|
Article information
2018 , Volume 23, ¹ 3, p.58-76
Krotov K.V.
The complex method for definition of effective decisions on data set composition and shedule for their processing in conveyor systems
The task of controlling the pipelined processing for various types of remote sensing data of the Earth is important. The task of managing the data processing process is complex and represents a set of two interrelated subtasks - the definition of the composition of batches and the schedules of their processing. The complex task of managing the processing of data lots is represented in the form of hierarchy of the required subtasks. The realization of effective decisions on the composition of parties is realized at the top level, schedules and their processing - on the lower level. A hierarchical game model (two-level programming) for determining solutions at the appropriate levels is accordingly designed. The final time for processing all data entering the system is considered as a criterion at the upper level (to determine the composition of data lots). The total downtiming of the pipeline segments when processing batches of data is the criterion at the lower level. Local optimization methods are proposed at each level of the hierarchy to determine effective solutions. The method for determining solutions by party composition provides for the search for a better solution in the vicinity of different types of the current locally optimal solution. The approaches of making decisions on the composition of parties in the vicinity of the respective species are formulated. The proof of both theorems determining the conditions for the end of the change in the composition of a given number of batches and that eliminates duplication of solutions in a certain neighborhood is accomplished. A generalized algorithm for determining locally optimal solutions by party composition, acting on the upper level of the hierarchy, is formulated based on these methods. The algorithm for determining effective schedules is based on “greedy” strategies and involves adding each new batch to the processing sequences optimized in the previous steps and determining an effective position for them in this order. Software implementation of the developed methods of local optimization of solutions at each level of the hierarchy is completed. Studies for the dependence of the effectiveness of the proposed methods (in particular, the method of forming batches of batches) on the parameters of the system and the data processed are carried out. The obtained results have shown that use of the offered method of the definition of batches allows considerable reducing for the time of processing of batches of the data in the conveyor system. The efficiency of the treatment is then increased by 10% to 80%.
[full text]
Keywords: batch processing schedules, conveyor system, two-level game model, batch composition determination method
doi: 10.25743/ICT.2018.3.15984
Author(s):
Krotov Kirill Victorovich
PhD. , Associate Professor
Position: Associate Professor
Office: Sevastopol State University
Address: 290053, Russia, Sevastopol, Universitetskaya street, 33
Phone Office: (8692)435-364
E-mail: krotov_k1@mail.ru
References:
[1] Miklashevich, E.S., Balashov, I.V., Burtsev, M.A., Efremov, V. Y. , Mazurov, A.A., Matveev, A.M., Proshin, A.A., Radchenko, M.V., Flitman, E.V. Complex system for the receiving, processing, archiving and distribution of satellite data and products of thematic processing. CURRENT PROBLEMS IN REMOTE SENSING OF THE EARTH FROM SPACE. 2012; 9(4):47–56. (In Russ.)
[2] Loupian, E.A., Balashov, I.V., Bourtsev, M.A., Efremov, V.Yu., Kashnitskiy, A.V., Kobets, D.A., Krasheninnikova, Yu.S. , Mazurov, A.A. , Nazirov, R.R. , Proshin, A.A. , Sychugov, I.G. , Tolpin, V.A. , Uvarov, I.A. , Flitman, E.V. Development of information systems design technologies. CURRENT PROBLEMS IN REMOTE SENSING OF THE EARTH FROM SPACE. 2015; 12(5):53–75. (In Russ.)
[3] Lupyan, Ye. A., Proshin, A. A., Burtsev, M. A., Balashov, S. A., Bartalev, S. A., Efremov, V. Y., Kashnitsky, A. V., Mazurov, A. A., Matveev, A. M., Sudneva, O. A., Sychugov, I. G., Tolpin, V. A., Uvarov, I. A. IKI center for collective use of satellite data archiving, processing and analysis systems aimed at solving the problems of environmental study and monitoring. Current problems in remote sensing of the earth from space. 2015; 12(5):263-284 (In Russ.).
[4] Bartalev, S. A., Egorov, V. A., Zharko, V. O., Lupyan, J. A., Plotnikov, D. E., Khvostikov, S. A., Shabanov, N. V. Sputnikovoe kartografirovanie rastitel'nogo pokrova Rossii [Satellite mapping of vegetation cover of Russia]. Moscow: IKI RAN; 2016: 208. (In Russ.).
[5] Kashnitsky, A. V., Balashov, I. V., Lupyan, J. A., Tolpin, V. A., Uvarov, I. A. Development of software tools for satellite data remote processing in contemporary information systems. Current problems in remote sensing of the earth from space. 2015; 12(1):156-170. (In Russ.).
[6] Kobets, D. A., Matveev, A. M., Mazurov, A. A., Proshin, A. A. Organization of automated multithreaded processing of satellite information in remote monitoring systems. Current problems in remote sensing of the earth from space. 2015; 12(1):145-155. (In Russ.).
[7] Shokin, Y. I., Pestunov, I. A., Smirnov, V. V., Sinyavskiy, Yu. N., Skachkova, A. P., Dubrov, I. S., Levin, V. A., Aleksanin, A. I., Aleksanina, M. G., Babiak, P. V., Gromov, A. V., Nedoluzhko, I. V. The Distributed Informational System of Satellite Data Collecting, Storage and Processing for Siberia and the Far East Territories Monitoring. Journal of Siberian Federal University. Engineering & Technologies. 2008; 1(4):291-314. (In Russ.)
[8] Shokin, Y. I., Dobretsov, N. N., Kikhtenko, V. A., Smirnov, V. V., Chubarov, D. L., Chubarov, L. B. On a distributed infrastructure for the monitoring of satellite remote sensing data using the center for shared access. Computational technologies. 2013; 18(Special issue):86-94.
[9] Babiak, P. V., Nedoluzhko, I. V., Fomin, E. V. Approach to the provision of services for the processing of satellite data in the Center of collective use for regional satellite environmental monitoring of the FEB of RAS. Proceedings of the XIVth all-Russian joint conference "Internet and modern society" (IMS-2011), 10-12 October 2011. St. Petersburg, Russia; 2011:27-32. (In Russ.)
[10] Teo, Y.M., Tay, S.C., Low, S.C., Gozali, J.P. Distributed Geo-rectification of Satellite Images using Grid Computing. Proceedings of International Parallel and Distributed Processing Symposium. IEEE Computer Society Press; 2003:152–157.
[11] Suarez, R.A., Nesmachnow, S. Parallel Computing Applied to Satellite Images processing for Solar Resource Estimates. CLEI Electronic Journal. 2012; 15(3):paper 4.
[12] Krotov, K.V. Multilevel model of construction of the processing schedules batch data in conveyor systems in the formation of sets and availability restrictions. Trudy SPIIRAN . 2016; 4(47): 65-91. (In Russ.)
[13] Krotov, K. V. Using the method of genetic algorithms for designing the decisions for the composition of data batches in a two-level problem of building complex schedules within their processing. Avtomatizirovannye tekhnologii i proizvodstva. Mezhdunarodnyy nauchno-tekhnicheskiy zhurnal. 2017; 2(16):23-34. (In Russ.)
[14] Kovalev, M. M. Matroidy v diskretnoy optimizatsii [Matroids in discrete optimization]. Moscow: Izd-vo Editorial URSS; 2003: 224. (In Russ.)
Bibliography link:
Krotov K.V. The complex method for definition of effective decisions on data set composition and shedule for their processing in conveyor systems // Computational technologies. 2018. V. 23. ¹ 3. P. 58-76
|
