Vol. 29, issue 09, article # 8

Kashnitskii A. V., Lupyan E. A., Bаlаshоv I. V., Konstantinova A. M. Technology for producing tools for processing and analysis of data from very large ever-expanding archives. // Optika Atmosfery i Okeana. 2016. V. 29. No. 09. P. 772–777. DOI: 10.15372/AOO20160908 [in Russian].
Copy the reference to clipboard

Abstract:

Rapid growth of Earth satellite observation data over the recent years actualizes the problem of development of new technologies for effective data search, selection and processing within very large distributed ever-expanding archives. The paper describes the features of such technologies developed by Space Research Institute of RAS (IKI RAN). These technologies provide implementation of various data processing tools for satellite data analysis operating with distributed computing resources of remote sensing data processing and archiving centers. The paper shows their advantages and capabilities and gives the examples of developed tools for distributed processing of data from various satellite remote sensing systems. The examples given are provided to demonstrate the possibilities of described tools for various atmospheric and ocean surface phenomena analysis.

Keywords:

remote sensing, information systems, distributed data processing, satellite data processing, very large data archives, data management technologies, ocean and atmosphere remote observation approaches

References:

  1. Lupjan E.A., Savorskij V.P., Shokin Ju.I., Aleksanin A.I., Nazirov R.R., Nedoluzhko I.V., Panova O.Ju. Sovremennye podhody i tehnologii organizacii raboty s dannymi distancionnogo zondirovanija Zemli dlja reshenija nauchnyh zadach // Sovremennye problemy distancionnogo zondirovanija Zemli iz kosmosa. 2012. V. 9, N 5. P. 21–44.
  2. Lupjan E.A., Balashov I.V., Burcev M.A., Efremov V.Ju., Kashnickij A.V., Kobec D.A., Krasheninnikova Ju.S., Mazurov A.A., Nazirov R.R., Proshin A.A., Sychugov I.G., Tolpin V.A., Uvarov I.A., Flitman E.V. Sozdanie tehnologij postroenija informacionnyh sistem distancionnogo monitoringa // Sovremennye problemy distancionnogo zondirovanija Zemli iz kosmosa. 2015. V. 12, N 5. P. 53–75.
  3. Kashnickij A.V., Balashov I.V., Lupjan E.A., Tolpin V.A., Uvarov I.A. Sozdanie instrumentov dlja udalennoj obrabotki sputnikovyh dannyh v sovremennyh informacionnyh sistemah // Sovremennye problemy distancionnogo zondirovanija Zemli iz kosmosa. 2015. V. 12, N 1. P. 156–170.
  4. Shokin Ju.I., Dobrecov N.N., Mamash E.A., Kihtenko V.A., Voronina P.V., Smirnov V.V., Chubarov D.L. Informacionnaja sistema priema, obrabotki i dostupa k sputnikovym dannym i ee primenenie dlja reshenija zadach monitoringa okruzhajushhej sredy // Vychislitel'nye tehnologii. 2015. V. 20, N 5. P. 157–174.
  5. Nedoluzhko I.V., Babjak P.V., Tarasov G.V., Erjomenko V.S. Infrastruktura priema, raspredelennoj obrabotki i postavki sputnikovyh dannyh v Centre kollektivnogo pol'zovanija Regional'nogo sputnikovogo monitoringa DVO RAN // Sovremennye problemy distancionnogo zondirovanija Zemli iz kosmosa. 2012. V. 9, N 3. PС. 324–331.
  6. Ramapriyan H.K., Behnke J., Sofinowski E., Lowe D., Esfandiari M.A. Evolution of the earth observing system (EOS) data and information system (EOSDIS) // Standard-Based Data and Information Systems for Earth Observation / Eds. Di Liping, H.K. Ramapriyan. 2010. P. 63–92.
  7. Acker J.G., Leptoukh G. Online analysis enhances use of NASA earth science data // Eos. Transactions American Geophysical Union. 2007. V. 88, N 2. P. 14–17.
  8. Gorelick N. Google Earth Engine // EGU General Assembly Conference Abstracts. 2013. V. 15. P. 11997.
  9. Balashov I.V., Burcev M.A., Efremov V.Ju., Lupjan E.A., Proshin A.A., Tolpin V.A. Postroenie arhivov rezul'tatov obrabotki sputnikovyh dannyh dlja sistem dinamicheskogo formirovanija proizvodnyh informacionnyh produktov // Sovremennye problemy distancionnogo zondirovanija Zemli iz kosmosa. 2008. V. 5, N 1. P. 26–32.
  10. Efremov  V.Ju., Krasheninnikova Ju.S., Lupjan E.A., Mazurov A.A., Proshin A.A., Flitman E.V. Optimizirovannaja sistema hranenija i predstavlenija geograficheski privjazannyh sputnikovyh dannyh /Sovremennye problemy distancionnogo zondirovanija Zemli iz kosmosa. 2007. V. 4, N 1. P. 125–132.
  11. Tolpin V.A., Balashov I.V., Efremov V.Ju., Lupjan E.A., Proshin A.A., Uvarov I.A., Flitman E.V. Sozdanie interfejsov dlja raboty s dannymi sovremennyh sistem distancionnogo monitoringa (sistema GEOSMIS) // Sovremennye problemy distancionnogo zondirovanija Zemli iz kosmosa. 2011. V. 8, N 3. P. 93–108.
  12. Neteler M., Bowman M.H., Landa M., Metz M. GRASS GIS: A multi-purpose open source GIS // Environmental Modelling & Software. 2012. V. 31. P. 124–130.
  13. He J., Zha Y., Zhang J., Gao J. Aerosol indices derived from MODIS data for indicating aerosol-induced air pollution // Remote Sens. 2014. V. 6, N 2. P. 1587–1604.
  14. Marshak A., Knyazikhin Y., Davis A.B., Wiscombe W., Pilewskie P. Cloud – vegetation interaction: Use of Normalized Difference Cloud Index for estimation of cloud optical thickness // Geophys. Res. Lett. 2000. V. 27, N 12. P. 1695–1698.
  15. Lupjan E.A., Savin I.Ju., Bartalev S.A., Tolpin V.A., Balashov I.V., Plotnikov D.E. Sputnikovyj servis monitoringa sostojanija rastitel'nosti («VEGA») // Sovremennye problemy distancionnogo zondirovanija Zemli iz kosmosa. 2011. V. 8, N 1. P. 190–198.
  16. Bartalev S.A., Ershov D.V., Korovin G.N., Kotel'nikov  R.V., Lupjan E.A., Shhetinskij V.E. Osnovnye vozmozhnosti i struktura informacionnoj sistemy distancionnogo monitoringa lesnyh pozharov Federal'nogo agentstva lesnogo hozjajstva (ISDM Rosleshoz) // Sovremennye problemy distancionnogo zondirovanija Zemli iz kosmosa. 2010. V. 7, N 2. P. 97–105.
  17. Lupjan E.A., Bartalev S.A., Ershov D.V., Kotel'nikov R.V., Balashov I.V., Burcev M.A., Egorov V.A., Efremov V.Ju., Zharko V.O., Kovganko K.A., Kolbudaev P.A., Krasheninnikova Ju.S., Proshin A.A., Mazurov A.A., Uvarov I.A., Stycenko F.V., Sychugov I.G., Flitman E.V., Hvostikov S.A., Shuljak P.P. Organizacija raboty so sputnikovymi dannymi v informacionnoj sisteme distancionnogo monitoringa lesnyh pozharov Federal'nogo agentstva lesnogo hozjajstva (ISDM Rosleshoz) // Sovremennye problemy distancionnogo zondirovanija Zemli iz kosmosa. 2015. V. 12, N 5. P. 222–250.
  18. Lupjan E.A., Milehin O.E., Antonov V.N., Kramareva L.S., Burcev M.A., Balashov I.V., Tolpin V.A., Solov'ev V.I. Sistema raboty s ob#edinennymi informacionnymi resursami, poluchaemymi na osnove sputnikovyh dannyh v centrah NIC «PLANETA» // Meteorol. i gidrol. 2014. N 12. P. 89–97.
  19. Lupjan E.A., Matveev A.A., Uvarov I.A., Bocharova T.Ju., Lavrova O.Ju., Mitjagina M.I. Sputnikovyj servis See the Sea – instrument dlja izuchenija razlichnyh javlenij na poverhnosti okeana // Sovremennye problemy distancionnogo zondirovanija Zemli iz kosmosa. 2012. V. 9, N 2. P. 251–262.
  20. Efremov V.Ju., Girina O.A., Kramareva L.S., Lupjan E.A., Manevich A.G., Mel'nikov D.V., Matveev A.M., Proshin A.A., Sorokin A.A., Flitman E.V. Sozdanie informacionnogo servisa «Distancionnyj monitoring aktivnosti vulkanov Kamchatki i Kuril» // Sovremennye problemy distancionnogo zondirovanija Zemli iz kosmosa. 2012. V. 9, N 5. P. 155–170.
  21. Lupjan E.A., Burcev M.A., Balashov I.V., Bartalev S.A., Efremov V.Ju., Kashnickij A.V., Mazurov A.A., Matveev A.M., Sudneva O.A., Sychugov I.G., Tolpin V.A., Uvarov I.A. Centr kollektivnogo pol'zovanija sistemami arhivacii, obrabotki i analiza sputnikovyh dannyh IKI RAN dlja reshenija zadach izuchenija i monitoringa okruzhajushhej sredy // Sovremennye problemy distancionnogo zondirovanija Zemli iz kosmosa. 2015. V. 12, N 5. P. 263–284.