Pressures on natural resources are increasing and a number of challenges need to be overcome to meet the needs of a growing population in a period of environmental variability.Some of these environmental issues can be...Pressures on natural resources are increasing and a number of challenges need to be overcome to meet the needs of a growing population in a period of environmental variability.Some of these environmental issues can be monitored using remotely sensed Earth Observations(EO)data that are increasingly available from a number of freely and openly accessible repositories.However,the full information potential of EO data has not been yet realized.They remain still underutilized mainly because of their complexity,increasing volume,and the lack of efficient processing capabilities.EO Data Cubes(DC)are a new paradigm aiming to realize the full potential of EO data by lowering the barriers caused by these Big data challenges and providing access to large spatio-temporal data in an analysis ready form.Systematic and regular provision of Analysis Ready Data(ARD)will significantly reduce the burden on EO data users.Nevertheless,ARD are not commonly produced by data providers and therefore getting uniform and consistent ARD remains a challenging task.This paper presents an approach to enable rapid data access and pre-processing to generate ARD using interoperable services chains.The approach has been tested and validated generating Landsat ARD while building the Swiss Data Cube.展开更多
The rapid growth of remote sensing big data(RSBD)has attracted considerable attention from both academia and industry.Despite the progress of computer technologies,conventional computing implementations have become te...The rapid growth of remote sensing big data(RSBD)has attracted considerable attention from both academia and industry.Despite the progress of computer technologies,conventional computing implementations have become technically inefficient for processing RSBD.Cloud computing is effective in activating and mining large-scale heterogeneous data and has been widely applied to RSBD over the past years.This study performs a technical review of cloud-based RSBD storage and computing from an interdisciplinary viewpoint of remote sensing and computer science.First,we elaborate on four critical technical challenges resulting from the scale expansion of RSBD applications,i.e.raster storage,metadata management,data homogeneity,and computing paradigms.Second,we introduce state-of-the-art cloud-based data management technologies for RSBD storage.The unit for manipulating remote sensing data has evolved due to the scale expansion and use of novel technologies,which we name the RSBD data model.Four data models are suggested,i.e.scenes,ARD,data cubes,and composite layers.Third,we summarize recent research on the application of various cloud-based parallel computing technologies to RSBD computing implementations.Finally,we categorize the architectures of mainstream RSBD platforms.This research provides a comprehensive review of the fundamental issues of RSBD for computing experts and remote sensing researchers.展开更多
Petascale archives of Earth observations from space(EOS)have the potential to characterise water resources at continental scales.For this data to be useful,it needs to be organised,converted from individual scenes as ...Petascale archives of Earth observations from space(EOS)have the potential to characterise water resources at continental scales.For this data to be useful,it needs to be organised,converted from individual scenes as acquired by multiple sensors,converted into“analysis ready data”,and made available through high performance computing platforms.Moreover,converting this data into insights requires integration of non-EOS data-sets that can provide biophysical and climatic context for EOS.Digital Earth Australia has demonstrated its ability to link EOS to rainfall and stream gauge data to provide insight into surface water dynamics during the hydrological extremes of flood and drought.This information is supporting the characterisation of groundwater resources across Australia’s north and could potentially be used to gain an understanding of the vulnerability of transport infrastructure to floods in remote,sparsely gauged regions of northern and central Australia.展开更多
Aiming at the convergence between Earth observation(EO)Big Data and Artificial General Intelligence(AGI),this paper consists of two parts.In the previous Part 1,existing EO optical sensory imagederived Level 2/Analysi...Aiming at the convergence between Earth observation(EO)Big Data and Artificial General Intelligence(AGI),this paper consists of two parts.In the previous Part 1,existing EO optical sensory imagederived Level 2/Analysis Ready Data(ARD)products and processes are critically compared,to overcome their lack of harmonization/standardization/interoperability and suitability in a new notion of Space Economy 4.0.In the present Part 2,original contributions comprise,at the Marr five levels of system understanding:(1)an innovative,but realistic EO optical sensory image-derived semantics-enriched ARD co-product pair requirements specification.First,in the pursuit of third-level semantic/ontological interoperability,a novel ARD symbolic(categorical and semantic)co-product,known as Scene Classification Map(SCM),adopts an augmented Cloud versus Not-Cloud taxonomy,whose Not-Cloud class legend complies with the standard fully-nested Land Cover Classification System’s Dichotomous Phase taxonomy proposed by the United Nations Food and Agriculture Organization.Second,a novel ARD subsymbolic numerical co-product,specifically,a panchromatic or multispectral EO image whose dimensionless digital numbers are radiometrically calibrated into a physical unit of radiometric measure,ranging from top-of-atmosphere reflectance to surface reflectance and surface albedo values,in a five-stage radiometric correction sequence.(2)An original ARD process requirements specification.(3)An innovative ARD processing system design(architecture),where stepwise SCM generation and stepwise SCM-conditional EO optical image radiometric correction are alternated in sequence.(4)An original modular hierarchical hybrid(combined deductive and inductive)computer vision subsystem design,provided with feedback loops,where software solutions at the Marr two shallowest levels of system understanding,specifically,algorithm and implementation,are selected from the scientific literature,to benefit from their technology readiness level as proof of feasibility,required in addition to proven suitability.To be implemented in operational mode at the space segment and/or midstream segment by both public and private EO big data providers,the proposed EO optical sensory image-derived semantics-enriched ARD product-pair and process reference standard is highlighted as linchpin for success of a new notion of Space Economy 4.0.展开更多
基金The authors would like to thank the Swiss Federal Office for the Environment(FOEN)for their financial support to the Swiss Data Cube.
文摘Pressures on natural resources are increasing and a number of challenges need to be overcome to meet the needs of a growing population in a period of environmental variability.Some of these environmental issues can be monitored using remotely sensed Earth Observations(EO)data that are increasingly available from a number of freely and openly accessible repositories.However,the full information potential of EO data has not been yet realized.They remain still underutilized mainly because of their complexity,increasing volume,and the lack of efficient processing capabilities.EO Data Cubes(DC)are a new paradigm aiming to realize the full potential of EO data by lowering the barriers caused by these Big data challenges and providing access to large spatio-temporal data in an analysis ready form.Systematic and regular provision of Analysis Ready Data(ARD)will significantly reduce the burden on EO data users.Nevertheless,ARD are not commonly produced by data providers and therefore getting uniform and consistent ARD remains a challenging task.This paper presents an approach to enable rapid data access and pre-processing to generate ARD using interoperable services chains.The approach has been tested and validated generating Landsat ARD while building the Swiss Data Cube.
基金supported by Strategic Priority Research Program of the Chinese Academy of Sciences,Project title:CASEarth:[Grant Number XDA19080103,XDA19080101]Innovation Drive Development Special Project of Guangxi:[Grant Number GuikeAA20302022]National Natural Science Foundation of China:[Grant Number 41974108].
文摘The rapid growth of remote sensing big data(RSBD)has attracted considerable attention from both academia and industry.Despite the progress of computer technologies,conventional computing implementations have become technically inefficient for processing RSBD.Cloud computing is effective in activating and mining large-scale heterogeneous data and has been widely applied to RSBD over the past years.This study performs a technical review of cloud-based RSBD storage and computing from an interdisciplinary viewpoint of remote sensing and computer science.First,we elaborate on four critical technical challenges resulting from the scale expansion of RSBD applications,i.e.raster storage,metadata management,data homogeneity,and computing paradigms.Second,we introduce state-of-the-art cloud-based data management technologies for RSBD storage.The unit for manipulating remote sensing data has evolved due to the scale expansion and use of novel technologies,which we name the RSBD data model.Four data models are suggested,i.e.scenes,ARD,data cubes,and composite layers.Third,we summarize recent research on the application of various cloud-based parallel computing technologies to RSBD computing implementations.Finally,we categorize the architectures of mainstream RSBD platforms.This research provides a comprehensive review of the fundamental issues of RSBD for computing experts and remote sensing researchers.
文摘Petascale archives of Earth observations from space(EOS)have the potential to characterise water resources at continental scales.For this data to be useful,it needs to be organised,converted from individual scenes as acquired by multiple sensors,converted into“analysis ready data”,and made available through high performance computing platforms.Moreover,converting this data into insights requires integration of non-EOS data-sets that can provide biophysical and climatic context for EOS.Digital Earth Australia has demonstrated its ability to link EOS to rainfall and stream gauge data to provide insight into surface water dynamics during the hydrological extremes of flood and drought.This information is supporting the characterisation of groundwater resources across Australia’s north and could potentially be used to gain an understanding of the vulnerability of transport infrastructure to floods in remote,sparsely gauged regions of northern and central Australia.
基金ASAP 16 project call,project title:SemantiX-A cross-sensor semantic EO data cube to open and leverage essential climate variables with scientists and the public,Grant ID:878939ASAP 17 project call,project title:SIMS-Soil sealing identification and monitoring system,Grant ID:885365.
文摘Aiming at the convergence between Earth observation(EO)Big Data and Artificial General Intelligence(AGI),this paper consists of two parts.In the previous Part 1,existing EO optical sensory imagederived Level 2/Analysis Ready Data(ARD)products and processes are critically compared,to overcome their lack of harmonization/standardization/interoperability and suitability in a new notion of Space Economy 4.0.In the present Part 2,original contributions comprise,at the Marr five levels of system understanding:(1)an innovative,but realistic EO optical sensory image-derived semantics-enriched ARD co-product pair requirements specification.First,in the pursuit of third-level semantic/ontological interoperability,a novel ARD symbolic(categorical and semantic)co-product,known as Scene Classification Map(SCM),adopts an augmented Cloud versus Not-Cloud taxonomy,whose Not-Cloud class legend complies with the standard fully-nested Land Cover Classification System’s Dichotomous Phase taxonomy proposed by the United Nations Food and Agriculture Organization.Second,a novel ARD subsymbolic numerical co-product,specifically,a panchromatic or multispectral EO image whose dimensionless digital numbers are radiometrically calibrated into a physical unit of radiometric measure,ranging from top-of-atmosphere reflectance to surface reflectance and surface albedo values,in a five-stage radiometric correction sequence.(2)An original ARD process requirements specification.(3)An innovative ARD processing system design(architecture),where stepwise SCM generation and stepwise SCM-conditional EO optical image radiometric correction are alternated in sequence.(4)An original modular hierarchical hybrid(combined deductive and inductive)computer vision subsystem design,provided with feedback loops,where software solutions at the Marr two shallowest levels of system understanding,specifically,algorithm and implementation,are selected from the scientific literature,to benefit from their technology readiness level as proof of feasibility,required in addition to proven suitability.To be implemented in operational mode at the space segment and/or midstream segment by both public and private EO big data providers,the proposed EO optical sensory image-derived semantics-enriched ARD product-pair and process reference standard is highlighted as linchpin for success of a new notion of Space Economy 4.0.
