Nowadays,the use of Machine Learning(ML)onboard Earth Observation(EO)satellites has been investigated for a plethora of applications relying on multispectral and hyperspectral imaging.Traditionally,these studies have ...Nowadays,the use of Machine Learning(ML)onboard Earth Observation(EO)satellites has been investigated for a plethora of applications relying on multispectral and hyperspectral imaging.Traditionally,these studies have heavily relied on high-end data products,subjected to extensive pre-processing chains natively designed to be executed on the ground.However,replicating such algorithms onboard EO satellites poses significant challenges due to their computational intensity and need for additional metadata,which are typically unavailable on board.Because of that,current missions exploring onboard ML models implement simplified but still complex processing chains that imitate their on-ground counterparts.Despite these advancements,the potential of ML models to process raw satellite data directly remains largely unexplored.To fill this gap,this paper investigates the feasibility of applying ML models directly to Sentinel-2 raw data to perform thermal hotspot classification.This approach significantly limits the processing steps to simple and lightweight algorithms to achieve real-time processing of data with low power consumption.To this aim,we present an end-to-end(E2E)pipeline to create a binary classification map of Sentinel-2 raw granules,where each point suggests the absence/presence of a thermal anomaly in a square area of 2.5 km.To this aim,lightweight coarse spatial registration is applied to register three different bands,and an EfficientNetlite0 model is used to perform the classification of the various bands.The trained models achieve an average Matthew’s correlation coefficient(MCC)score of 0.854(on 5 seeds)and a maximum MCC of 0.90 on a geographically tripartite dataset of cropped images from the THRawS dataset.The proposed E2E pipeline is capable of processing a Sentinel-2 granule in 1.8 s and within 6.4 W peak power on a combination of Raspberry PI 4 and CogniSat-XE2 board,demonstrating real-time performance.展开更多
While novel artificial intelligence and machine learning techniques are evolving and disrupting established terrestrial technologies at an unprecedented speed,their adaptation onboard satellites is seemingly lagging.A...While novel artificial intelligence and machine learning techniques are evolving and disrupting established terrestrial technologies at an unprecedented speed,their adaptation onboard satellites is seemingly lagging.A major hindrance in this regard is the need for highquality annotated data for training such systems,which makes the development process of machine learning solutions costly,time-consuming,and inefficient.This paper presents“the OPS-SAT case”,a novel data-centric competition that seeks to address these challenges.The powerful computational capabilities of the European Space Agency’s OPS-SAT satellite are utilized to showcase the design of machine learning systems for space by using only the small amount of available labeled data,relying on the widely adopted and freely available open-source software.The generation of a suitable dataset,design and evaluation of a public data-centric competition,and results of an onboard experimental campaign by using the competition winners’machine learning model directly on OPS-SAT are detailed.The results indicate that adoption of open standards and deployment of advanced data augmentation techniques can retrieve meaningful onboard results comparatively quickly,simplifying and expediting an otherwise prolonged development period.展开更多
文摘Nowadays,the use of Machine Learning(ML)onboard Earth Observation(EO)satellites has been investigated for a plethora of applications relying on multispectral and hyperspectral imaging.Traditionally,these studies have heavily relied on high-end data products,subjected to extensive pre-processing chains natively designed to be executed on the ground.However,replicating such algorithms onboard EO satellites poses significant challenges due to their computational intensity and need for additional metadata,which are typically unavailable on board.Because of that,current missions exploring onboard ML models implement simplified but still complex processing chains that imitate their on-ground counterparts.Despite these advancements,the potential of ML models to process raw satellite data directly remains largely unexplored.To fill this gap,this paper investigates the feasibility of applying ML models directly to Sentinel-2 raw data to perform thermal hotspot classification.This approach significantly limits the processing steps to simple and lightweight algorithms to achieve real-time processing of data with low power consumption.To this aim,we present an end-to-end(E2E)pipeline to create a binary classification map of Sentinel-2 raw granules,where each point suggests the absence/presence of a thermal anomaly in a square area of 2.5 km.To this aim,lightweight coarse spatial registration is applied to register three different bands,and an EfficientNetlite0 model is used to perform the classification of the various bands.The trained models achieve an average Matthew’s correlation coefficient(MCC)score of 0.854(on 5 seeds)and a maximum MCC of 0.90 on a geographically tripartite dataset of cropped images from the THRawS dataset.The proposed E2E pipeline is capable of processing a Sentinel-2 granule in 1.8 s and within 6.4 W peak power on a combination of Raspberry PI 4 and CogniSat-XE2 board,demonstrating real-time performance.
文摘While novel artificial intelligence and machine learning techniques are evolving and disrupting established terrestrial technologies at an unprecedented speed,their adaptation onboard satellites is seemingly lagging.A major hindrance in this regard is the need for highquality annotated data for training such systems,which makes the development process of machine learning solutions costly,time-consuming,and inefficient.This paper presents“the OPS-SAT case”,a novel data-centric competition that seeks to address these challenges.The powerful computational capabilities of the European Space Agency’s OPS-SAT satellite are utilized to showcase the design of machine learning systems for space by using only the small amount of available labeled data,relying on the widely adopted and freely available open-source software.The generation of a suitable dataset,design and evaluation of a public data-centric competition,and results of an onboard experimental campaign by using the competition winners’machine learning model directly on OPS-SAT are detailed.The results indicate that adoption of open standards and deployment of advanced data augmentation techniques can retrieve meaningful onboard results comparatively quickly,simplifying and expediting an otherwise prolonged development period.
