The ExtremeEarth project develops Artificial Intelligence and Big Data technologies that scale to the petabytes of big Copernicus data, information and knowledge, and applies these technologies in two of the thematic exploitation platforms of the European Space Agency: the one dedicated to Food Security and the one dedicated to the Polar regions.
ExtremeEarth concentrates on developing techniques and software that will enable the extraction of information and knowledge from big Copernicus data using deep learning techniques and extreme geospatial analytics, and the development of two use cases based on this information and knowledge and other relevant non-EO data sets. ExtremeEarth will impact developments in the Integrated Ground Segment of Copernicus and the Sentinel Collaborative Ground Segment. ExtremeEarth tools and techniques can be used for extracting information and knowledge from big Copernicus data and making this information and knowledge available as linked data and, in this way, allow the easy development of applications by developers with minimal or no knowledge of EO techniques, file formats, data access protocols etc.
In the last few years, there have been four highly successful European research projects that have pursued this idea: the FP7 projects TELEIOS, LEO and Melodies, and the H2020 project Copernicus App Lab. These projects, under the lead of partner UoA, pioneered the use of linked geospatial data in the EO domain, and demonstrated the potential of linked data and semantic web technologies by developing prototype environmental and business applications. ExtremeEarth builds on the advances of these projects.
The data and information processed and disseminated puts Copernicus at the forefront of the Big Data paradigm, giving rise to all relevant challenges: volume, velocity, variety, veracity and value.
ExtremeEarth aims to close the gaps in research and innovation in the Copernicus context with significant impact for the European industry.
The deep neural network architectures classify effectively and efficiently multimedia images using extremely large benchmark datasets and utilizing the power of Big Data, Cloud and GPU technologies.
New tools have been developed in the projects TELEIOS, LEO, Melodies and Copernicus App Lab, for knowledge discovery and data mining from satellite images and related geospatial data sets, as well as tools for linked geospatial data integration, querying and analytics. However, none of these tools scales to the many petabytes of data, information and knowledge present in the Copernicus context.
Contrary to multimedia images, for which highly scalable Artificial Intelligence techniques based on deep neural network architectures have been developed by big North American companies such as Google and Facebook recently, similar architectures for satellite images, that can manage the extreme scale and characteristics of Copernicus data, do not exist in Europe or elsewhere today. Training datasets consisting of millions of data samples in the Copernicus context do not exist today and published deep learning architectures for Copernicus satellite images typically run using one GPU and do not take advantage of recent advances like distributed scale-out deep learning.
To make the Web of Data a reality, it is important to have this huge amount of data on the Web, available in a standard format, reachable and manageable by Semantic Web tools.
The technologies to be developed will extend the European Hopsworks data platform of partners Logical Clocks and KTH to offer unprecendented scalability to extreme data volumes and scale-out distributed deep learning for Copernicus data. The extended Hopsworks data platform will run on a DIAS selected after the project starts and will be available as open source to enable its adoption by the strong European Earth Observation downstream services industry.
ExtremeEarth is a H2020 proposal in the area of ICT addressing the call “ICT-12-2018-2020: Big Data technologies and extreme-scale analytics”. The main objective of ExtremeEarth is to develop extreme earth analytics techniques and technologies that scale to the petabytes of big Copernicus data, information and knowledge, and apply these technologies in two of the ESA TEPs: Food Security and Polar. The scientific and technical objectives of ExtremeEarth are the following: