New Embed2Scale Project: Earth Observation and Weather Data Federation with AI Embeddings

Embed2Scale kickoff at EUSPA in Prague: A new step towards AI-driven management of the data deluge in the Copernicus Program. Copyright: Jülich Supercomputing Center

On January 15, 2024, the kickoff meeting of the EU project Embed2Scale took place at the European Union Agency for the Space Programme (EUSPA) in Prague. Led by MARTEL INNOVATE BV, this project brings together ten partners, including theJülich Supercomputing Center from Forschungszentrum Jülich. Its aim is to address the challenges associated with the vast data volumes of the Copernicus program through AI-driven data compression. (Source: Jülich Supercomputing Centre – News flashes)

The true potential of the European Union’s Earth Observation Copernicus Programme is unlocked when integrated with additional geo-information, such as weather models and GNSS data. However, managing hundreds of petabytes of geospatial data is challenging, as no single platform can store it all. Service providers often download data from various archives, but the vast amount of data makes some applications economically unfeasible.

Embed2Scale aims to address these challenges by facilitating efficient data exchange through AI-driven data compression. It will develop methods to convert raw geo-information into highly compressed embeddings, potentially reducing the size by up to 1000 times. The envisaged key breakthroughs include enabling decentralized applications through significant data volume reduction, enhancing the portability of geospatial analytics by reducing computational demands, minimizing data labeling through few-shot learning, and enabling near-real-time, petabyte-scale searches of earth observation and climate data. The plan is to demonstrate these advancements with practical applications in the Copernicus Programme and to foster community growth through open-source contributions and standardization. The embedding technology will be tested in four areas: maritime monitoring, aboveground biomass measurement, climate and air pollution forecasting, and early detection of crop stress and yield.

More information can be found on the project website.

05.02.2024, Jülich Supercomputing Centre – News flashes

The original press release can be found at: 

New Embed2Scale Project: Earth Observation and Weather Data Federation with AI Embeddings

Localization in Helmholtz Information:

Helmholtz Information, Program 1: Engineering Digital Futures, Topic 1: Enabling Computational- & Data-Intensive Science and Engineering

Further Information:

Also, visit our official website and follow us on our LinkedIn channel of Helmholtz Information to receive up-to-date information, event announcements, and insights into our research activities in Helmholtz Information.

Contact:

Prof. Dr. -Ing. Gabriele Cavallaro
Institute for Advanced Simulation (IAS)
Jülich Supercomputing Centre (JSC)
Forschungszentrum Jülich
Phone: +49 2461/61-3858
E-Mail: g.cavallaro@fz-juelich.de

Dr. Stefan Kesselheim
Institute for Advanced Simulation (IAS)
Jülich Supercomputing Centre (JSC)
Forschungszentrum Jülich
Phone: +49 2461/61-85927
E-Mail: s.kesselheim@fz-juelich.de

Add comment

Related posts