If you are a city agency dealing with chaotic evacuation data during a crisis — this project developed a platform that integrates 5G signals and IoT sensors to create personalized evacuation routes. This ensures civilian-centric crisis management by processing extreme data in real-time.
Distributed Software Platform for Processing Massive and Scattered Big Data
Imagine trying to solve a giant puzzle where the pieces are scattered across different cities and arrive at different speeds. Instead of bringing all the pieces to one room, which would take forever, this system sends the solving tools to where the pieces are. It connects small local computers, big cloud servers, and supercomputers into one single team to find answers quickly.
What needed solving
Current data tools fail when data is too large, too fast, or too scattered across different locations. This creates a gap where companies cannot extract reliable knowledge from complex, dispersed data sources in real-time.
What was built
An open-source software platform that manages the full lifecycle of extreme data mining. It includes tools for data-driven orchestration, distributed monitoring, and cybersecurity across edge, cloud, and HPC layers.
Who needs this
Who can put this to work
If you are a research facility dealing with massive data streams from 2000 radio-telescopes — this project developed a system that performs real-time assessment of solar activity. This allows for immediate scientific exploitation of extreme data volumes.
If you are a provider dealing with dispersed data sources and high energy costs — this project developed an open-source software platform that optimizes how data moves between edge and cloud. This results in more energy-efficient and secure data mining workflows.
Quick answers
What is the cost or pricing model for this software?
Based on available project data, the platform is being developed as open-source software, though specific commercial pricing is not mentioned.
Can this be scaled to industrial levels?
Yes, the project specifically targets 'extreme data' and integrates HPC, cloud, and edge computing to ensure scalability across a compute continuum.
Who owns the IP and how is it licensed?
The project objective states it will deliver an open-source software platform, but specific licensing terms are not detailed in the provided text.
How does this integrate with existing hardware?
It is designed to work across a heterogeneous compute continuum, meaning it glues together edge devices, cloud storage, and High-Performance Computing (HPC) resources.
When will the platform be available for business use?
The project period runs from 2023-01-01 to 2025-12-31, suggesting the final results will be ready by the end of 2025.
Who built it
The consortium is well-balanced for technology transfer, consisting of 12 partners across 6 countries. With a 33% industry ratio (4 companies, including 3 SMEs), there is a strong link between the academic research (7 partners) and practical commercial application, led by the Barcelona Supercomputing Center.
Contact the Barcelona Supercomputing Center (BSC) regarding the EXTRACT platform.
Talk to the team behind this work.
Contact us to find out how to integrate this open-source extreme data platform into your infrastructure.