SciTransfer
EXTRACT · Project

Distributed Software Platform for Processing Massive and Scattered Big Data

digitalTestedTRL 5

Imagine trying to solve a giant puzzle where the pieces are scattered across different cities and arrive at different speeds. Instead of bringing all the pieces to one room, which would take forever, this system sends the solving tools to where the pieces are. It connects small local computers, big cloud servers, and supercomputers into one single team to find answers quickly.

By the numbers
2000
radio-telescopes processed for solar activity
12
total deliverables
The business problem

What needed solving

Current data tools fail when data is too large, too fast, or too scattered across different locations. This creates a gap where companies cannot extract reliable knowledge from complex, dispersed data sources in real-time.

The solution

What was built

An open-source software platform that manages the full lifecycle of extreme data mining. It includes tools for data-driven orchestration, distributed monitoring, and cybersecurity across edge, cloud, and HPC layers.

Audience

Who needs this

Smart City Infrastructure OperatorsLarge-scale Scientific Research CentersIndustrial IoT Platform ProvidersEmergency Response Coordination Centers
Business applications

Who can put this to work

Public Safety
enterprise
Target: City Emergency Management Agency

If you are a city agency dealing with chaotic evacuation data during a crisis — this project developed a platform that integrates 5G signals and IoT sensors to create personalized evacuation routes. This ensures civilian-centric crisis management by processing extreme data in real-time.

Aerospace & Astronomy
enterprise
Target: Radio-Telescope Research Facility

If you are a research facility dealing with massive data streams from 2000 radio-telescopes — this project developed a system that performs real-time assessment of solar activity. This allows for immediate scientific exploitation of extreme data volumes.

Smart Infrastructure
mid-size
Target: IoT Network Provider

If you are a provider dealing with dispersed data sources and high energy costs — this project developed an open-source software platform that optimizes how data moves between edge and cloud. This results in more energy-efficient and secure data mining workflows.

Frequently asked

Quick answers

What is the cost or pricing model for this software?

Based on available project data, the platform is being developed as open-source software, though specific commercial pricing is not mentioned.

Can this be scaled to industrial levels?

Yes, the project specifically targets 'extreme data' and integrates HPC, cloud, and edge computing to ensure scalability across a compute continuum.

Who owns the IP and how is it licensed?

The project objective states it will deliver an open-source software platform, but specific licensing terms are not detailed in the provided text.

How does this integrate with existing hardware?

It is designed to work across a heterogeneous compute continuum, meaning it glues together edge devices, cloud storage, and High-Performance Computing (HPC) resources.

When will the platform be available for business use?

The project period runs from 2023-01-01 to 2025-12-31, suggesting the final results will be ready by the end of 2025.

Consortium

Who built it

The consortium is well-balanced for technology transfer, consisting of 12 partners across 6 countries. With a 33% industry ratio (4 companies, including 3 SMEs), there is a strong link between the academic research (7 partners) and practical commercial application, led by the Barcelona Supercomputing Center.

How to reach the team

Contact the Barcelona Supercomputing Center (BSC) regarding the EXTRACT platform.

Next steps

Talk to the team behind this work.

Contact us to find out how to integrate this open-source extreme data platform into your infrastructure.