If you are a data analytics firm dealing with massive volumes of satellite imagery — this project developed a Big Data Analytics Framework that allows for processing outsize usage scenarios. This means you can analyze datasets that are too large for standard hardware.
Cloud-Based Big Data Analytics Platform for Massive Space and Satellite Datasets
Imagine trying to find a single needle in a mountain of hay, but the hay is the size of the galaxy. This project builds a giant digital magnifying glass and a super-powered sorting machine in the cloud to handle this. It lets researchers sift through massive amounts of space data without needing their own expensive supercomputers.
What needed solving
Scientific and commercial entities struggle to analyze massive space datasets because they lack the expensive, specialized infrastructure required for Big Data mining.
What was built
A Big Data Analytics Framework (BDAF) and a cloud-based computational environment for processing ESA mission data.
Who needs this
Who can put this to work
If you are a cloud provider dealing with high-performance computing demands for science — this project developed a computational environment for Big Data and Data Mining. You can use these methods to optimize how you host and process massive scientific archives.
If you are a space tech company dealing with the sheer volume of ESA mission data — this project developed tools and methods to analyze these products. This reduces the technical barrier to extracting value from massive datasets like Gaia and Euclid.
Quick answers
What is the cost or pricing model for using this platform?
Based on available project data, the project is funded by the EU and aims to open the platform to the community via an Open Call, but no commercial pricing model is specified.
Can this be scaled to industrial-level data processing?
Yes, the project specifically targets 'Outsize Usage Scenarios' and uses Big Data and Data Mining technologies to handle datasets that are otherwise impossible to analyze without dedicated infrastructure.
What are the IP and licensing terms for the developed tools?
Based on available project data, the project intends to open the platform to the community, but specific licensing terms for the Big Data Analytics Framework are not provided.
How long until the system is available for external use?
The project runs from 2024-01-01 to 2026-12-31, with a second phase dedicated to opening the system to the community through an Open Call.
How does this integrate with existing ESA data?
The project is in close collaboration with the ESA DataLabs Project to facilitate the analysis of ESA archives and data products.
Who built it
The consortium is purely academic and research-driven, consisting of 5 universities and 2 research organizations across 4 countries. With an industry ratio of 0%, the project is currently focused on scientific validation and technical development rather than immediate commercialization.
Contact the Universitat de Barcelona regarding the Big Data Analytics Framework (BDAF).
Talk to the team behind this work.
Contact us to track the Open Call for proposals to test your datasets on the SPACIOUS platform.