SciTransfer
ASTERICS · Project

Big Data Tools and Scheduling Software Born from Managing Giant Telescope Networks

digitalTestedTRL 5Thin data (2/5)
asterics2020.eu

Imagine four of the world's most powerful telescopes all trying to look at the same cosmic event at the same time — like coordinating four giant cameras across different countries during a lightning strike. ASTERICS built the software and data plumbing to make that work: scheduling tools that sync multiple facilities, algorithms that move massive data at 10 Gb/s, and systems that let scientists across Europe search and reuse each other's results. Think of it as building an air traffic control system, but for telescope time and the flood of data they produce.

By the numbers
EUR 14,991,194
EU funding for development
28
consortium partners
6
countries involved
67
total deliverables produced
10 Gb/s
network capacity achieved
5
industry partners in consortium
3
SMEs in consortium
The business problem

What needed solving

Companies running distributed operations — multiple factories, data centers, or field sites — struggle to coordinate real-time scheduling, move massive data volumes between locations, and keep precise timing across systems. Off-the-shelf solutions often cannot handle the scale or the need for reactive re-scheduling when unexpected events occur. The cost of poor coordination is downtime, wasted capacity, and missed opportunities.

The solution

What was built

The project delivered pilot multi-messenger event handling software, multi-facility scheduling simulation and performance analysis tools, advanced algorithms with a network upgrade to 10 Gb/s capacity, and hardware for maser-level time and frequency distribution in optical networks. In total, 67 deliverables were produced across the 4-year project.

Audience

Who needs this

Telecom operators managing high-throughput optical networks across multiple countriesBig data platform companies processing petabyte-scale distributed datasetsLogistics software firms building multi-site real-time scheduling systemsPrecision timing equipment manufacturers for financial trading or 5G networksEarth observation and remote sensing companies handling multi-sensor data fusion
Business applications

Who can put this to work

Telecommunications & Network Infrastructure
enterprise
Target: Network equipment manufacturers or telecom operators handling high-throughput data transfer

If you are a telecom equipment company dealing with the challenge of moving massive data volumes reliably across distributed sites — this project developed advanced algorithms and hardware upgrades enabling 10 Gb/s data capacity across optical transport networks. The time and frequency distribution hardware built for maser-level precision could improve synchronization in your network infrastructure. These were tested across a 28-partner network spanning 6 countries.

Data Analytics & Cloud Computing
mid-size
Target: Big data platform providers or companies processing large-scale scientific or industrial datasets

If you are a data platform company struggling with petabyte-scale data management from distributed sources — this project built data mining and processing pipelines designed to handle the enormous datasets generated by Europe's largest research telescopes. The Virtual Observatory interface they created allows seamless access and re-use of reduced data products across facilities. With 67 deliverables produced, the toolset is substantial.

Operations & Logistics Software
SME
Target: Companies building multi-facility scheduling and resource optimization software

If you are a software company developing scheduling solutions for complex multi-site operations — this project created multi-facility scheduling simulation and performance analysis software that coordinates observations across multiple large-scale installations in real time. The pilot multi-messenger event handling system responds to unpredictable events by re-prioritizing facility schedules instantly. This kind of reactive scheduling logic transfers directly to manufacturing or logistics operations.

Frequently asked

Quick answers

What would it cost to license or adapt these tools for our industry?

ASTERICS was funded with EUR 14,991,194 in EU contribution under an RIA (Research and Innovation Action) scheme. RIA results are typically available under open or favorable licensing terms. Specific licensing arrangements would need to be discussed with the coordinating institute SRON in the Netherlands.

Can the scheduling and data tools scale to industrial volumes?

The project was designed to handle data from four of Europe's largest telescope projects (SKA, CTA, KM3NeT, E-ELT), which generate some of the biggest datasets in science. The network algorithms were upgraded to handle 10 Gb/s capacity. This scale is comparable to or exceeds many industrial data processing requirements.

Who owns the intellectual property from this project?

As an EU-funded RIA project coordinated by SRON (Stichting Nederlandse Wetenschappelijk Onderzoek Instituten), IP ownership follows Horizon 2020 rules where results belong to the partner that generated them. The consortium included 5 industry partners and 3 SMEs who may hold commercial rights to specific components.

How mature are these tools — are they ready to deploy?

The project produced 67 deliverables including pilot event handling systems and working scheduling simulation software. The 10 Gb/s network upgrade and maser-level timing hardware were demonstrated. However, these were built for astronomy use cases and would require adaptation for commercial deployment.

Can these tools integrate with our existing IT infrastructure?

The project specifically built interfaces to the Virtual Observatory, an international standard for astronomical data interoperability. The design philosophy of making multiple independent facilities interoperate through common interfaces is directly applicable to enterprise system integration. The consortium spanned 28 partners across 6 countries, so interoperability was a core requirement.

Is there regulatory compliance built into these systems?

Based on available project data, the tools were built to meet scientific data management standards including data re-use and open access principles. The time and frequency distribution hardware meets maser-level precision standards. Specific industrial regulatory compliance would need to be added for sector-specific deployment.

Consortium

Who built it

The ASTERICS consortium of 28 partners is research-heavy: 12 research organizations and 11 universities, with only 5 industry partners (18% industry ratio) and 3 SMEs. This signals strong scientific depth but limited commercial pull. The 6-country spread (DE, ES, FR, IT, NL, UK) covers major European markets. The coordinator, SRON in the Netherlands, is a national research institute — not a commercial entity. For a business looking to adopt these technologies, the path runs through research institutes rather than off-the-shelf vendors, meaning you would likely need a technology transfer or co-development arrangement.

How to reach the team

SRON — Stichting Nederlandse Wetenschappelijk Onderzoek Instituten, Netherlands. Contact through SciTransfer for a warm introduction.

Order a report on this consortiumSee STICHTING NEDERLANDSE WETENSCHAPPELIJK ONDERZOEK INSTITUTEN profile →
Next steps

Talk to the team behind this work.

Want to explore how ASTERICS scheduling or data tools could solve your multi-site coordination challenge? SciTransfer can arrange a direct conversation with the right technical lead from the consortium.

Order a report on this topicMore in Digital & ICT
More in Digital & ICT
See all Digital & ICT projects →
Affordable Satellite Communication Modules That Give SMEs Direct Access to Space Data
InnoSpaceComm
Open →
Home Dining Marketplace Connecting Travelers with Local Hosts Across Europe
ECINPERSON
Open →
AI-Powered 3D Art Creation That Cuts Production Time for Game and Film Studios
ArtomatixSuite
Open →