SciTransfer
REPERTORIUM · Project

AI-Powered Digitization and Immersive Streaming for Classical and Medieval Music Heritage

digitalTestedTRL 6

Imagine trying to read a handwritten diary from 500 years ago, but it's written in a musical code only a few experts understand. This project built a smart scanner that reads those old notes and turns them into digital music. It also creates a 3D sound experience, making it feel like you are sitting inside a historic concert hall using your headphones.

By the numbers
350,000
images from historical collections processed
1,000
medieval manuscript pages manually annotated
1,300
eighteenth-century opera arias manually annotated
The business problem

What needed solving

Valuable musical manuscripts are locked in physical archives, making them inaccessible to the public and musicians. Existing digital formats lack the immersive quality needed to attract modern audiences to classical music.

The solution

What was built

An integrated immersive streaming platform and a suite of AI tools for Optical Music Recognition and sound source separation.

Audience

Who needs this

Digital music streaming servicesMusic education institutionsProfessional orchestrasDigital archive managersVR/AR experience developers
Business applications

Who can put this to work

Music Streaming & Entertainment
enterprise
Target: Audio streaming platforms

If you are a streaming service dealing with a lack of high-quality, immersive classical content — this project developed an immersive streaming platform that uses spatial audio and instrument separation to attract new audiences.

Education Technology
any
Target: Music conservatories and digital learning providers

If you are a music school dealing with inaccessible historical manuscripts — this project developed AI tools for Optical Music Recognition that turn handwritten scores into usable digital formats for students.

Cultural Tourism
SME
Target: Museums and historical archives

If you are a cultural site dealing with physical archives that the public cannot access — this project developed a system to digitise and catalogue manuscripts, turning them into interactive virtual reality experiences.

Frequently asked

Quick answers

What is the cost of implementing these AI tools?

Based on available project data, specific pricing or implementation costs are not provided, though the project aims to provide cost-effective solutions for immersive streaming.

Can this be scaled to other types of musical notation?

The project specifically targeted medieval neumatic and eighteenth-century classical notations, processing over 350,000 images to train its AI systems.

How is the intellectual property or licensing handled?

Based on available project data, the specific licensing terms for the AI tools and the streaming platform are not disclosed.

How does the system integrate with existing music databases?

The project developed a technological platform designed to curate databases of art-music works and link them to other relevant existing databases worldwide.

What is the timeline for deploying the immersive system?

The project period runs from 2023-01-01 to 2025-12-31, with a fully integrated immersive system ready for testing as a deliverable.

Consortium

Who built it

The consortium is well-balanced for commercialization, featuring a 23% industry ratio with 3 companies, 1 orchestra, and 7 universities across 8 countries. The presence of specialized entities like ODRATEK (early music) and LNP (orchestra) ensures the AI tools are validated by actual end-users in the music business.

How to reach the team

Contact the Universidad de Jaen research office regarding the REPERTORIUM project.

Next steps

Talk to the team behind this work.

Contact us to bridge the gap between these AI music tools and your digital content strategy.