If you are a streaming service dealing with a lack of high-quality, immersive classical content — this project developed an immersive streaming platform that uses spatial audio and instrument separation to attract new audiences.
AI-Powered Digitization and Immersive Streaming for Classical and Medieval Music Heritage
Imagine trying to read a handwritten diary from 500 years ago, but it's written in a musical code only a few experts understand. This project built a smart scanner that reads those old notes and turns them into digital music. It also creates a 3D sound experience, making it feel like you are sitting inside a historic concert hall using your headphones.
What needed solving
Valuable musical manuscripts are locked in physical archives, making them inaccessible to the public and musicians. Existing digital formats lack the immersive quality needed to attract modern audiences to classical music.
What was built
An integrated immersive streaming platform and a suite of AI tools for Optical Music Recognition and sound source separation.
Who needs this
Who can put this to work
If you are a music school dealing with inaccessible historical manuscripts — this project developed AI tools for Optical Music Recognition that turn handwritten scores into usable digital formats for students.
If you are a cultural site dealing with physical archives that the public cannot access — this project developed a system to digitise and catalogue manuscripts, turning them into interactive virtual reality experiences.
Quick answers
What is the cost of implementing these AI tools?
Based on available project data, specific pricing or implementation costs are not provided, though the project aims to provide cost-effective solutions for immersive streaming.
Can this be scaled to other types of musical notation?
The project specifically targeted medieval neumatic and eighteenth-century classical notations, processing over 350,000 images to train its AI systems.
How is the intellectual property or licensing handled?
Based on available project data, the specific licensing terms for the AI tools and the streaming platform are not disclosed.
How does the system integrate with existing music databases?
The project developed a technological platform designed to curate databases of art-music works and link them to other relevant existing databases worldwide.
What is the timeline for deploying the immersive system?
The project period runs from 2023-01-01 to 2025-12-31, with a fully integrated immersive system ready for testing as a deliverable.
Who built it
The consortium is well-balanced for commercialization, featuring a 23% industry ratio with 3 companies, 1 orchestra, and 7 universities across 8 countries. The presence of specialized entities like ODRATEK (early music) and LNP (orchestra) ensures the AI tools are validated by actual end-users in the music business.
Contact the Universidad de Jaen research office regarding the REPERTORIUM project.
Talk to the team behind this work.
Contact us to bridge the gap between these AI music tools and your digital content strategy.