If you are an opera house dealing with limited venue capacity and high ticket costs for remote fans — this project developed a mixed reality environment that brings performances to remote locations, allowing you to reach a wider audience beyond the physical seats.
Mixed Reality Platform for Remote Immersive Art and Cultural Performances
Imagine being able to attend a world-class opera or concert in your own living room, where the musicians appear in 3D and the sound feels like it's actually around you. It's like a high-tech upgrade to a video call that makes you feel physically present at the event. You can even invite friends to join your virtual room and experience the show together.
What needed solving
Live cultural events are limited by physical venue capacity, high travel costs, and geographic barriers, excluding many potential audiences and increasing carbon emissions.
What was built
A mixed reality software environment and a prototype called 'Bubbles' for social interaction. They also built an automated AI pipeline for audio-to-visual generation and high-fidelity 3D audio-visual datasets.
Who needs this
Who can put this to work
If you are a museum dealing with geographic barriers and the environmental impact of visitor travel — this project developed 3D reconstruction and high-fidelity sound tools that let people experience art virtually without traveling.
If you are a therapy center dealing with patients who have limited mobility and cannot visit concerts for mental health benefits — this project developed an inclusive MR solution that delivers immersive musical experiences directly to the user.
Quick answers
What is the cost or pricing model for this technology?
Based on available project data, specific pricing or cost structures are not provided as the project is currently in the research and development phase.
Can this be scaled to a global industrial level?
The project aims to remove geographic limitations and venue size constraints, suggesting a design intended for global accessibility and scalability.
Who owns the IP and how is licensing handled?
Based on available project data, the specific IP and licensing agreements are not detailed, though the project utilizes some open-source AI models for music visualization.
How does this integrate with existing hardware?
The system is designed as a software environment that blends 3D visuals and sound into the user's room, implying compatibility with Mixed Reality headsets.
What is the timeline for a commercial release?
The project period runs from 2024-01-01 to 2026-12-31, indicating that full development and evaluation will continue through 2026.
Who built it
The consortium is well-balanced for technology transfer, featuring 14 partners across 9 countries. With an industry ratio of 36% (including 5 industry partners and 3 SMEs), there is significant commercial interest and a clear path from the 6 participating universities to market application.
Contact IT-UNIVERSITETET I KOBENHAVN
Talk to the team behind this work.
Contact us to connect with the XTREME consortium for pilot opportunities.