If you are a warehouse operator dealing with changing floor layouts and robot navigation errors — this project developed AI-based 3D scene reconstruction that enables autonomous mobile robots to navigate manufacturing environments using updated maps.
AI-Powered Dynamic Digital Twins for Real-Time Urban and Industrial XR Applications
Imagine having a digital map of a city or factory that updates itself automatically, like a live GPS for 3D spaces. Instead of manually redrawing maps every time a wall moves or a machine is relocated, AI uses cameras and sensors to keep the virtual copy in sync with reality. It's like a living mirror of the physical world that lets you see through walls or plan routes in a virtual space before stepping outside.
What needed solving
Current digital twins are static, expensive to create, and require manual updates, making them useless for dynamic environments like busy cities or evolving factories.
What was built
A system for 3D scene reconstruction from heterogeneous sensors (lidar/cameras) and AI-driven synchronization tools to keep digital twins updated automatically.
Who needs this
Who can put this to work
If you are a tourism board dealing with overcrowded landmarks and static brochures — this project developed an AR application that guides tourists based on current visitor numbers and weather, even allowing virtual peeks into museums outside opening hours.
If you are a city planner dealing with traffic congestion and manual road surveys — this project developed vehicle-based sensor integration that automatically detects city maintenance issues and assesses the effect of changing road layouts.
Quick answers
How much does the system cost to implement?
Based on available project data, specific pricing or implementation costs are not provided.
Can this be scaled to an entire city?
Yes, the project specifically researches robust and scalable methods for large-scale digital twins in city environments and urban planning.
Who owns the IP and how is licensing handled?
Based on available project data, the licensing terms and IP ownership are not specified.
How does the system handle GDPR and privacy?
The technologies are developed to be ethical and privacy-aware by design to avoid the risk of capturing personal and sensitive data from sensors.
How is the digital twin kept up to date?
The system uses AI-based data fusion from heterogeneous sensors, including static and mobile cameras and lidar, to update geometry without manual intervention.
Who built it
The consortium is well-balanced for commercialization, featuring 15 partners across 7 countries. With a 40% industry ratio (6 companies, including 2 SMEs), there is a strong bridge between the 4 universities and 3 research centers and the actual market needs of the industrial and urban sectors.
Contact JOANNEUM RESEARCH FORSCHUNGSGESELLSCHAFT MBH in Austria
Talk to the team behind this work.
Contact us to find a partner for the upcoming pilot phase of DIDYMOS-XR.