If you are a healthcare provider dealing with the lack of physical presence in remote consultations — this project developed a self-calibrating body sensor network and hand tracking that allows doctors to observe patient motor skills and gestures accurately from a distance.
High-Fidelity Human Motion Capture and Social Interaction for Immersive Virtual Spaces
Imagine being in a video call where you don't just see a face, but your digital twin mimics every subtle body movement and gesture in real-time. It's like a digital mirror that captures how you move and interact with others, making remote meetings feel like you're in the same room. This tech helps computers understand the 'language' of human movement to make virtual avatars feel natural and alive.
What needed solving
Remote digital interactions often feel disconnected and robotic because current avatars cannot capture the subtle, non-verbal physical cues of human social interaction. This leads to 'zoom fatigue' and a lack of trust or empathy in virtual professional and medical environments.
What was built
["A self-calibrating body sensor network and 3D metric hand tracking system.", "AI-driven cognitive architectures for natural avatar animation and neural rendering for large spaces.", "An XR-communication platform integrated into Enterprise Rainbow environments."]
Who needs this
Who can put this to work
If you are a sports tech company dealing with rigid motion capture setups — this project developed mobile full-body motion capture for VR/AR that was tested in real-world scenarios including the Olympic Games to analyze human movement fluidly.
If you are a training company dealing with unrealistic avatars that break immersion — this project developed AI-based cognitive architectures and neural rendering that make virtual instructors move naturally and interact with the local environment.
Quick answers
What is the cost or pricing for this technology?
Based on available project data, specific pricing or cost structures are not mentioned as the project is currently in the research and prototype phase.
Can this be scaled for industrial use?
The project includes 4 industry partners and has developed a communication platform built on Pixel Streaming integrated into Enterprise Rainbow environments, suggesting a path toward industrial scaling.
What is the IP and licensing status?
Based on available project data, the project focuses on early transfer to deep-tech companies to consolidate European market areas, but specific licenses are not listed.
How is the system integrated with existing hardware?
The technology is integrated into head-mounted displays and uses a combination of IMUs and visual upper body tracking to reduce the number of sensors needed.
What is the timeline for deployment?
The project period runs from 2023-01-01 to 2025-12-31, with final prototype versions scheduled for delivery toward the end of this period.
Who built it
The consortium is well-balanced for a technology transfer project, consisting of 16 partners across 9 countries. With a 25% industry ratio (4 companies, including 2 SMEs), there is a clear bridge between the 12 academic and research entities and the commercial market. The leadership by a German AI center (DFKI) suggests a strong focus on the software and AI intelligence driving the hardware.
Contact DFKI GmbH in Germany
Talk to the team behind this work.
Contact us to connect with the SHARESPACE consortium for licensing and pilot opportunities.