SciTransfer
SHARESPACE · Project

High-Fidelity Human Motion Capture and Social Interaction for Immersive Virtual Spaces

digitalTestedTRL 5

Imagine being in a video call where you don't just see a face, but your digital twin mimics every subtle body movement and gesture in real-time. It's like a digital mirror that captures how you move and interact with others, making remote meetings feel like you're in the same room. This tech helps computers understand the 'language' of human movement to make virtual avatars feel natural and alive.

By the numbers
16
partners
9
countries involved
4
industry partners
14
demo deliverables
The business problem

What needed solving

Remote digital interactions often feel disconnected and robotic because current avatars cannot capture the subtle, non-verbal physical cues of human social interaction. This leads to 'zoom fatigue' and a lack of trust or empathy in virtual professional and medical environments.

The solution

What was built

["A self-calibrating body sensor network and 3D metric hand tracking system.", "AI-driven cognitive architectures for natural avatar animation and neural rendering for large spaces.", "An XR-communication platform integrated into Enterprise Rainbow environments."]

Audience

Who needs this

VR/AR Hardware ManufacturersTele-health platform developersHigh-end corporate training providersDigital twin software companies
Business applications

Who can put this to work

Telehealth
mid-size
Target: Remote diagnostics and therapy providers

If you are a healthcare provider dealing with the lack of physical presence in remote consultations — this project developed a self-calibrating body sensor network and hand tracking that allows doctors to observe patient motor skills and gestures accurately from a distance.

Professional Sports
SME
Target: Athlete training and performance analysis firms

If you are a sports tech company dealing with rigid motion capture setups — this project developed mobile full-body motion capture for VR/AR that was tested in real-world scenarios including the Olympic Games to analyze human movement fluidly.

Industrial Training
enterprise
Target: Enterprise AR training providers

If you are a training company dealing with unrealistic avatars that break immersion — this project developed AI-based cognitive architectures and neural rendering that make virtual instructors move naturally and interact with the local environment.

Frequently asked

Quick answers

What is the cost or pricing for this technology?

Based on available project data, specific pricing or cost structures are not mentioned as the project is currently in the research and prototype phase.

Can this be scaled for industrial use?

The project includes 4 industry partners and has developed a communication platform built on Pixel Streaming integrated into Enterprise Rainbow environments, suggesting a path toward industrial scaling.

What is the IP and licensing status?

Based on available project data, the project focuses on early transfer to deep-tech companies to consolidate European market areas, but specific licenses are not listed.

How is the system integrated with existing hardware?

The technology is integrated into head-mounted displays and uses a combination of IMUs and visual upper body tracking to reduce the number of sensors needed.

What is the timeline for deployment?

The project period runs from 2023-01-01 to 2025-12-31, with final prototype versions scheduled for delivery toward the end of this period.

Consortium

Who built it

The consortium is well-balanced for a technology transfer project, consisting of 16 partners across 9 countries. With a 25% industry ratio (4 companies, including 2 SMEs), there is a clear bridge between the 12 academic and research entities and the commercial market. The leadership by a German AI center (DFKI) suggests a strong focus on the software and AI intelligence driving the hardware.

How to reach the team

Contact DFKI GmbH in Germany

Next steps

Talk to the team behind this work.

Contact us to connect with the SHARESPACE consortium for licensing and pilot opportunities.