VISUALMEDIA · Project

Real-Time 3D Social Media Graphics System for Live TV Broadcasts

digitalMarket-readyTRL 8

You know how live TV shows sometimes display audience tweets or poll results as flat text scrolling across the bottom of the screen? That looks pretty boring. This project built a system that pulls social media content and turns it into interactive 3D graphics right inside the live broadcast — think spinning data visualizations, floating comment bubbles, and objects viewers can interact with through their phones. It also includes a smart camera tracker that blends real studio footage with these virtual 3D elements seamlessly, so it looks like they actually exist in the studio.

By the numbers

consortium partners across multiple countries

countries represented in the consortium

industry partners in the consortium

SMEs involved in development

58%

industry ratio in the consortium

total project deliverables produced

real-time graphics engine for broadcast

The business problem

What needed solving

Broadcasters are losing live audiences because their social media integration is stuck in the 1990s — flat text tickers and basic 2D graphics that fail to hold viewer attention. Audience feedback and focus groups confirm that current approaches do not sustain viewer interest. Broadcasters want more from existing solutions but available tools only offer small text information and plain 2D graphics.

The solution

What was built

The project delivered a complete commercial-ready system with five major components: a pan-tilt-zoom camera tracker with sensor fusion, a social media engine with AI algorithms, a real-time 3D graphics engine, a scene augmentation and interaction handling module, and an online distribution engine with operator interface and smart device front end. All components were integrated into the VisualMedia Commercial Release across 22 deliverables.

Audience

Who needs this

TV broadcasters running live interactive programming (news, entertainment, reality TV)Sports broadcast production companies wanting real-time audience engagement graphicsLive event production studios needing augmented reality overlaysDigital media companies building interactive second-screen experiencesEsports and streaming platforms looking for professional-grade audience interaction tools

Business applications

Who can put this to work

Broadcast Television

enterprise

Target: TV production companies and broadcasters

If you are a TV broadcaster struggling with declining live audience engagement and viewer retention — this project developed a complete integrated system combining a social media engine with AI algorithms, a real-time 3D graphics engine, and an online distribution engine that lets you transform audience social media input into immersive 3D visuals during live programming. The consortium of 12 partners across 7 countries built a commercial-ready product with camera tracking and scene augmentation.

Live Events & Sports Broadcasting

mid-size

Target: Sports broadcasters and live event production companies

If you are a live event producer dealing with the challenge of making real-time audience data visually compelling — this project created a pan-tilt-zoom camera tracker with sensor fusion that seamlessly blends 3D graphics into live camera feeds. The scene augmentation module lets you overlay interactive graphics that viewers can engage with through smart devices, turning passive watching into active participation.

Virtual Production & Visual Effects

SME

Target: Virtual production studios and post-production houses

If you are a production studio looking for real-time augmented reality tools that work in live environments — this project delivered a prototype camera tracker integrated with a 3D graphics engine and interaction handling module. The system was built to commercial release stage with 22 deliverables, including sensor fusion capabilities for precise tracking and plane-based region tracking for accurate graphic placement.

Frequently asked

Quick answers

What would this system cost to license or purchase?

Pricing details are not available in the project data. The coordinator, Brainstorm Multimedia SL, is a Spanish SME that specializes in broadcast graphics solutions. The final deliverable was described as a commercial release ready for immediate market introduction, so commercial licensing terms would need to be discussed directly with them.

Can this scale to major broadcast operations with multiple studios?

The system was designed specifically for the broadcast industry with an integrated platform architecture (social media engine, 3D graphics engine, and online distribution engine). With 7 industry partners and 6 SMEs in the consortium across 7 countries, it was built with real broadcast production environments in mind. The camera tracker supports pan-tilt-zoom with sensor fusion, which is standard in professional multi-camera setups.

Who owns the intellectual property and how can I license it?

The project was coordinated by Brainstorm Multimedia SL, a Spanish SME. As an Innovation Action with 12 consortium partners, IP ownership would typically be shared according to the consortium agreement. Licensing inquiries should be directed to Brainstorm Multimedia as the lead partner.

Does this work with existing broadcast infrastructure?

The system was built as an integrated platform with defined communication protocols between the social media engine, graphics engine, and online distribution engine. The camera tracker prototype was specifically designed for integration with existing broadcast camera setups (pan-tilt-zoom). The online distribution engine includes a front end for smart devices and an operator interface.

What is the current status of this technology?

The project closed in December 2017 with a final deliverable described as a commercial release ready for immediate market exploitation. This included the final versions of all components: the integrated platform, camera tracker, and scene augmentation module. Based on available project data, the technology reached commercial readiness by project end.

Is there regulatory compliance for broadcast standards?

Based on available project data, specific broadcast standard certifications are not mentioned. However, the consortium included 7 industry partners from the broadcast sector across 7 countries, suggesting the system was designed to work within European broadcast environments. Compliance details would need to be confirmed with the coordinator.

Consortium

Who built it

This is a strongly industry-driven consortium with 7 out of 12 partners coming from industry and 6 being SMEs — giving it a 58% industry ratio, well above typical EU projects. The coordinator, Brainstorm Multimedia SL, is a Spanish SME already operating in the broadcast graphics space, which means the technology was developed by a company that actually sells to this market. With partners spread across 7 countries (Germany, Greece, Spain, Ireland, Norway, Romania, and the UK), the project had broad European market coverage. Only 2 universities were involved, confirming this was an applied product development effort rather than academic research.

BRAINSTORM MULTIMEDIA SLCoordinator · ES
CORPORACION DE RADIO Y TELEVISION ESPANOLA SAparticipant · ES
INSTITUT FUR RUNDFUNKTECHNIK GMBHparticipant · DE
BAYERISCHER RUNDFUNKparticipant · DE
UNIVERSITY OF SURREYparticipant · UK
NORGES TEKNISK-NATURVITENSKAPELIGE UNIVERSITET NTNUparticipant · NO
Hallingdoelen ASparticipant · NO

How to reach the team

Brainstorm Multimedia SL (Spain) — a broadcast graphics SME that coordinated the 12-partner consortium

Order a report on this consortium See BRAINSTORM MULTIMEDIA SL profile →

Next steps

Talk to the team behind this work.

Want an introduction to the VisualMedia team to discuss licensing their broadcast 3D graphics platform? SciTransfer can arrange a direct meeting with Brainstorm Multimedia.

Order a report on this topic More in Digital & ICT