If you are an architecture firm spending days manually researching historical styles and recreating building elements from reference photos — this project developed a platform that automatically extracts 3D models from video footage and links them to building information data (BIM/GIS). The system was tested across 12 partner organizations in 8 countries and produced a final demonstrator for 3D reconstruction and model extraction from real-world visual content.
AI Platform That Turns Existing Videos and Images Into 3D Models for Architects and Game Designers
Imagine you're an architect who sees a beautiful building in an old movie and wants to use that style in your next project. Normally you'd spend weeks sketching, measuring, and rebuilding it from scratch. V4Design built a platform that can watch that movie, pull out the building's shape, and hand you a ready-to-use 3D model — along with summaries of what critics and historians have written about it. It's like having an AI assistant that watches films, browses art libraries, and reads design reviews for you, then delivers everything as usable design assets.
What needed solving
Architects, game designers, and creative professionals waste enormous time manually searching for visual inspiration, studying historical styles, and building 3D models from scratch. Existing design references — scattered across films, art libraries, museum catalogues, and online archives — sit in formats that designers cannot directly use. There is no efficient way to turn a beautiful building seen in a movie into a usable 3D asset or to extract a specific era's aesthetic style from visual and textual sources.
What was built
V4Design built a complete platform with: a web crawler that gathers visual and textual content from online sources and content providers; 3D reconstruction tools that extract building models from video footage with BIM/GIS data; interior and exterior localization algorithms with object detection and scene recognition; multilingual semantic text analysis and summarization; linked data ontologies for buildings and scenes; and frontend applications for both architecture and video game design workflows. The project produced 39 deliverables including 7 working demonstrators.
Who needs this
Who can put this to work
If you are a game studio that needs historically accurate or aesthetically rich environments but can't afford to model every building from scratch — this project built tools that crawl online art libraries, extract 3D and VR representations from buildings and cityscapes, and let designers repurpose visual styles from movies, paintings, and photographs. The consortium included 5 SMEs and delivered a final system specifically for video game design platforms.
If you are a cultural heritage company struggling to digitize historical buildings and art collections into interactive 3D experiences — this project developed interior and exterior localization algorithms, object detection, and scene recognition tools tested on real-world visual content. The platform includes multilingual text analysis and semantic summarization across 39 deliverables, turning scattered cultural documentation into structured, reusable design knowledge.
Quick answers
What would it cost to license or deploy this technology?
The project was publicly funded with EUR 3,937,850 in EU contribution under a Research and Innovation Action (RIA). Licensing terms would need to be negotiated with the coordinator (CERTH, Greece) and relevant consortium partners. As an RIA project, results may have open-access components, but commercial licensing for specific modules is likely required.
Can this work at industrial scale for a large architecture or game studio?
The project delivered a final system with both frontend applications and backend infrastructure for architecture and video game design platforms. The platform handles web crawling, 3D reconstruction, multilingual text analysis, and linked data for buildings — all pipeline components needed for scale. However, deployment would likely require integration work to match specific studio workflows.
What is the IP situation — can we use this commercially?
The consortium of 12 partners across 8 countries holds the IP. With 5 SMEs in the consortium, there is clear commercial intent. Specific IP arrangements per module (3D reconstruction, text summarization, crawling tools) would need to be clarified with individual partners who developed each component.
How mature is the 3D reconstruction from video footage?
The project produced a 'Final demonstrator of 3D reconstruction and model extraction' showing how 3D models are created from video footage, how BIM and GIS data can be extracted, and how this leads to improved 3D representations. This indicates tested technology with working demonstrations on real-world content.
Does it work with our existing design tools (AutoCAD, Revit, Unreal Engine)?
The project developed BIM and GIS data extraction capabilities and linked data ontologies for building-related resources, which are standard formats used by tools like Revit and AutoCAD. Based on available project data, specific integrations with commercial tools would need verification with the consortium.
What languages does the text analysis support?
The project delivered a 'Final version of multilingual semantic text analysis' covering multiple languages. The system generates personalized multilingual summaries from reviews, critics, catalogues, and museum guides. Specific supported languages would need to be confirmed with the consortium.
Is there regulatory risk around reusing copyrighted visual content?
The project specifically addresses content re-purposing from movies, documentaries, paintings, and online art libraries. Based on available project data, the platform works with content providers and crawls online libraries, suggesting licensing and rights management were considered. However, users would need to verify copyright compliance for their specific use cases.
Who built it
The V4Design consortium of 12 partners across 8 countries (Belgium, Switzerland, Germany, Greece, Spain, Netherlands, Sweden, UK) is led by CERTH, a major Greek research center. The mix includes 3 universities, 1 research organization, and 5 SMEs — giving the project both academic depth and commercial grounding. The 17% industry ratio is modest, but the presence of 5 SMEs signals that practical, market-oriented thinking shaped the tools. For a business looking to adopt this technology, the multi-country spread means expertise across European markets, though it also means IP is distributed across multiple organizations which could complicate licensing negotiations.
- ETHNIKO KENTRO EREVNAS KAI TECHNOLOGIKIS ANAPTYXISCoordinator · EL
- UNIVERSIDAD POMPEU FABRAparticipant · ES
- STICHTING EUROPEANAparticipant · NL
- DEUTSCHE WELLEparticipant · DE
- NUROGAMES GMBHparticipant · DE
- ARISTOTELIO PANEPISTIMIO THESSALONIKISparticipant · EL
- MCNEEL EUROPE SLparticipant · ES
- KATHOLIEKE UNIVERSITEIT LEUVENparticipant · BE
The coordinator is CERTH (Centre for Research and Technology Hellas) in Greece — a well-known research organization with established technology transfer processes.
Talk to the team behind this work.
Want to explore how V4Design's 3D reconstruction or content re-purposing tools could fit your architecture or game design workflow? SciTransfer can arrange a direct introduction to the right consortium partner for your specific needs.