If you are a vehicle manufacturer dealing with signal drops in dense urban areas — this project developed vision-aided base stations that use visual data to predict wireless channel dynamics. This ensures a more stable connection for safety-critical data.
Integrating Computer Vision and 6G Wireless Networks for Smarter Connectivity
Imagine if your internet router had eyes to see where you are and what is blocking the signal. By combining cameras with radio waves, the network can predict when a signal will drop and steer the connection around obstacles. It is like giving a blind radio system a set of glasses to ensure a perfect connection.
What needed solving
High-frequency 6G signals are easily blocked by physical obstacles, leading to connection drops. Current networks cannot 'see' these obstacles, making beam management reactive rather than predictive.
What was built
A toolset comprising vision-aided intelligent surfaces, base stations, a 3D vision-radio simulator, and multimodal ML algorithms.
Who needs this
Who can put this to work
If you are a factory operator dealing with interference from heavy machinery — this project developed a vision-radio simulator and 3D environment modeler. This allows you to optimize signal paths using digital twins before physical deployment.
If you are a network provider dealing with the short range of sub-THz waves — this project developed vision-aided large intelligent surfaces. This helps maintain line-of-sight connectivity by intelligently directing beams based on visual sensing.
Quick answers
What is the cost or pricing for these tools?
Based on available project data, no specific pricing or cost structures are provided as this is a research infrastructure project.
Can this be scaled to an industrial level?
The project aims to deploy its toolset into 7 research infrastructures, indicating a scalable model for scientific and industrial testing.
What are the IP and licensing terms for the ML algorithms?
Based on available project data, the project intends to provide the scientific community with open datasets, but specific commercial licensing terms are not listed.
How does this integrate with existing 5G/6G hardware?
The tools integrate with the Open Air Interface and are designed to work with fixed and mobile base stations.
What is the timeline for deployment?
The project period runs from 2023-02-01 to 2026-07-31.
Who built it
The consortium is well-balanced for technology transfer, consisting of 16 partners across 6 countries. With an industry ratio of 38% (6 industrial partners, including 5 SMEs), there is a strong link between academic research and commercial application, ensuring the tools meet real-world market requirements.
Contact INESC TEC in Portugal for technical specifications on the vision-radio toolset.
Talk to the team behind this work.
Contact us to identify the specific SME partners in the CONVERGE consortium for licensing inquiries.