If you are a Tier-1 supplier struggling with sensor failures in adverse weather — this project developed self-diagnosing sensor software that monitors reliability across all system levels and adapts algorithms in real time. The system was validated with a publicly presentable demonstrator built by a consortium of 15 partners including Mercedes-Benz. This could reduce your warranty claims and accelerate certification of your ADAS products.
Making Self-Driving Car Sensors Work Reliably in Rain, Fog, and Snow
Imagine your car's cameras and sensors are like your eyes — they work great on a sunny day but struggle in heavy rain or fog. That's exactly the problem self-driving cars face: their sensors fail when conditions get tough, which is precisely when you need them most. RobustSENSE built a system that lets sensors monitor their own reliability and automatically adapt when conditions worsen, so the car always knows how much it can trust what it "sees." Think of it as giving the car the common sense to slow down and be more careful when visibility drops, rather than just shutting off entirely.
What needed solving
Autonomous vehicles and advanced driver assistance systems rely on sensors (cameras, radar, lidar) that degrade or fail in bad weather — rain, fog, snow, glare. When these sensors lose accuracy, the system either makes dangerous decisions or shuts down entirely, leaving drivers stranded or causing accidents. Companies developing autonomous vehicles need a way to keep their systems operating safely across all environmental conditions, not just on sunny days.
What was built
The project built a self-diagnosing sensor system that monitors its own reliability at every level — from individual sensors up to the decision-making layer — and automatically adapts its behavior when performance drops. A publicly presentable demonstrator with the full integrated system was delivered, along with 6 total deliverables covering the sensing, decision, and planning pipeline.
Who needs this
Who can put this to work
If you are a fleet operator losing uptime because your autonomous trucks shut down in bad weather — this project built reliability metrics that measure sensor performance at every level of the automation stack. Instead of stopping the vehicle entirely, the system permanently adapts its level of automation to match available sensor performance. This means your vehicles keep operating safely in conditions that would otherwise ground them.
If you are a robotics company whose outdoor autonomous machines fail in dust, rain, or low light — this project's self-monitoring sensor architecture transfers directly to any perception system operating in harsh environments. The approach of propagating reliability measures through system levels was tested with 9 industry partners across 5 countries. Adapting this could extend your robots' operational range into conditions you currently cannot serve.
Quick answers
What would it cost to license or integrate this sensor reliability technology?
The project data does not include licensing terms or pricing. The coordinator is Mercedes-Benz Group AG, a large enterprise, so licensing negotiations would likely involve their IP department. SciTransfer can facilitate an initial conversation to explore terms.
Can this technology scale to mass-production automotive applications?
The consortium included 9 industry partners and Mercedes-Benz as coordinator, indicating strong alignment with production-scale requirements. A publicly presentable demonstrator was built, suggesting the system moved beyond lab-stage. However, gap-to-production details are not specified in available project data.
Who owns the intellectual property and how is it licensed?
IP from ECSEL Joint Undertaking projects is typically retained by the partners who generated it, with consortium agreements governing cross-licensing. Mercedes-Benz Group AG coordinated, and 9 industry partners were involved. Specific IP arrangements would need to be discussed directly with the relevant partner.
Does this work with existing sensor hardware or require new equipment?
Based on available project data, RobustSENSE focused on software-level improvements — self-diagnosis, adaptation algorithms, and reliability metrics — applied on top of existing sensing methods. This suggests it can enhance current sensor setups rather than requiring hardware replacement.
Has this been tested in real driving conditions?
The project produced a publicly presentable demonstrator with an integrated system, which indicates real-world testing beyond simulation. The 3-year project ran from 2015 to 2018 with 15 partners contributing to validation. Based on available project data, specific test scenarios and conditions are not detailed.
What regulations or standards does this address?
The project addresses the core challenge of functional safety in automated driving, which is governed by ISO 26262 and the emerging ISO 21448 (SOTIF — Safety of the Intended Functionality). The self-monitoring and reliability propagation approach directly supports the safety case required for higher levels of vehicle automation.
Can this be adapted for non-automotive applications?
The sensor reliability metrics and self-diagnosis architecture are fundamentally sensor-agnostic. Based on the project objectives, the approach of measuring and propagating reliability across system levels could apply to any autonomous system operating in unpredictable environments — drones, agricultural robots, or mining vehicles.
Who built it
This is a heavily industry-driven consortium with 60% of partners (9 out of 15) coming from industry, coordinated by Mercedes-Benz Group AG — one of the world's largest automakers. The presence of 3 SMEs alongside major industry players across 5 European countries (Austria, Germany, Spain, Finland, Italy) signals that the technology was developed with real commercial pressure and supply-chain relevance, not just academic curiosity. The single university partner and 5 research organizations provided the scientific backbone, but the consortium's center of gravity is clearly industrial, which increases the likelihood that results are production-relevant.
- MERCEDES-BENZ GROUP AGCoordinator · DE
- EUROPEAN CENTER FOR INFORMATION AND COMMUNICATION TECHNOLOGIES GMBHparticipant · DE
- ROBERT BOSCH GMBHparticipant · DE
- FZI FORSCHUNGSZENTRUM INFORMATIKparticipant · DE
- CENTRO RICERCHE FIAT SCPAparticipant · IT
- SICK AGparticipant · DE
- TEKNOLOGIAN TUTKIMUSKESKUS VTT OYparticipant · FI
- UNIVERSITAET ULMparticipant · DE
- AVL DEUTSCHLAND GMBHparticipant · DE
- FUNDACION PARA LA PROMOCION DE LA INNOVACION INVESTIGACION Y DESARROLLO TECNOLOGICO EN LA INDUSTRIA DE AUTOMOCION DE GALICIAparticipant · ES
- MODULIGHT OYJparticipant · FI
- AVL LIST GMBHparticipant · AT
Mercedes-Benz Group AG (Germany) — contact via SciTransfer for introduction to the project team
Talk to the team behind this work.
Want to explore how RobustSENSE sensor reliability technology could solve your perception challenges? SciTransfer can connect you with the right people from this consortium.