Windshield Integration of Thermal and Color Fusion for Automatic Emergency Braking in Low Visibility Conditions
Authors:
Gabriel Jobert,
Guillaume Delubac,
Jessy Matias,
Quentin Noir,
Xavier Brenière,
Pauline Girard,
Tatiana Severin-Fabiani,
Sebastien Tinnes
Abstract:
The new NHSTA regulations require Automatic Emergency Braking (AEB) systems to operate at night, to protect pedestrians in the deadliest conditions. We propose thermal imaging as a new sensor to complement the AEB sensor suite, alongside the visible front camera and RADAR. This paper explores the benefits of visible-thermal fusion, proposes a windshield integration for such a system, and evaluates…
▽ More
The new NHSTA regulations require Automatic Emergency Braking (AEB) systems to operate at night, to protect pedestrians in the deadliest conditions. We propose thermal imaging as a new sensor to complement the AEB sensor suite, alongside the visible front camera and RADAR. This paper explores the benefits of visible-thermal fusion, proposes a windshield integration for such a system, and evaluates the minimum performance requirements for a thermal camera compliant with the NHSTA standards, based on a field study of pedestrian detection range.
△ Less
Submitted 7 October, 2024;
originally announced October 2024.
Optimizing the image correction pipeline for pedestrian detection in the thermal-infrared domain
Authors:
Christophe Karam,
Jessy Matias,
Xavier Breniere,
Jocelyn Chanussot
Abstract:
Infrared imagery can help in low-visibility situations such as fog and low-light scenarios, but it is prone to thermal noise and requires further processing and correction. This work studies the effect of different infrared processing pipelines on the performance of a pedestrian detection in an urban environment, similar to autonomous driving scenarios. Detection on infrared images is shown to out…
▽ More
Infrared imagery can help in low-visibility situations such as fog and low-light scenarios, but it is prone to thermal noise and requires further processing and correction. This work studies the effect of different infrared processing pipelines on the performance of a pedestrian detection in an urban environment, similar to autonomous driving scenarios. Detection on infrared images is shown to outperform that on visible images, but the infrared correction pipeline is crucial since the models cannot extract information from raw infrared images. Two thermal correction pipelines are studied, the shutter and the shutterless pipes. Experiments show that some correction algorithms like spatial denoising are detrimental to performance even if they increase visual quality for a human observer. Other algorithms like destriping and, to a lesser extent, temporal denoising, increase computational time, but have some role to play in increasing detection accuracy. As it stands, the optimal trade-off for speed and accuracy is simply to use the shutterless pipe with a tonemapping algorithm only, for autonomous driving applications within varied environments.
△ Less
Submitted 5 July, 2024;
originally announced July 2024.
