SemSegMap- 3D Segment-Based Semantic Localization
Authors:
Andrei Cramariuc,
Florian Tschopp,
Nikhilesh Alatur,
Stefan Benz,
Tillmann Falck,
Marius Bruehlmeier,
Benjamin Hahn,
Juan Nieto,
Roland Siegwart
Abstract:
Localization is an essential task for mobile autonomous robotic systems that want to use pre-existing maps or create new ones in the context of SLAM. Today, many robotic platforms are equipped with high-accuracy 3D LiDAR sensors, which allow a geometric mapping, and cameras able to provide semantic cues of the environment. Segment-based mapping and localization have been applied with great success…
▽ More
Localization is an essential task for mobile autonomous robotic systems that want to use pre-existing maps or create new ones in the context of SLAM. Today, many robotic platforms are equipped with high-accuracy 3D LiDAR sensors, which allow a geometric mapping, and cameras able to provide semantic cues of the environment. Segment-based mapping and localization have been applied with great success to 3D point-cloud data, while semantic understanding has been shown to improve localization performance in vision based systems. In this paper we combine both modalities in SemSegMap, extending SegMap into a segment based mapping framework able to also leverage color and semantic data from the environment to improve localization accuracy and robustness. In particular, we present new segmentation and descriptor extraction processes. The segmentation process benefits from additional distance information from color and semantic class consistency resulting in more repeatable segments and more overlap after re-visiting a place. For the descriptor, a tight fusion approach in a deep-learned descriptor extraction network is performed leading to a higher descriptiveness for landmark matching. We demonstrate the advantages of this fusion on multiple simulated and real-world datasets and compare its performance to various baselines. We show that we are able to find 50.9% more high-accuracy prior-less global localizations compared to SegMap on challenging datasets using very compact maps while also providing accurate full 6 DoF pose estimates in real-time.
△ Less
Submitted 30 July, 2021;
originally announced July 2021.
Building an Aerial-Ground Robotics System for Precision Farming: An Adaptable Solution
Authors:
Alberto Pretto,
Stéphanie Aravecchia,
Wolfram Burgard,
Nived Chebrolu,
Christian Dornhege,
Tillmann Falck,
Freya Fleckenstein,
Alessandra Fontenla,
Marco Imperoli,
Raghav Khanna,
Frank Liebisch,
Philipp Lottes,
Andres Milioto,
Daniele Nardi,
Sandro Nardi,
Johannes Pfeifer,
Marija Popović,
Ciro Potena,
Cédric Pradalier,
Elisa Rothacker-Feder,
Inkyu Sa,
Alexander Schaefer,
Roland Siegwart,
Cyrill Stachniss,
Achim Walter
, et al. (3 additional authors not shown)
Abstract:
The application of autonomous robots in agriculture is gaining increasing popularity thanks to the high impact it may have on food security, sustainability, resource use efficiency, reduction of chemical treatments, and the optimization of human effort and yield. With this vision, the Flourish research project aimed to develop an adaptable robotic solution for precision farming that combines the a…
▽ More
The application of autonomous robots in agriculture is gaining increasing popularity thanks to the high impact it may have on food security, sustainability, resource use efficiency, reduction of chemical treatments, and the optimization of human effort and yield. With this vision, the Flourish research project aimed to develop an adaptable robotic solution for precision farming that combines the aerial survey capabilities of small autonomous unmanned aerial vehicles (UAVs) with targeted intervention performed by multi-purpose unmanned ground vehicles (UGVs). This paper presents an overview of the scientific and technological advances and outcomes obtained in the project. We introduce multi-spectral perception algorithms and aerial and ground-based systems developed for monitoring crop density, weed pressure, crop nitrogen nutrition status, and to accurately classify and locate weeds. We then introduce the navigation and mapping systems tailored to our robots in the agricultural environment, as well as the modules for collaborative mapping. We finally present the ground intervention hardware, software solutions, and interfaces we implemented and tested in different field conditions and with different crops. We describe a real use case in which a UAV collaborates with a UGV to monitor the field and to perform selective spraying without human intervention.
△ Less
Submitted 7 June, 2022; v1 submitted 8 November, 2019;
originally announced November 2019.
