-
Mono-hydra: Real-time 3D scene graph construction from monocular camera input with IMU
Authors:
U. V. B. L. Udugama,
G. Vosselman,
F. Nex
Abstract:
The ability of robots to autonomously navigate through 3D environments depends on their comprehension of spatial concepts, ranging from low-level geometry to high-level semantics, such as objects, places, and buildings. To enable such comprehension, 3D scene graphs have emerged as a robust tool for representing the environment as a layered graph of concepts and their relationships. However, buildi…
▽ More
The ability of robots to autonomously navigate through 3D environments depends on their comprehension of spatial concepts, ranging from low-level geometry to high-level semantics, such as objects, places, and buildings. To enable such comprehension, 3D scene graphs have emerged as a robust tool for representing the environment as a layered graph of concepts and their relationships. However, building these representations using monocular vision systems in real-time remains a difficult task that has not been explored in depth. This paper puts forth a real-time spatial perception system Mono-Hydra, combining a monocular camera and an IMU sensor setup, focusing on indoor scenarios. However, the proposed approach is adaptable to outdoor applications, offering flexibility in its potential uses. The system employs a suite of deep learning algorithms to derive depth and semantics. It uses a robocentric visual-inertial odometry (VIO) algorithm based on square-root information, thereby ensuring consistent visual odometry with an IMU and a monocular camera. This system achieves sub-20 cm error in real-time processing at 15 fps, enabling real-time 3D scene graph construction using a laptop GPU (NVIDIA 3080). This enhances decision-making efficiency and effectiveness in simple camera setups, augmenting robotic system agility. We make Mono-Hydra publicly available at: https://github.com/UAV-Centre-ITC/Mono_Hydra
△ Less
Submitted 10 August, 2023;
originally announced August 2023.
-
Review of Deep Reinforcement Learning for Autonomous Driving
Authors:
B. Udugama
Abstract:
Since deep neural networks' resurgence, reinforcement learning has gradually strengthened and surpassed humans in many conventional games. However, it is not easy to copy these accomplishments to autonomous driving because state spaces are immensely complicated in the real world and action spaces are continuous and fine control is necessary. Besides, autonomous driving systems must also maintain t…
▽ More
Since deep neural networks' resurgence, reinforcement learning has gradually strengthened and surpassed humans in many conventional games. However, it is not easy to copy these accomplishments to autonomous driving because state spaces are immensely complicated in the real world and action spaces are continuous and fine control is necessary. Besides, autonomous driving systems must also maintain their functionality regardless of the environment's complexity. The deep reinforcement learning domain (DRL) has become a robust learning framework to handle complex policies in high dimensional surroundings with deep representation learning. This research outlines deep, reinforcement learning algorithms (DRL). It presents a nomenclature of autonomous driving in which DRL techniques have been used, thus discussing important computational issues in evaluating autonomous driving agents in the real environment. Instead, it involves similar but not standard RL techniques, adjoining fields such as emulation of actions, modelling imitation, inverse reinforcement learning. The simulators' role in training agents is addressed, as are the methods for validating, checking and robustness of existing RL solutions.
△ Less
Submitted 13 February, 2023;
originally announced February 2023.
-
Mini bot 3D: A ROS based Gazebo Simulation
Authors:
B. Udugama
Abstract:
The recent adoption of the Robot Operating System (ROS) as a software standard in robotics has contributed to novel solutions for several problems on the area. One such problem is known as Simultaneous Localization and Mapping (SLAM) with autonomous navigation, for which a number of algorithms from different classes are available as ROS packages ready to be used on any compatible robot. Many antic…
▽ More
The recent adoption of the Robot Operating System (ROS) as a software standard in robotics has contributed to novel solutions for several problems on the area. One such problem is known as Simultaneous Localization and Mapping (SLAM) with autonomous navigation, for which a number of algorithms from different classes are available as ROS packages ready to be used on any compatible robot. Many anticipated applications of autonomous mobile robots require for them to navigate in diverse complex environments without support from exterior infrastructures. To perform this on-board navigation, the robot must make use of the available sensor technologies and fuse the most reliable data respective to the present environment in an adaptive manner and optimize the algorithm parameters prior to the actual implementation to reduce the workaround time. This paper will review recent efforts to develop onboard navigation systems which can seamlessly transition between outdoor and indoor environments and different terrains seamlessly using Gazebo simulator with ROS integration. The methodologies surveyed include SLAM, Odometry and Localisation. An overview of the state-of-the-art is provided with a focus on approaches which are adaptive to dynamic sensor uncertainty, dynamic objects and dynamic scenes. The experiences reported on this work should provide insight for roboticists seeking an Autonomous SLAM solution for indoor applications.
△ Less
Submitted 13 February, 2023;
originally announced February 2023.
-
Evolution of SLAM: Toward the Robust-Perception of Autonomy
Authors:
B. Udugama
Abstract:
Simultaneous localisation and mapping (SLAM) is the problem of autonomous robots to construct or update a map of an undetermined unstructured environment while simultaneously estimate the pose in it. The current trend towards self-driving vehicles has influenced the development of robust SLAM techniques over the last 30 years. This problem is addressed by using a standard sensor or a sensor array…
▽ More
Simultaneous localisation and mapping (SLAM) is the problem of autonomous robots to construct or update a map of an undetermined unstructured environment while simultaneously estimate the pose in it. The current trend towards self-driving vehicles has influenced the development of robust SLAM techniques over the last 30 years. This problem is addressed by using a standard sensor or a sensor array (Ultrasonic sensor, LIDAR, Camera, Kinect RGB-D) with sensor fusion techniques to achieve the perception step. Sensing method is determined by considering the specifications of the environment to extract the features. Then the usage of classical Filter-based approaches, the global optimisation approach which is a popular method for visual-based SLAM and convolutional neural network-based methods such as deep learning-based SLAM are discussed whereas considering how to overcome the localisation and mapping issues. The robustness and scalability in long-term autonomy, performance and other new directions in the algorithms compared with each other to sort out. This paper is looking at the published previous work with a judgemental perspective from sensors to algorithm development while discussing open challenges and new research frontiers.
△ Less
Submitted 13 February, 2023;
originally announced February 2023.
-
Review on Efficient Strategies for Coordinated Motion and Tracking in Swarm Robotics
Authors:
B. Udugama
Abstract:
Swarm robotics is a creative method of organizing multi-robot structures, consisting of many basic robots influenced by communal insects. The greatest astonishing attribute of swarm robots is their capacity to function together to accomplish a collective objective. This paper addresses the list of current surveys, problems and algorithms that were stimulated in the research of Coordinated Movement…
▽ More
Swarm robotics is a creative method of organizing multi-robot structures, consisting of many basic robots influenced by communal insects. The greatest astonishing attribute of swarm robots is their capacity to function together to accomplish a collective objective. This paper addresses the list of current surveys, problems and algorithms that were stimulated in the research of Coordinated Movement in Swarm robotics. Algorithms for swarm robotics movement are contrasted, considering the swarm micro-robots to accomplish aggregation, creation, and clamouring by contrasting the relative computational simulations between the algorithms and simulations used.
△ Less
Submitted 13 February, 2023;
originally announced February 2023.
-
Object Dimension Extraction for Environment Mapping with Low Cost Cameras Fused with Laser Ranging
Authors:
E. M. S. P. Ekanayake,
T. H. M. N. C. Thelasingha,
U. V. B. L. Udugama,
G. M. R. I. Godaliyadda,
M. P. B. Ekanayake,
B. G. L. T. Samaranayake,
J. V. Wijayakulasooriya
Abstract:
It is essential to have a method to map an unknown terrain for various applications. For places where human access is not possible, a method should be proposed to identify the environment. Exploration, disaster relief, transportation and many other purposes would be convenient if a map of the environment is available. Replicating the human vision system using stereo cameras would be an optimum sol…
▽ More
It is essential to have a method to map an unknown terrain for various applications. For places where human access is not possible, a method should be proposed to identify the environment. Exploration, disaster relief, transportation and many other purposes would be convenient if a map of the environment is available. Replicating the human vision system using stereo cameras would be an optimum solution. In this work, we have used laser ranging based technique fused with stereo cameras to extract dimension of objects for mapping. The distortions were calibrated using mathematical model of the camera. By means of Semi Global Block Matching [1] disparity map was generated and reduces the noise using novel noise reduction method of disparity map by dilation. The Data from the Laser Range Finder (LRF) and noise reduced vision data has been used to identify the object parameters.
△ Less
Submitted 31 January, 2023;
originally announced February 2023.
-
Laser Ranging Based Intelligent System for Unknown Environment Mapping
Authors:
T. H. M. N. C. Thelasingha,
U. V. B. L. Udugama,
E. M. S. P. Ekanayake,
G. M. R. I. Godaliyadda,
M. P. B. Ekanayake,
B. G. L. T. Samaranayake,
J. V. Wijayakulasooriya
Abstract:
This work describes the implementation of a simple and computationally efficient Intelligent Navigation System (INS) for autonomous systems used in areas where human access is impossible. The system uses Laser Range Finder (LRF) readings as input, making it suitable for mobile platform implementation. The INS pre-processes the LRF readings to remove noise and determines an obstacle-free path for m…
▽ More
This work describes the implementation of a simple and computationally efficient Intelligent Navigation System (INS) for autonomous systems used in areas where human access is impossible. The system uses Laser Range Finder (LRF) readings as input, making it suitable for mobile platform implementation. The INS pre-processes the LRF readings to remove noise and determines an obstacle-free path for mapping. The system's localization method uses a similarity transform and particle filter. The system was tested in artificially generated environments and emulated in real-time with real-environment data. The system was then implemented in a Raspberry Pi3 on a 3WD Omni-directional mobile platform and tested in real environments. The system was able to generate an accurate 2D map of the area. The proposed methodology was shown to be efficient through a comparative analysis of execution time.
△ Less
Submitted 31 January, 2023;
originally announced February 2023.
