Showing 1–10 of 10 results for author: Savkin, A

Unsupervised Traffic Scene Generation with Synthetic 3D Scene Graphs

Authors: Artem Savkin, Rachid Ellouze, Nassir Navab, Federico Tombari

Abstract: Image synthesis driven by computer graphics achieved recently a remarkable realism, yet synthetic image data generated this way reveals a significant domain gap with respect to real-world data. This is especially true in autonomous driving scenarios, which represent a critical aspect for overcoming utilizing synthetic data for training neural networks. We propose a method based on domain-invariant… ▽ More Image synthesis driven by computer graphics achieved recently a remarkable realism, yet synthetic image data generated this way reveals a significant domain gap with respect to real-world data. This is especially true in autonomous driving scenarios, which represent a critical aspect for overcoming utilizing synthetic data for training neural networks. We propose a method based on domain-invariant scene representation to directly synthesize traffic scene imagery without rendering. Specifically, we rely on synthetic scene graphs as our internal representation and introduce an unsupervised neural network architecture for realistic traffic scene synthesis. We enhance synthetic scene graphs with spatial information about the scene and demonstrate the effectiveness of our approach through scene manipulation. △ Less

Submitted 15 March, 2023; originally announced March 2023.

Lidar Upsampling with Sliced Wasserstein Distance

Authors: Artem Savkin, Yida Wang, Sebastian Wirkert, Nassir Navab, Federico Tombar

Abstract: Lidar became an important component of the perception systems in autonomous driving. But challenges of training data acquisition and annotation made emphasized the role of the sensor to sensor domain adaptation. In this work, we address the problem of lidar upsampling. Learning on lidar point clouds is rather a challenging task due to their irregular and sparse structure. Here we propose a method… ▽ More Lidar became an important component of the perception systems in autonomous driving. But challenges of training data acquisition and annotation made emphasized the role of the sensor to sensor domain adaptation. In this work, we address the problem of lidar upsampling. Learning on lidar point clouds is rather a challenging task due to their irregular and sparse structure. Here we propose a method for lidar point cloud upsampling which can reconstruct fine-grained lidar scan patterns. The key idea is to utilize edge-aware dense convolutions for both feature extraction and feature expansion. Additionally applying a more accurate Sliced Wasserstein Distance facilitates learning of the fine lidar sweep structures. This in turn enables our method to employ a one-stage upsampling paradigm without the need for coarse and fine reconstruction. We conduct several experiments to evaluate our method and demonstrate that it provides better upsampling. △ Less

Submitted 31 January, 2023; originally announced January 2023.

Journal ref: in IEEE Robotics and Automation Letters, vol. 8, no. 1, pp. 392-399, Jan. 2023

Attention-based Adversarial Appearance Learning of Augmented Pedestrians

Authors: Kevin Strauss, Artem Savkin, Federico Tombari

Abstract: Synthetic data became already an essential component of machine learning-based perception in the field of autonomous driving. Yet it still cannot replace real data completely due to the sim2real domain shift. In this work, we propose a method that leverages the advantages of the augmentation process and adversarial training to synthesize realistic data for the pedestrian recognition task. Our appr… ▽ More Synthetic data became already an essential component of machine learning-based perception in the field of autonomous driving. Yet it still cannot replace real data completely due to the sim2real domain shift. In this work, we propose a method that leverages the advantages of the augmentation process and adversarial training to synthesize realistic data for the pedestrian recognition task. Our approach utilizes an attention mechanism driven by an adversarial loss to learn domain discrepancies and improve sim2real adaptation. Our experiments confirm that the proposed adaptation method is robust to such discrepancies and reveals both visual realism and semantic consistency. Furthermore, we evaluate our data generation pipeline on the task of pedestrian recognition and demonstrate that generated data resemble properties of the real domain. △ Less

Submitted 22 November, 2023; v1 submitted 6 July, 2021; originally announced July 2021.

KLIEP-based Density Ratio Estimation for Semantically Consistent Synthetic to Real Images Adaptation in Urban Traffic Scenes

Authors: Artem Savkin, Federico Tombari

Abstract: Synthetic data has been applied in many deep learning based computer vision tasks. Limited performance of algorithms trained solely on synthetic data has been approached with domain adaptation techniques such as the ones based on generative adversarial framework. We demonstrate how adversarial training alone can introduce semantic inconsistencies in translated images. To tackle this issue we propo… ▽ More Synthetic data has been applied in many deep learning based computer vision tasks. Limited performance of algorithms trained solely on synthetic data has been approached with domain adaptation techniques such as the ones based on generative adversarial framework. We demonstrate how adversarial training alone can introduce semantic inconsistencies in translated images. To tackle this issue we propose density prematching strategy using KLIEP-based density ratio estimation procedure. Finally, we show that aforementioned strategy improves quality of translated images of underlying method and their usability for the semantic segmentation task in the context of autonomous driving. △ Less

Submitted 26 May, 2021; originally announced May 2021.

Journal ref: 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2020) 5901-5908

Content Disentanglement for Semantically Consistent Synthetic-to-Real Domain Adaptation

Authors: Mert Keser, Artem Savkin, Federico Tombari

Abstract: Synthetic data generation is an appealing approach to generate novel traffic scenarios in autonomous driving. However, deep learning perception algorithms trained solely on synthetic data encounter serious performance drops when they are tested on real data. Such performance drops are commonly attributed to the domain gap between real and synthetic data. Domain adaptation methods that have been ap… ▽ More Synthetic data generation is an appealing approach to generate novel traffic scenarios in autonomous driving. However, deep learning perception algorithms trained solely on synthetic data encounter serious performance drops when they are tested on real data. Such performance drops are commonly attributed to the domain gap between real and synthetic data. Domain adaptation methods that have been applied to mitigate the aforementioned domain gap achieve visually appealing results, but usually introduce semantic inconsistencies into the translated samples. In this work, we propose a novel, unsupervised, end-to-end domain adaptation network architecture that enables semantically consistent \textit{sim2real} image transfer. Our method performs content disentanglement by employing shared content encoder and fixed style code. △ Less

Submitted 3 August, 2021; v1 submitted 18 May, 2021; originally announced May 2021.

Wireless Feedback Control with Variable Packet Length for Industrial IoT

Authors: Kang Huang, Wanchun Liu, Yonghui Li, Andrey Savkin, Branka Vucetic

Abstract: The paper considers a wireless networked control system (WNCS), where a controller sends packets carrying control information to an actuator through a wireless channel to control a physical process for industrial-control applications. In most of the existing work on WNCSs, the packet length for transmission is fixed. However, from the channel-encoding theory, if a message is encoded into a longer… ▽ More The paper considers a wireless networked control system (WNCS), where a controller sends packets carrying control information to an actuator through a wireless channel to control a physical process for industrial-control applications. In most of the existing work on WNCSs, the packet length for transmission is fixed. However, from the channel-encoding theory, if a message is encoded into a longer codeword, its reliability is improved at the expense of longer delay. Both delay and reliability have great impact on the control performance. Such a fundamental delay-reliability tradeoff has rarely been considered in WNCSs. In this paper, we propose a novel WNCS, where the controller adaptively changes the packet length for control based on the current status of the physical process. We formulate a decision-making problem and find the optimal variable-length packet-transmission policy for minimizing the long-term average cost of the WNCSs. We derive a necessary and sufficient condition on the existence of the optimal policy in terms of the transmission reliabilities with different packet lengths and the control system parameter. △ Less

Submitted 27 May, 2020; originally announced May 2020.

Comments: Paper accepted by IEEE Wireless Communications Letters

Optimal Downlink-Uplink Scheduling of Wireless Networked Control for Industrial IoT

Authors: Kang Huang, Wanchun Liu, Yonghui Li, Branka Vucetic, Andrey Savkin

Abstract: This paper considers a wireless networked control system (WNCS) consisting of a dynamic system to be controlled (i.e., a plant), a sensor, an actuator and a remote controller for mission-critical Industrial Internet of Things (IIoT) applications. A WNCS has two types of wireless transmissions, i.e., the sensor's measurement transmission to the controller and the controller's command transmission t… ▽ More This paper considers a wireless networked control system (WNCS) consisting of a dynamic system to be controlled (i.e., a plant), a sensor, an actuator and a remote controller for mission-critical Industrial Internet of Things (IIoT) applications. A WNCS has two types of wireless transmissions, i.e., the sensor's measurement transmission to the controller and the controller's command transmission to the actuator. In this work, we consider a practical half-duplex controller, which introduces a novel transmission-scheduling problem for WNCSs. A frequent scheduling of sensor's transmission results in a better estimation of plant states at the controller and thus a higher quality of control command, but it leads to a less frequent/timely control of the plant. Therefore, considering the overall control performance of the plant in terms of its average cost function, there exists a fundamental tradeoff between the sensor's and the controller's transmissions. We formulate a new problem to optimize the transmission-scheduling policy for minimizing the long-term average cost function. We derive the necessary and sufficient condition of the existence of a stationary and deterministic optimal policy that results in a bounded average cost in terms of the transmission reliabilities of the sensor-to-controller and controller-to-actuator channels. Also, we derive an easy-to-compute suboptimal policy, which notably reduces the average cost of the plant compared to a naive alternative-scheduling policy. △ Less

Submitted 6 October, 2019; v1 submitted 17 July, 2019; originally announced July 2019.

Comments: This work has been submitted to the IEEE for possible publication

Automated Scene Flow Data Generation for Training and Verification

Authors: Oliver Wasenmüller, René Schuster, Didier Stricker, Karl Leiss, Jürger Pfister, Oleksandra Ganus, Julian Tatsch, Artem Savkin, Nikolas Brasch

Abstract: Scene flow describes the 3D position as well as the 3D motion of each pixel in an image. Such algorithms are the basis for many state-of-the-art autonomous or automated driving functions. For verification and training large amounts of ground truth data is required, which is not available for real data. In this paper, we demonstrate a technology to create synthetic data with dense and precise scene… ▽ More Scene flow describes the 3D position as well as the 3D motion of each pixel in an image. Such algorithms are the basis for many state-of-the-art autonomous or automated driving functions. For verification and training large amounts of ground truth data is required, which is not available for real data. In this paper, we demonstrate a technology to create synthetic data with dense and precise scene flow ground truth. △ Less

Submitted 31 August, 2018; v1 submitted 30 August, 2018; originally announced August 2018.

Optimized Deployment of Autonomous Drones to Improve User Experience in Cellular Networks

Authors: Hailong Huang, Andrey V. Savkin, Ming Ding, Mohamed Ali Kaafar

Abstract: Modern wireless traffic demand pushes Internet Service Providers to develop effective strategies to improve user experience. Since deploying dense Base Stations (BSs) is not cost efficient, an alternative is to deploy autonomous drones to supplement existing BSs. A street graph is adopted to represent the area of interest. The outdoor User Equipments (UEs) to be served locate near streets and the… ▽ More Modern wireless traffic demand pushes Internet Service Providers to develop effective strategies to improve user experience. Since deploying dense Base Stations (BSs) is not cost efficient, an alternative is to deploy autonomous drones to supplement existing BSs. A street graph is adopted to represent the area of interest. The outdoor User Equipments (UEs) to be served locate near streets and the 2D projections of drones are restricted to streets to avoid collision with buildings. We build up a UE density function based on a real dataset, reflecting the traffic in the area. We study four problems: where to deploy single drone to cover maximum UEs, where to deploy $k$ drones cover maximum UEs subject to an inner drone distance constraint, where to deploy $k$ drones cover maximum UEs subject to inner drone distance constraint and drones' battery constraints, and the minimum drones to cover a given percentage of UEs subject to inner drone distance constraint. We prove that the latter three problems are NP-hard and propose greedy algorithms with theoretical analysis. To our best knowledge, this is the first paper to consider the battery constraints for drone deployments. Extensive simulations have been conducted to verify the effectiveness of our approaches. △ Less

Submitted 6 December, 2017; originally announced December 2017.

Proofs of the Technical Results Justifying an Algorithm of Reactive 3D Navigation for a Surface Scan by a Nonholonomic Mobile Robot

Authors: Alexey S. Matveev, Kirill S. Ovchinnikov, Andrey V. Savkin

Abstract: A single nonholonomic under-actuated mobile robot with a bounded control range travels in a 3D workspace. This workspace also hosts a compact unknown domain with a smooth boundary. The robot has access to the horizontal distance to this domain and to a certain direction (typically, vertical) in the space, along with its coordinate (typically, altitude) in this direction. We present a new navigatio… ▽ More A single nonholonomic under-actuated mobile robot with a bounded control range travels in a 3D workspace. This workspace also hosts a compact unknown domain with a smooth boundary. The robot has access to the horizontal distance to this domain and to a certain direction (typically, vertical) in the space, along with its coordinate (typically, altitude) in this direction. We present a new navigation law that drives the robot to the desired distance to the domain and ensures subsequent full scan of its surface within a desired range of "altitudes". The proposed strategy is computationally inexpensive and achieves full scan at the lowest control level via generating the current control as a simple, reflex-like reaction to the current observation. The paper presents and proves key technical facts underlying mathematically rigorous analysis and justification of the proposed guidance approach. △ Less

Submitted 9 May, 2016; originally announced May 2016.