-
Map Prediction and Generative Entropy for Multi-Agent Exploration
Authors:
Alexander Spinos,
Bradley Woosley,
Justin Rokisky,
Christopher Korpela,
John G. Rogers III,
Brian A. Bittner
Abstract:
Traditionally, autonomous reconnaissance applications have acted on explicit sets of historical observations. Aided by recent breakthroughs in generative technologies, this work enables robot teams to act beyond what is currently known about the environment by inferring a distribution of reasonable interpretations of the scene. We developed a map predictor that inpaints the unknown space in a mult…
▽ More
Traditionally, autonomous reconnaissance applications have acted on explicit sets of historical observations. Aided by recent breakthroughs in generative technologies, this work enables robot teams to act beyond what is currently known about the environment by inferring a distribution of reasonable interpretations of the scene. We developed a map predictor that inpaints the unknown space in a multi-agent 2D occupancy map during an exploration mission. From a comparison of several inpainting methods, we found that a fine-tuned latent diffusion inpainting model could provide rich and coherent interpretations of simulated urban environments with relatively little computation time. By iteratively inferring interpretations of the scene throughout an exploration run, we are able to identify areas that exhibit high uncertainty in the prediction, which we formalize with the concept of generative entropy. We prioritize tasks in regions of high generative entropy, hypothesizing that this will expedite convergence on an accurate predicted map of the scene. In our study we juxtapose this new paradigm of task ranking with the state of the art, which ranks regions to explore by those which maximize expected information recovery. We compare both of these methods in a simulated urban environment with three vehicles. Our results demonstrate that by using our new task ranking method, we can predict a correct scene significantly faster than with a traditional information-guided method.
△ Less
Submitted 22 January, 2025;
originally announced January 2025.
-
Rapid Co-design of Task-Specialized Whegged Robots for Ad-Hoc Needs
Authors:
Varun Madabushi,
Katie M. Popek,
Craig Knuth,
Galen Mullins,
Brian A. Bittner
Abstract:
In this work, we investigate the use of co-design methods to iterate upon robot designs in the field, performing time sensitive, ad-hoc tasks. Our method optimizes the morphology and wheg trajectory for a MiniRHex robot, producing 3D printable structures and leg trajectory parameters. Tested in four terrains, we show that robots optimized in simulation exhibit strong sim-to-real transfer and are n…
▽ More
In this work, we investigate the use of co-design methods to iterate upon robot designs in the field, performing time sensitive, ad-hoc tasks. Our method optimizes the morphology and wheg trajectory for a MiniRHex robot, producing 3D printable structures and leg trajectory parameters. Tested in four terrains, we show that robots optimized in simulation exhibit strong sim-to-real transfer and are nearly twice as efficient as the nominal platform when tested in hardware.
△ Less
Submitted 8 May, 2024;
originally announced May 2024.
-
Generative Planning with Fast Collision Checks for High Speed Navigation
Authors:
Craig Knuth,
Cora Dimmig,
Brian Bittner
Abstract:
Reasoning about large numbers of diverse plans to achieve high speed navigation in cluttered environments remains a challenge for robotic systems even in the case of perfect perceptual information. Often, this is tackled by methods that iteratively optimize around a prior seeded trajectory and consequently restrict to local optima. We present a novel planning method using normalizing flows (NFs) t…
▽ More
Reasoning about large numbers of diverse plans to achieve high speed navigation in cluttered environments remains a challenge for robotic systems even in the case of perfect perceptual information. Often, this is tackled by methods that iteratively optimize around a prior seeded trajectory and consequently restrict to local optima. We present a novel planning method using normalizing flows (NFs) to encode expert-styled motion primitives. We also present an accelerated collision checking framework that enables rejecting samples from the prior distribution before running them through the NF model for rapid sampling of collision-free trajectories. The choice of an NF as the generator permits a flexible way to encode diverse multi-modal behavior distributions while maintaining a smooth relation to the input space which allows approximating collision checks on NF inputs rather than outputs. We show comparable performance to model predictive path integral control in random cluttered environments and improved exit rates in a cul-de-sac environment. We conclude by discussing our plans for future work to improve both safety and performance of our controller.
△ Less
Submitted 7 May, 2024;
originally announced May 2024.
-
Adaptive Gait Modeling and Optimization for Principally Kinematic Systems
Authors:
Siming Deng,
Noah J. Cowan,
Brian A. Bittner
Abstract:
Robotic adaptation to unanticipated operating conditions is crucial to achieving persistence and robustness in complex real world settings. For a wide range of cutting-edge robotic systems, such as micro- and nano-scale robots, soft robots, medical robots, and bio-hybrid robots, it is infeasible to anticipate the operating environment a priori due to complexities that arise from numerous factors i…
▽ More
Robotic adaptation to unanticipated operating conditions is crucial to achieving persistence and robustness in complex real world settings. For a wide range of cutting-edge robotic systems, such as micro- and nano-scale robots, soft robots, medical robots, and bio-hybrid robots, it is infeasible to anticipate the operating environment a priori due to complexities that arise from numerous factors including imprecision in manufacturing, chemo-mechanical forces, and poorly understood contact mechanics. Drawing inspiration from data-driven modeling, geometric mechanics (or gauge theory), and adaptive control, we employ an adaptive system identification framework and demonstrate its efficacy in enhancing the performance of principally kinematic locomotors (those governed by Rayleigh dissipation or zero momentum conservation). We showcase the capability of the adaptive model to efficiently accommodate varying terrains and iteratively modified behaviors within a behavior optimization framework. This provides both the ability to improve fundamental behaviors and perform motion tracking to precision. Notably, we are capable of optimizing the gaits of the Purcell swimmer using approximately 10 cycles per link, which for the nine-link Purcell swimmer provides a factor of ten improvement in optimization speed over the state of the art. Beyond simply a computational speed up, this ten-fold improvement may enable this method to be successfully deployed for in-situ behavior refinement, injury recovery, and terrain adaptation, particularly in domains where simulations provide poor guides for the real world.
△ Less
Submitted 18 April, 2024; v1 submitted 3 October, 2023;
originally announced October 2023.
-
Floating-base manipulation on zero-perturbation manifolds
Authors:
Brian A. Bittner,
Jason Reid,
Kevin C. Wolfe
Abstract:
To achieve high-dexterity motion planning on floating-base systems, the base dynamics induced by arm motions must be treated carefully. In general, it is a significant challenge to establish a fixed-base frame during tasking due to forces and torques on the base that arise directly from arm motions (e.g. arm drag in low Reynolds environments and arm momentum in high Reynolds environments). While t…
▽ More
To achieve high-dexterity motion planning on floating-base systems, the base dynamics induced by arm motions must be treated carefully. In general, it is a significant challenge to establish a fixed-base frame during tasking due to forces and torques on the base that arise directly from arm motions (e.g. arm drag in low Reynolds environments and arm momentum in high Reynolds environments). While thrusters can in theory be used to regulate the vehicle pose, it is often insufficient to establish a stable pose for precise tasking, whether the cause be due to underactuation, modeling inaccuracy, suboptimal control parameters, or insufficient power. We propose a solution that asks the thrusters to do less high bandwidth perturbation correction by planning arm motions that induce zero perturbation on the base. We are able to cast our motion planner as a nonholonomic rapidly-exploring random tree (RRT) by representing the floating-base dynamics as pfaffian constraints on joint velocity. These constraints guide the manipulators to move on zero-perturbation manifolds (which inhabit a subspace of the tangent space of the internal configuration space). To invoke this representation (termed a \textit{perturbation map}) we assume the body velocity (perturbation) of the base to be a joint-defined linear mapping of joint velocity and describe situations where this assumption is realistic (including underwater, aerial, and orbital environments). The core insight of this work is that when perturbation of the floating-base has affine structure with respect to joint velocity, it provides the system a class of kinematic reduction that permits the use of sample-based motion planners (specifically a nonholonomic RRT). We show that this allows rapid, exploration-geared motion planning for high degree of freedom systems in obstacle rich environments, even on floating-base systems with nontrivial dynamics.
△ Less
Submitted 5 July, 2023;
originally announced July 2023.
-
A Data-Driven Approach to Geometric Modeling of Systems with Low-Bandwidth Actuator Dynamics
Authors:
Siming Deng,
Junning Liu,
Bibekananda Datta,
Aishwarya Pantula,
David H. Gracias,
Thao D. Nguyen,
Brian A. Bittner,
Noah J. Cowan
Abstract:
It is challenging to perform system identification on soft robots due to their underactuated, high-dimensional dynamics. In this work, we present a data-driven modeling framework, based on geometric mechanics (also known as gauge theory) that can be applied to systems with low-bandwidth control of the system's internal configuration. This method constructs a series of connected models comprising a…
▽ More
It is challenging to perform system identification on soft robots due to their underactuated, high-dimensional dynamics. In this work, we present a data-driven modeling framework, based on geometric mechanics (also known as gauge theory) that can be applied to systems with low-bandwidth control of the system's internal configuration. This method constructs a series of connected models comprising actuator and locomotor dynamics based on data points from stochastically perturbed, repeated behaviors. By deriving these connected models from general formulations of dissipative Lagrangian systems with symmetry, we offer a method that can be applied broadly to robots with first-order, low-pass actuator dynamics, including swelling-driven actuators used in hydrogel crawlers. These models accurately capture the dynamics of the system shape and body movements of a simplified swimming robot model. We further apply our approach to a stimulus-responsive hydrogel simulator that captures the complexity of chemo-mechanical interactions that drive shape changes in biomedically relevant micromachines. Finally, we propose an approach of numerically optimizing control signals by iteratively refining models, which is applied to optimize the input waveform for the hydrogel crawler. This transfer to realistic environments provides promise for applications in locomotor design and biomedical engineering.
△ Less
Submitted 3 October, 2023; v1 submitted 3 July, 2023;
originally announced July 2023.
-
Bridging Walking and Slithering -- Stokesian Locomotion
Authors:
Shai Revzen,
Dan Zhao,
Glenna Clifton,
Brian Bittner,
Nick Gravish
Abstract:
Both legged locomotion and slithering motions typically utilize periodic gaits -- repeating cycles of body shape change that produce a net motion through the world. Legged locomotion can be viewed from the perspective of piece-wise contact constraint formation and removal. Slithering and low Reynolds number swimming operate under continuous constraints of force balance, wherein dissipation removes…
▽ More
Both legged locomotion and slithering motions typically utilize periodic gaits -- repeating cycles of body shape change that produce a net motion through the world. Legged locomotion can be viewed from the perspective of piece-wise contact constraint formation and removal. Slithering and low Reynolds number swimming operate under continuous constraints of force balance, wherein dissipation removes the ability to accumulate momentum. Here we discuss how to bridge the gap between these domains of motion, thereby, among other benefits, producing models for the space of legged locomotion with slipping. The connective fabric is the use of a "Stokesian", or "local connection" model.
△ Less
Submitted 11 April, 2022;
originally announced May 2022.
-
Optimizing Gait Libraries via a Coverage Metric
Authors:
Brian Bittner,
Shai Revzen
Abstract:
Many robots move through the world by composing locomotion primitives like steps and turns. To do so well, robots need not have primitives that make intuitive sense to humans. This becomes of paramount importance when robots are damaged and no longer move as designed. Here we propose a goal function we call "coverage", that represents the usefulness of a library of locomotion primitives in a manne…
▽ More
Many robots move through the world by composing locomotion primitives like steps and turns. To do so well, robots need not have primitives that make intuitive sense to humans. This becomes of paramount importance when robots are damaged and no longer move as designed. Here we propose a goal function we call "coverage", that represents the usefulness of a library of locomotion primitives in a manner agnostic to the particulars of the primitives themselves. We demonstrate the ability to optimize coverage on both simulated and physical robots, and show that coverage can be rapidly recovered after injury. This suggests that by optimizing for coverage, robots can sustain their ability to navigate through the world even in the face of significant mechanical failures. The benefits of this approach are enhanced by sample-efficient, data-driven approaches to system identification that can rapidly inform the optimization of primitives. We found that the number of degrees of freedom improved the rate of recovery of our simulated robots, a rare result in the fields of gait optimization and reinforcement learning. We showed that a robot with limbs made of tree branches (for which no CAD model or first principles model was available) is able to quickly find an effective high-coverage library of motion primitives. The optimized primitives are entirely non-obvious to a human observer, and thus are unlikely to be attainable through manual tuning.
△ Less
Submitted 3 October, 2021; v1 submitted 19 July, 2021;
originally announced July 2021.
-
Data-Driven Geometric System Identification for Shape-Underactuated Dissipative Systems
Authors:
Brian Bittner,
Ross L. Hatton,
Shai Revzen
Abstract:
Systems whose movement is highly dissipative provide an opportunity to both identify models easily and quickly optimize motions. Geometric mechanics provides means for reduction of the dynamics by environmental homogeneity, while the dissipative nature minimizes the role of second order (inertial) features in the dynamics. Here we extend the tools of geometric system identification to ``Shape-Unde…
▽ More
Systems whose movement is highly dissipative provide an opportunity to both identify models easily and quickly optimize motions. Geometric mechanics provides means for reduction of the dynamics by environmental homogeneity, while the dissipative nature minimizes the role of second order (inertial) features in the dynamics. Here we extend the tools of geometric system identification to ``Shape-Underactuated Dissipative Systems (SUDS)'' -- systems whose motions are more dissipative than inertial, but whose actuation is restricted to a subset of the body shape coordinates.
Many animal motions are SUDS, including micro-swimmers such as nematodes and flagellated bacteria, and granular locomotors such as snakes and lizards. Many soft robots are also SUDS, particularly those robots using highly damped series elastic actuators. Whether involved in locomotion or manipulation, these robots are often used to interface less rigidly with the environment.
We motivate the use of SUDS models, and validate their ability to predict motion of a variety of simulated viscous swimming platforms. For a large class of SUDS, we show how the shape velocity actuation inputs can be directly converted into torque inputs suggesting that systems with soft pneumatic actuators or dielectric elastomers can be modeled with the tools presented. Based on fundamental assumptions in the physics, we show how our model complexity scales linearly with the number of passive shape coordinates. This offers a large reduction on the number of trials needed to identify the system model from experimental data, and may reduce overfitting. The sample efficiency of our method suggests its use in modeling, control, and optimization in robotics, and as a tool for the study of organismal motion in friction dominated regimes.
△ Less
Submitted 28 August, 2021; v1 submitted 20 December, 2020;
originally announced December 2020.
-
Drawing with AI -- Exploring Collaborative Inking Experiences Based on Mid-air Pointing and Reinforcement Learning
Authors:
Franziska Geiger,
Michelle Martin,
Monika Pichlmair,
Ilhan Aslan,
Hannes Ritschel,
Björn Bittner,
Elisabeth André
Abstract:
Digitalization is changing the nature of tools and materials, which are used in artistic practices in professional and non-professional settings. For example, today it is common that even children express their ideas and explore their creativity by drawing on tablets as digital canvases. While there are many software-based tools, which resemble traditional tools, such as various forms of virtual b…
▽ More
Digitalization is changing the nature of tools and materials, which are used in artistic practices in professional and non-professional settings. For example, today it is common that even children express their ideas and explore their creativity by drawing on tablets as digital canvases. While there are many software-based tools, which resemble traditional tools, such as various forms of virtual brushes, erasers, etc. in contrast to traditional materials there is potential in augmenting software-based tools and digital canvases with artificial intelligence. Curious about how it would feel to interact with a digital canvas, which would be in contrast to a traditional canvas dynamic, responsive, and potentially able to continuously adapt to its user's input, we developed a drawing application and conducted a qualitative study with 14 users. In this paper, we describe details of our design process, which lead up to using a k-armed bandit as a simple form of reinforcement learning and a LeapMotion sensor to allow people from all walks of like, old and young to draw on pervasive displays, small and large, positioned near or far.
△ Less
Submitted 10 October, 2020;
originally announced October 2020.
-
Gait modeling and optimization for the perturbed Stokes regime
Authors:
Matthew D. Kvalheim,
Brian Bittner,
Shai Revzen
Abstract:
Many forms of locomotion, both natural and artificial, are dominated by viscous friction in the sense that without power expenditure they quickly come to a standstill. From geometric mechanics, it is known that for swimming at the "Stokesian" (viscous; zero Reynolds number) limit, the motion is governed by a reduced order "connection" model that describes how body shape change produces motion for…
▽ More
Many forms of locomotion, both natural and artificial, are dominated by viscous friction in the sense that without power expenditure they quickly come to a standstill. From geometric mechanics, it is known that for swimming at the "Stokesian" (viscous; zero Reynolds number) limit, the motion is governed by a reduced order "connection" model that describes how body shape change produces motion for the body frame with respect to the world. In the "perturbed Stokes regime" where inertial forces are still dominated by viscosity, but are not negligible (low Reynolds number), we show that motion is still governed by a functional relationship between shape velocity and body velocity, but this function is no longer linear in shape change rate. We derive this model using results from singular perturbation theory, and the theory of noncompact normally hyperbolic invariant manifolds (NHIMs).
Using the theoretical properties of this reduced-order model, we develop an algorithm that estimates an approximation to the dynamics near a cyclic body shape change (a "gait") directly from observational data of shape and body motion. This extends our previous work which assumed kinematic "connection" models. To compare the old and new algorithms, we analyze simulated swimmers over a range of inertia to damping ratios. Our new class of models performs well on the Stokesian regime, and over several orders of magnitude outside it into the perturbed Stokes regime, where it gives significantly improved prediction accuracy compared to previous work.
In addition to algorithmic improvements, we thereby present a new class of models that is of independent interest. Their application to data-driven modeling improves our ability to study the optimality of animal gaits, and our ability to use hardware-in-the-loop optimization to produce gaits for robots.
△ Less
Submitted 25 April, 2020; v1 submitted 11 June, 2019;
originally announced June 2019.
-
The xSAP Safety Analysis Platform
Authors:
Benjamin Bittner,
Marco Bozzano,
Roberto Cavada,
Alessandro Cimatti,
Marco Gario,
Alberto Griggio,
Cristian Mattarei,
Andrea Micheli,
Gianni Zampedri
Abstract:
This paper describes the xSAP safety analysis platform. xSAP provides several model-based safety analysis features for finite- and infinite-state synchronous transition systems. In particular, it supports library-based definition of fault modes, an automatic model extension facility, generation of safety analysis artifacts such as Dynamic Fault Trees (DFTs) and Failure Mode and Effects Analysis (F…
▽ More
This paper describes the xSAP safety analysis platform. xSAP provides several model-based safety analysis features for finite- and infinite-state synchronous transition systems. In particular, it supports library-based definition of fault modes, an automatic model extension facility, generation of safety analysis artifacts such as Dynamic Fault Trees (DFTs) and Failure Mode and Effects Analysis (FMEA) tables. Moreover, it supports probabilistic evaluation of Fault Trees, failure propagation analysis using Timed Failure Propagation Graphs (TFPGs), and Common Cause Analysis (CCA). xSAP has been used in several industrial projects as verification back-end, and is currently being evaluated in a joint R&D Project involving FBK and The Boeing Company.
△ Less
Submitted 29 April, 2015; v1 submitted 28 April, 2015;
originally announced April 2015.
