-
Geometric Gait Optimization for Kinodynamic Systems Using a Lie Group Integrator
Authors:
Yanhao Yang,
Ross L. Hatton
Abstract:
This paper presents a gait optimization and motion planning framework for a class of locomoting systems with mixed kinematic and dynamic properties. Using Lagrangian reduction and differential geometry, we derive a general dynamic model that incorporates second-order dynamics and nonholonomic constraints, applicable to kinodynamic systems such as wheeled robots with nonholonomic constraints as wel…
▽ More
This paper presents a gait optimization and motion planning framework for a class of locomoting systems with mixed kinematic and dynamic properties. Using Lagrangian reduction and differential geometry, we derive a general dynamic model that incorporates second-order dynamics and nonholonomic constraints, applicable to kinodynamic systems such as wheeled robots with nonholonomic constraints as well as swimming robots with nonisotropic fluid-added inertia and hydrodynamic drag. Building on Lie group integrators and group symmetries, we develop a variational gait optimization method for kinodynamic systems. By integrating multiple gaits and their transitions, we construct comprehensive motion plans that enable a wide range of motions for these systems. We evaluate our framework on three representative examples: roller racer, snakeboard, and swimmer. Simulation and hardware experiments demonstrate diverse motions, including acceleration, steady-state maintenance, gait transitions, and turning. The results highlight the effectiveness of the proposed method and its potential for generalization to other biological and robotic locomoting systems.
△ Less
Submitted 26 April, 2025;
originally announced April 2025.
-
Geometric Data-Driven Multi-Jet Locomotion Inspired by Salps
Authors:
Yanhao Yang,
Nina L. Hecht,
Yousef Salaman-Maclara,
Nathan Justus,
Zachary A. Thomas,
Farhan Rozaidi,
Ross L. Hatton
Abstract:
Salps are marine animals consisting of chains of jellyfish-like units. Their capacity for effective underwater undulatory locomotion through coordinating multi-jet propulsion has aroused significant interest in the field of robotics and inspired extensive research including design, modeling, and control. In this paper, we conduct a comprehensive analysis of the locomotion of salp-like systems usin…
▽ More
Salps are marine animals consisting of chains of jellyfish-like units. Their capacity for effective underwater undulatory locomotion through coordinating multi-jet propulsion has aroused significant interest in the field of robotics and inspired extensive research including design, modeling, and control. In this paper, we conduct a comprehensive analysis of the locomotion of salp-like systems using the robotic platform "LandSalp" based on geometric mechanics, including mechanism design, dynamic modeling, system identification, and motion planning and control. Our work takes a step toward a better understanding of salps' underwater locomotion and provides a clear path for extending these insights to more complex and capable underwater robotic systems. Furthermore, this study illustrates the effectiveness of geometric mechanics in bio-inspired robots for efficient data-driven locomotion modeling, demonstrated by learning the dynamics of LandSalp from only 3 minutes of experimental data. Lastly, we extend the geometric mechanics principles to multi-jet propulsion systems with stability considerations and validate the theory through experiments on the LandSalp hardware.
△ Less
Submitted 11 March, 2025;
originally announced March 2025.
-
The Geometry of Optimal Gait Families for Steering Kinematic Locomoting Systems
Authors:
Jinwoo Choi,
Siming Deng,
Nathan Justus,
Noah J. Cowan,
Ross L. Hatton
Abstract:
Motion planning for locomotion systems typically requires translating high-level rigid-body tasks into low-level joint trajectories-a process that is straightforward for car-like robots with fixed, unbounded actuation inputs but more challenging for systems like snake robots, where the mapping depends on the current configuration and is constrained by joint limits. In this paper, we focus on gener…
▽ More
Motion planning for locomotion systems typically requires translating high-level rigid-body tasks into low-level joint trajectories-a process that is straightforward for car-like robots with fixed, unbounded actuation inputs but more challenging for systems like snake robots, where the mapping depends on the current configuration and is constrained by joint limits. In this paper, we focus on generating continuous families of optimal gaits-collections of gaits parameterized by step size or steering rate-to enhance controllability and maneuverability. We uncover the underlying geometric structure of these optimal gait families and propose methods for constructing them using both global and local search strategies, where the local method and the global method compensate each other. The global search approach is robust to nonsmooth behavior, albeit yielding reduced-order solutions, while the local search provides higher accuracy but can be unstable near nonsmooth regions. To demonstrate our framework, we generate optimal gait families for viscous and perfect-fluid three-link swimmers. This work lays a foundation for integrating low-level joint controllers with higher-level motion planners in complex locomotion systems.
△ Less
Submitted 24 February, 2025;
originally announced February 2025.
-
Riemannian Variational Calculus: Optimal Trajectories Under Inertia, Gravity, and Drag Effects
Authors:
Jinwoo Choi,
Alejandro Cabrera,
Ross L. Hatton
Abstract:
Robotic motion optimization often focuses on task-specific solutions, overlooking fundamental motion principles. Building on Riemannian geometry and the calculus of variations (often appearing as indirect methods of optimal control), we derive an optimal control equation that expresses general forces as functions of configuration and velocity, revealing how inertia, gravity, and drag shape optimal…
▽ More
Robotic motion optimization often focuses on task-specific solutions, overlooking fundamental motion principles. Building on Riemannian geometry and the calculus of variations (often appearing as indirect methods of optimal control), we derive an optimal control equation that expresses general forces as functions of configuration and velocity, revealing how inertia, gravity, and drag shape optimal trajectories. Our analysis identifies three key effects: (i) curvature effects of inertia manifold, (ii) curvature effects of potential field, and (iii) shortening effects from resistive force. We validate our approach on a two-link manipulator and a UR5, demonstrating a unified geometric framework for understanding optimal trajectories beyond geodesic-based planning.
△ Less
Submitted 17 March, 2025; v1 submitted 12 October, 2024;
originally announced October 2024.
-
Geometric Design and Gait Co-Optimization for Soft Continuum Robots Swimming at Low and High Reynolds Numbers
Authors:
Yanhao Yang,
Ross L. Hatton
Abstract:
Recent advancements in soft actuators have enabled soft continuum swimming robots to achieve higher efficiency and more closely mimic the behaviors of real marine animals. However, optimizing the design and control of these soft continuum robots remains a significant challenge. In this paper, we present a practical framework for the co-optimization of the design and control of soft continuum robot…
▽ More
Recent advancements in soft actuators have enabled soft continuum swimming robots to achieve higher efficiency and more closely mimic the behaviors of real marine animals. However, optimizing the design and control of these soft continuum robots remains a significant challenge. In this paper, we present a practical framework for the co-optimization of the design and control of soft continuum robots, approached from a geometric locomotion analysis perspective. This framework is based on the principles of geometric mechanics, accounting for swimming at both low and high Reynolds numbers. By generalizing geometric principles to continuum bodies, we achieve efficient geometric variational co-optimization of designs and gaits across different power consumption metrics and swimming environments. The resulting optimal designs and gaits exhibit greater efficiencies at both low and high Reynolds numbers compared to three-link or serpenoid swimmers with the same degrees of freedom, approaching or even surpassing the efficiencies of infinitely flexible swimmers and those with higher degrees of freedom.
△ Less
Submitted 27 April, 2025; v1 submitted 23 September, 2024;
originally announced September 2024.
-
Optimal Control Approach for Gait Transition with Riemannian Splines
Authors:
Jinwoo Choi,
Ross L. Hatton
Abstract:
Robotic locomotion often relies on sequenced gaits to efficiently convert control input into desired motion. Despite extensive studies on gait optimization, achieving smooth and efficient gait transitions remains challenging. In this paper, we propose a general solver based on geometric optimal control methods, leveraging insights from previous works on gait efficiency. Building upon our previous…
▽ More
Robotic locomotion often relies on sequenced gaits to efficiently convert control input into desired motion. Despite extensive studies on gait optimization, achieving smooth and efficient gait transitions remains challenging. In this paper, we propose a general solver based on geometric optimal control methods, leveraging insights from previous works on gait efficiency. Building upon our previous work, we express the effort to execute the trajectory as distinct geometric objects, transforming the optimization problems into boundary value problems. To validate our approach, we generate gait transition trajectories for three-link swimmers across various fluid environments. This work provides insights into optimal trajectory geometries and mechanical considerations for robotic locomotion.
△ Less
Submitted 13 September, 2024;
originally announced September 2024.
-
Towards Geometric Motion Planning for High-Dimensional Systems: Gait-Based Coordinate Optimization and Local Metrics
Authors:
Yanhao Yang,
Capprin Bass,
Ross L. Hatton
Abstract:
Geometric motion planning offers effective and interpretable gait analysis and optimization tools for locomoting systems. However, due to the curse of dimensionality in coordinate optimization, a key component of geometric motion planning, it is almost infeasible to apply current geometric motion planning to high-dimensional systems. In this paper, we propose a gait-based coordinate optimization m…
▽ More
Geometric motion planning offers effective and interpretable gait analysis and optimization tools for locomoting systems. However, due to the curse of dimensionality in coordinate optimization, a key component of geometric motion planning, it is almost infeasible to apply current geometric motion planning to high-dimensional systems. In this paper, we propose a gait-based coordinate optimization method that overcomes the curse of dimensionality. We also identify a unified geometric representation of locomotion by generalizing various nonholonomic constraints into local metrics. By combining these two approaches, we take a step towards geometric motion planning for high-dimensional systems. We test our method in two classes of high-dimensional systems - low Reynolds number swimmers and free-falling Cassie - with up to 11-dimensional shape variables. The resulting optimal gait in the high-dimensional system shows better efficiency compared to that of the reduced-order model. Furthermore, we provide a geometric optimality interpretation of the optimal gait.
△ Less
Submitted 6 March, 2024; v1 submitted 16 September, 2023;
originally announced September 2023.
-
Geometric Gait Optimization for Inertia-Dominated Systems With Nonzero Net Momentum
Authors:
Yanhao Yang,
Ross L. Hatton
Abstract:
Inertia-dominated mechanical systems can achieve net displacement by 1) periodically changing their shape (known as kinematic gait) and 2) adjusting their inertia distribution to utilize the existing nonzero net momentum (known as momentum gait). Therefore, finding the gait that most effectively utilizes the two types of locomotion in terms of the magnitude of the net momentum is a significant top…
▽ More
Inertia-dominated mechanical systems can achieve net displacement by 1) periodically changing their shape (known as kinematic gait) and 2) adjusting their inertia distribution to utilize the existing nonzero net momentum (known as momentum gait). Therefore, finding the gait that most effectively utilizes the two types of locomotion in terms of the magnitude of the net momentum is a significant topic in the study of locomotion. For kinematic locomotion with zero net momentum, the geometry of optimal gaits is expressed as the equilibria of system constraint curvature flux through the surface bounded by the gait, and the cost associated with executing the gait in the metric space. In this paper, we identify the geometry of optimal gaits with nonzero net momentum effects by lifting the gait description to a time-parameterized curve in shape-time space. We also propose the variational gait optimization algorithm corresponding to the lifted geometric structure, and identify two distinct patterns in the optimal motion, determined by whether or not the kinematic and momentum gaits are concentric. The examples of systems with and without fluid-added mass demonstrate that the proposed algorithm can efficiently solve forward and turning locomotion gaits in the presence of nonzero net momentum. At any given momentum and effort limit, the proposed optimal gait that takes into account both momentum and kinematic effects outperforms the reference gaits that each only considers one of these effects.
△ Less
Submitted 13 September, 2023;
originally announced September 2023.
-
Geometrically Modulable Gait Design for Quadrupeds
Authors:
Hari Krishna Hari Prasad,
Ross L. Hatton,
Kaushik Jayaram
Abstract:
Miniature-legged robots are constrained by their onboard computation and control, thus motivating the need for simple, first-principles-based geometric models that connect \emph{periodic actuation or gaits} (a universal robot control paradigm) to the induced average locomotion. In this paper, we develop a \emph{modulable two-beat gait design framework} for sprawled planar quadrupedal systems under…
▽ More
Miniature-legged robots are constrained by their onboard computation and control, thus motivating the need for simple, first-principles-based geometric models that connect \emph{periodic actuation or gaits} (a universal robot control paradigm) to the induced average locomotion. In this paper, we develop a \emph{modulable two-beat gait design framework} for sprawled planar quadrupedal systems under the no-slip using tools from geometric mechanics. We reduce standard two-beat gaits into unique subgaits in mutually exclusive shape subspaces. Subgaits are characterized by a locomotive stance phase when limbs are in ground contact and a non-locomotive, instantaneous swing phase where the limbs are reset without contact. During the stance phase, the contacting limbs form a four-bar mechanism. To analyze the ensuing locomotion, we develop the following tools: (a) a vector field to generate nonslip actuation, (b) the kinematics of a four-bar mechanism as a local connection, and (c) stratified panels that combine the kinematics and constrained actuation to encode the net change in the system's position generated by a stance-swing subgait cycle. Decoupled subgaits are then designed independently using flows on the shape-change basis and are combined with appropriate phasing to produce a two-beat gait. Further, we introduce ``scaling" and ``sliding" control inputs to continuously modulate the global trajectories of the quadrupedal system in gait time through which we demonstrate cycle-average speed, direction, and steering control using the control inputs. Thus, this framework has the potential to create uncomplicated open-loop gait plans or gain schedules for robots with limited resources, bringing them closer to achieving autonomous control.
△ Less
Submitted 2 July, 2024; v1 submitted 28 August, 2023;
originally announced August 2023.
-
Geometric Mechanics of Contact-Switching Systems
Authors:
Hari Krishna Hari Prasad,
Ross L. Hatton,
Kaushik Jayaram
Abstract:
Discrete and periodic contact switching is a key characteristic of steady-state legged locomotion. This paper introduces a framework for modeling and analyzing this contact-switching behavior through the framework of geometric mechanics on a toy robot model that can make continuous limb swings and discrete contact switches. The kinematics of this model form a hybrid shape-space and by extending th…
▽ More
Discrete and periodic contact switching is a key characteristic of steady-state legged locomotion. This paper introduces a framework for modeling and analyzing this contact-switching behavior through the framework of geometric mechanics on a toy robot model that can make continuous limb swings and discrete contact switches. The kinematics of this model form a hybrid shape-space and by extending the generalized Stokes' theorem to compute discrete curvature functions called \textit{stratified panels}, we determine average locomotion generated by gaits spanning multiple contact modes. Using this tool, we also demonstrate the ability to optimize gaits based on the system's locomotion constraints and perform gait reduction on a complex gait spanning multiple contact modes to highlight the method's scalability to multilegged systems.
△ Less
Submitted 20 October, 2023; v1 submitted 17 June, 2023;
originally announced June 2023.
-
HISSbot: Sidewinding with a Soft Snake Robot
Authors:
Farhan Rozaidi,
Emma Waters,
Olivia Dawes,
Jennifer Yang,
Joseph R. Davidson,
Ross L. Hatton
Abstract:
Snake robots are characterized by their ability to navigate through small spaces and loose terrain by utilizing efficient cyclic forms of locomotion. Soft snake robots are a subset of these robots which utilize soft, compliant actuators to produce movement. Prior work on soft snake robots has primarily focused on planar gaits, such as undulation. More efficient spatial gaits, such as sidewinding,…
▽ More
Snake robots are characterized by their ability to navigate through small spaces and loose terrain by utilizing efficient cyclic forms of locomotion. Soft snake robots are a subset of these robots which utilize soft, compliant actuators to produce movement. Prior work on soft snake robots has primarily focused on planar gaits, such as undulation. More efficient spatial gaits, such as sidewinding, are unexplored gaits for soft snake robots. We propose a novel means of constructing a soft snake robot capable of sidewinding, and introduce the Helical Inflating Soft Snake Robot (HISSbot). We validate this actuation through the physical HISSbot, and demonstrate its ability to sidewind across various surfaces. Our tests show robustness in locomotion through low-friction and granular media.
△ Less
Submitted 28 March, 2023;
originally announced March 2023.
-
Linear Kinematics for General Constant Curvature and Torsion Manipulators
Authors:
Bill Fan,
Farhan Rozaidi,
Capprin Bass,
Gina Olson,
Melinda Malley,
Ross L Hatton
Abstract:
We present a novel general model that unifies the kinematics of constant curvature and constant twist continuum manipulators. Combining this kinematics with energy-based physics, we derive a linear mapping from actuator configuration to manipulator deformation that is analogous to traditional robot forward kinematics. Our model generalizes across manipulators with different sizes, types of bending…
▽ More
We present a novel general model that unifies the kinematics of constant curvature and constant twist continuum manipulators. Combining this kinematics with energy-based physics, we derive a linear mapping from actuator configuration to manipulator deformation that is analogous to traditional robot forward kinematics. Our model generalizes across manipulators with different sizes, types of bending, and types of actuators, without the need for parameter re-fitting. The combination of generality and linearity makes the model useful for control and planning algorithms. Finally, our model is shown to be accurate through experimental validation on manipulators with pneumatic artificial muscles.
△ Less
Submitted 22 February, 2023;
originally announced February 2023.
-
Optimal Gait Families using Lagrange Multiplier Method
Authors:
Jinwoo Choi,
Capprin Bass,
Ross L. Hatton
Abstract:
The robotic locomotion community is interested in optimal gaits for control. Based on the optimization criterion, however, there could be a number of possible optimal gaits. For example, the optimal gait for maximizing displacement with respect to cost is quite different from the maximum displacement optimal gait. Beyond these two general optimal gaits, we believe that the optimal gait should deal…
▽ More
The robotic locomotion community is interested in optimal gaits for control. Based on the optimization criterion, however, there could be a number of possible optimal gaits. For example, the optimal gait for maximizing displacement with respect to cost is quite different from the maximum displacement optimal gait. Beyond these two general optimal gaits, we believe that the optimal gait should deal with various situations for high-resolution of motion planning, e.g., steering the robot or moving in "baby steps." As the step size or steering ratio increases or decreases, the optimal gaits will slightly vary by the geometric relationship and they will form the families of gaits. In this paper, we explored the geometrical framework across these optimal gaits having different step sizes in the family via the Lagrange multiplier method. Based on the structure, we suggest an optimal locus generator that solves all related optimal gaits in the family instead of optimizing each gait respectively. By applying the optimal locus generator to two simplified swimmers in drag-dominated environments, we verify the behavior of the optimal locus generator.
△ Less
Submitted 7 October, 2022;
originally announced October 2022.
-
Optimizing Bipedal Maneuvers of Single Rigid-Body Models for Reinforcement Learning
Authors:
Ryan Batke,
Fangzhou Yu,
Jeremy Dao,
Jonathan Hurst,
Ross L. Hatton,
Alan Fern,
Kevin Green
Abstract:
In this work, we propose a method to generate reduced-order model reference trajectories for general classes of highly dynamic maneuvers for bipedal robots for use in sim-to-real reinforcement learning. Our approach is to utilize a single rigid-body model (SRBM) to optimize libraries of trajectories offline to be used as expert references in the reward function of a learned policy. This method tra…
▽ More
In this work, we propose a method to generate reduced-order model reference trajectories for general classes of highly dynamic maneuvers for bipedal robots for use in sim-to-real reinforcement learning. Our approach is to utilize a single rigid-body model (SRBM) to optimize libraries of trajectories offline to be used as expert references in the reward function of a learned policy. This method translates the model's dynamically rich rotational and translational behaviour to a full-order robot model and successfully transfers to real hardware. The SRBM's simplicity allows for fast iteration and refinement of behaviors, while the robustness of learning-based controllers allows for highly dynamic motions to be transferred to hardware. % Within this work we introduce a set of transferability constraints that amend the SRBM dynamics to actual bipedal robot hardware, our framework for creating optimal trajectories for dynamic stepping, turning maneuvers and jumps as well as our approach to integrating reference trajectories to a reinforcement learning policy. Within this work we introduce a set of transferability constraints that amend the SRBM dynamics to actual bipedal robot hardware, our framework for creating optimal trajectories for a variety of highly dynamic maneuvers as well as our approach to integrating reference trajectories for a high-speed running reinforcement learning policy. We validate our methods on the bipedal robot Cassie on which we were successfully able to demonstrate highly dynamic grounded running gaits up to 3.0 m/s.
△ Less
Submitted 8 July, 2022;
originally announced July 2022.
-
Motion Planning for Agile Legged Locomotion using Failure Margin Constraints
Authors:
Kevin Green,
John Warila,
Ross L. Hatton,
Jonathan Hurst
Abstract:
The complex dynamics of agile robotic legged locomotion requires motion planning to intelligently adjust footstep locations. Often, bipedal footstep and motion planning use mathematically simple models such as the linear inverted pendulum, instead of dynamically-rich models that do not have closed-form solutions. We propose a real-time optimization method to plan for dynamical models that do not h…
▽ More
The complex dynamics of agile robotic legged locomotion requires motion planning to intelligently adjust footstep locations. Often, bipedal footstep and motion planning use mathematically simple models such as the linear inverted pendulum, instead of dynamically-rich models that do not have closed-form solutions. We propose a real-time optimization method to plan for dynamical models that do not have closed form solutions and experience irrecoverable failure. Our method uses a data-driven approximation of the step-to-step dynamics and of a failure margin function. This failure margin function is an oriented distance function in state-action space where it describes the signed distance to success or failure. The motion planning problem is formed as a nonlinear program with constraints that enforce the approximated forward dynamics and the validity of state-action pairs. For illustration, this method is applied to create a planner for an actuated spring-loaded inverted pendulum model. In an ablation study, the failure margin constraints decreased the number of invalid solutions by between 24 and 47 percentage points across different objectives and horizon lengths. While we demonstrate the method on a canonical model of locomotion, we also discuss how this can be applied to data-driven models and full-order robot models.
△ Less
Submitted 28 March, 2022;
originally announced March 2022.
-
Scales and Locomotion: Non-Reversible Longitudinal Drag
Authors:
Quinten Konyn,
Ross L. Hatton
Abstract:
Locomotion requires that an animal or robot be able to move itself forward farther than it moves backward in each gait cycle (formally, that it be able to break the symmetry of its interactions with the world). Previous work has established that a difference between lateral and longitudinal drag provides sufficient conditions for locomotion to be possible. The geometric mechanics community has use…
▽ More
Locomotion requires that an animal or robot be able to move itself forward farther than it moves backward in each gait cycle (formally, that it be able to break the symmetry of its interactions with the world). Previous work has established that a difference between lateral and longitudinal drag provides sufficient conditions for locomotion to be possible. The geometric mechanics community has used this principle to build a geometric framework for describing the effectiveness and efficiency of undulatory locomotion. Researchers in biology and robotics have observed that structures such as snake scales additionally provide a difference between forward and backward longitudinal drag. As yet, however, the impact of scales on the geometric features relevant to locomotion effectiveness and efficiency have not yet been explored. We present a geometric model for a single-joint undulating system with scales and identify the features needed to understand its motion. Mathematically, the scales can be treated as inducing a "Finsler metric" on the configuration space, and this paper lays the groundwork for further research into application of such Finsler metrics to robotic locomotion.
△ Less
Submitted 24 February, 2022;
originally announced February 2022.
-
Data-Driven Geometric System Identification for Shape-Underactuated Dissipative Systems
Authors:
Brian Bittner,
Ross L. Hatton,
Shai Revzen
Abstract:
Systems whose movement is highly dissipative provide an opportunity to both identify models easily and quickly optimize motions. Geometric mechanics provides means for reduction of the dynamics by environmental homogeneity, while the dissipative nature minimizes the role of second order (inertial) features in the dynamics. Here we extend the tools of geometric system identification to ``Shape-Unde…
▽ More
Systems whose movement is highly dissipative provide an opportunity to both identify models easily and quickly optimize motions. Geometric mechanics provides means for reduction of the dynamics by environmental homogeneity, while the dissipative nature minimizes the role of second order (inertial) features in the dynamics. Here we extend the tools of geometric system identification to ``Shape-Underactuated Dissipative Systems (SUDS)'' -- systems whose motions are more dissipative than inertial, but whose actuation is restricted to a subset of the body shape coordinates.
Many animal motions are SUDS, including micro-swimmers such as nematodes and flagellated bacteria, and granular locomotors such as snakes and lizards. Many soft robots are also SUDS, particularly those robots using highly damped series elastic actuators. Whether involved in locomotion or manipulation, these robots are often used to interface less rigidly with the environment.
We motivate the use of SUDS models, and validate their ability to predict motion of a variety of simulated viscous swimming platforms. For a large class of SUDS, we show how the shape velocity actuation inputs can be directly converted into torque inputs suggesting that systems with soft pneumatic actuators or dielectric elastomers can be modeled with the tools presented. Based on fundamental assumptions in the physics, we show how our model complexity scales linearly with the number of passive shape coordinates. This offers a large reduction on the number of trials needed to identify the system model from experimental data, and may reduce overfitting. The sample efficiency of our method suggests its use in modeling, control, and optimization in robotics, and as a tool for the study of organismal motion in friction dominated regimes.
△ Less
Submitted 28 August, 2021; v1 submitted 20 December, 2020;
originally announced December 2020.
-
Learning Spring Mass Locomotion: Guiding Policies with a Reduced-Order Model
Authors:
Kevin Green,
Yesh Godse,
Jeremy Dao,
Ross L. Hatton,
Alan Fern,
Jonathan Hurst
Abstract:
In this paper, we describe an approach to achieve dynamic legged locomotion on physical robots which combines existing methods for control with reinforcement learning. Specifically, our goal is a control hierarchy in which highest-level behaviors are planned through reduced-order models, which describe the fundamental physics of legged locomotion, and lower level controllers utilize a learned poli…
▽ More
In this paper, we describe an approach to achieve dynamic legged locomotion on physical robots which combines existing methods for control with reinforcement learning. Specifically, our goal is a control hierarchy in which highest-level behaviors are planned through reduced-order models, which describe the fundamental physics of legged locomotion, and lower level controllers utilize a learned policy that can bridge the gap between the idealized, simple model and the complex, full order robot. The high-level planner can use a model of the environment and be task specific, while the low-level learned controller can execute a wide range of motions so that it applies to many different tasks. In this letter we describe this learned dynamic walking controller and show that a range of walking motions from reduced-order models can be used as the command and primary training signal for learned policies. The resulting policies do not attempt to naively track the motion (as a traditional trajectory tracking controller would) but instead balance immediate motion tracking with long term stability. The resulting controller is demonstrated on a human scale, unconstrained, untethered bipedal robot at speeds up to 1.2 m/s. This letter builds the foundation of a generic, dynamic learned walking controller that can be applied to many different tasks.
△ Less
Submitted 11 March, 2021; v1 submitted 21 October, 2020;
originally announced October 2020.
-
Planning for the Unexpected: Explicitly Optimizing Motions for Ground Uncertainty in Running
Authors:
Kevin Green,
Ross L. Hatton,
Jonathan Hurst
Abstract:
We propose a method to generate actuation plans for a reduced order, dynamic model of bipedal running. This method explicitly enforces robustness to ground uncertainty. The plan generated is not a fixed body trajectory that is aggressively stabilized: instead, the plan interacts with the passive dynamics of the reduced order model to create emergent robustness. The goal is to create plans for legg…
▽ More
We propose a method to generate actuation plans for a reduced order, dynamic model of bipedal running. This method explicitly enforces robustness to ground uncertainty. The plan generated is not a fixed body trajectory that is aggressively stabilized: instead, the plan interacts with the passive dynamics of the reduced order model to create emergent robustness. The goal is to create plans for legged robots that will be robust to imperfect perception of the environment, and to work with dynamics that are too complex to optimize in real-time. Working within this dynamic model of legged locomotion, we optimize a set of disturbance cases together with the nominal case, all with linked inputs. The input linking is nontrivial due to the hybrid dynamics of the running model but our solution is effective and has analytical gradients. The optimization procedure proposed is significantly slower than a standard trajectory optimization, but results in robust gaits that reject disturbances extremely effectively without any replanning required.
△ Less
Submitted 28 January, 2020;
originally announced January 2020.
-
Defect patterns and software metric correlations in a mature ubiquitous system
Authors:
Tim Hopkins,
Les Hatton
Abstract:
Software engineering is not an empirically based discipline. Consequently, many of its practices are based on little more than a generally agreed feeling that something may be true. Part of the problem is that it is both relatively young and unusually rich in new and often competing methodologies. As a result, there is little time to infer important empirical patterns of behaviour before the techn…
▽ More
Software engineering is not an empirically based discipline. Consequently, many of its practices are based on little more than a generally agreed feeling that something may be true. Part of the problem is that it is both relatively young and unusually rich in new and often competing methodologies. As a result, there is little time to infer important empirical patterns of behaviour before the technology moves on. Very occasionally an opportunity arises to study the defect growth and patterns in a well-specified software system which is also well-documented and heavily-used over a very long period.
Here we analyse the defect growth and structural patterns in just such a system, a numerical library written in Fortran evolving over a period of 30 years. This is important to the wider community for two reasons. First, the results cast significant doubt on widely-held long standing language-independent beliefs and second, some of these beliefs are perpetuated in modern technologies. It therefore makes good sense to use empirical long-term data as it becomes available to re-calibrate those generalisations. Finally, we analyse the phenomenon of defect clustering providing further empirical support for its existence.
△ Less
Submitted 6 December, 2019;
originally announced December 2019.
-
Information Theory and the Length Distribution of all Discrete Systems
Authors:
Les Hatton,
Gregory Warr
Abstract:
We begin with the extraordinary observation that the length distribution of 80 million proteins in UniProt, the Universal Protein Resource, measured in amino acids, is qualitatively identical to the length distribution of large collections of computer functions measured in programming language tokens, at all scales. That two such disparate discrete systems share important structural properties sug…
▽ More
We begin with the extraordinary observation that the length distribution of 80 million proteins in UniProt, the Universal Protein Resource, measured in amino acids, is qualitatively identical to the length distribution of large collections of computer functions measured in programming language tokens, at all scales. That two such disparate discrete systems share important structural properties suggests that yet other apparently unrelated discrete systems might share the same properties, and certainly invites an explanation.
We demonstrate that this is inevitable for all discrete systems of components built from tokens or symbols. Departing from existing work by embedding the Conservation of Hartley-Shannon information (CoHSI) in a classical statistical mechanics framework, we identify two kinds of discrete system, heterogeneous and homogeneous. Heterogeneous systems contain components built from a unique alphabet of tokens and yield an implicit CoHSI distribution with a sharp unimodal peak asymptoting to a power-law. Homogeneous systems contain components each built from just one kind of token unique to that component and yield a CoHSI distribution corresponding to Zipf's law.
This theory is applied to heterogeneous systems, (proteome, computer software, music); homogeneous systems (language texts, abundance of the elements); and to systems in which both heterogeneous and homogeneous behaviour co-exist (word frequencies and word length frequencies in language texts). In each case, the predictions of the theory are tested and supported to high levels of statistical significance. We also show that in the same heterogeneous system, different but consistent alphabets must be related by a power-law. We demonstrate this on a large body of music by excluding and including note duration in the definition of the unique alphabet of notes.
△ Less
Submitted 6 September, 2017;
originally announced September 2017.
-
Soap-bubble Optimization of Gaits
Authors:
Suresh Ramasamy,
Ross L. Hatton
Abstract:
In this paper, we present a geometric variational algorithm for optimizing the gaits of kinematic locomoting systems. The dynamics of this algorithm are analogous to the physics of a soap bubble, with the system's Lie bracket supplying an "inflation pressure" that is balanced by a "surface tension" term derived from a Riemannian metric on the system's shape space. We demonstrate this optimizer on…
▽ More
In this paper, we present a geometric variational algorithm for optimizing the gaits of kinematic locomoting systems. The dynamics of this algorithm are analogous to the physics of a soap bubble, with the system's Lie bracket supplying an "inflation pressure" that is balanced by a "surface tension" term derived from a Riemannian metric on the system's shape space. We demonstrate this optimizer on a variety of system geometries (including Purcell's swimmer) and for optimization criteria that include maximizing displacement and efficiency of motion for both translation and turning motions.
△ Less
Submitted 25 October, 2016; v1 submitted 8 September, 2016;
originally announced September 2016.
-
A review on locomotion robophysics: the study of movement at the intersection of robotics, soft matter and dynamical systems
Authors:
Jeffrey Aguilar,
Tingnan Zhang,
Feifei Qian,
Mark Kingsbury,
Benjamin McInroe,
Nicole Mazouchova,
Chen Li,
Ryan Maladen,
Chaohui Gong,
Matt Travers,
Ross L. Hatton,
Howie Choset,
Paul B. Umbanhowar,
Daniel I. Goldman
Abstract:
In this review we argue for the creation of a physics of moving systems -- a locomotion "robophysics" -- which we define as the pursuit of the discovery of principles of self generated motion. Robophysics can provide an important intellectual complement to the discipline of robotics, largely the domain of researchers from engineering and computer science. The essential idea is that we must complem…
▽ More
In this review we argue for the creation of a physics of moving systems -- a locomotion "robophysics" -- which we define as the pursuit of the discovery of principles of self generated motion. Robophysics can provide an important intellectual complement to the discipline of robotics, largely the domain of researchers from engineering and computer science. The essential idea is that we must complement study of complex robots in complex situations with systematic study of simplified robophysical devices in controlled laboratory settings and simplified theoretical models. We must thus use the methods of physics to examine successful and failed locomotion in simplified (abstracted) devices using parameter space exploration, systematic control, and techniques from dynamical systems. Using examples from our and other's research, we will discuss how such robophysical studies have begun to aid engineers in the creation of devices that begin to achieve life-like locomotor abilities on and within complex environments, have inspired interesting physics questions in low dimensional dynamical systems, geometric mechanics and soft matter physics, and have been useful to develop models for biological locomotion in complex terrain. The rapidly decreasing cost of constructing sophisticated robot models with easy access to significant computational power bodes well for scientists and engineers to engage in a discipline which can readily integrate experiment, theory and computation.
△ Less
Submitted 12 February, 2016;
originally announced February 2016.
-
Power-laws and the Conservation of Information in discrete token systems: Part 2 The role of defect
Authors:
Les Hatton
Abstract:
In a matching paper (arXiv:1207.5027), I proved that Conservation of Size and Information in a discrete token based system is overwhelmingly likely to lead to a power-law component size distribution with respect to the size of its unique alphabet. This was substantiated to a very high level of significance using some 55 million lines of source code of mixed provenance. The principle was also appli…
▽ More
In a matching paper (arXiv:1207.5027), I proved that Conservation of Size and Information in a discrete token based system is overwhelmingly likely to lead to a power-law component size distribution with respect to the size of its unique alphabet. This was substantiated to a very high level of significance using some 55 million lines of source code of mixed provenance. The principle was also applied to show that average gene length should be constant in an animal kingdom where the same constraints appear to hold, the implication being that Conservation of Information plays a similar role in discrete token-based systems as the Conservation of Energy does in physical systems.
In this part 2, the role of defect will be explored and a functional behaviour for defect derived to be consistent with the power-law behaviour substantiated above.
This will be supported by further experimental data and the implications explored.
△ Less
Submitted 7 September, 2012;
originally announced September 2012.
-
Power-Laws and the Conservation of Information in discrete token systems: Part 1 General Theory
Authors:
Les Hatton
Abstract:
The Conservation of Energy plays a pivotal part in the development of the physical sciences. With the growth of computation and the study of other discrete token based systems such as the genome, it is useful to ask if there are conservation principles which apply to such systems and what kind of functional behaviour they imply for such systems.
Here I propose that the Conservation of Hartley-Sh…
▽ More
The Conservation of Energy plays a pivotal part in the development of the physical sciences. With the growth of computation and the study of other discrete token based systems such as the genome, it is useful to ask if there are conservation principles which apply to such systems and what kind of functional behaviour they imply for such systems.
Here I propose that the Conservation of Hartley-Shannon Information plays the same over-arching role in discrete token based systems as the Conservation of Energy does in physical systems. I will go on to prove that this implies power-law behaviour in component sizes in software systems no matter what they do or how they were built, and also implies the constancy of average gene length in biological systems as reported for example by Lin Xu et al (10.1093/molbev/msk019).
These propositions are supported by very large amounts of experimental data extending the first presentation of these ideas in Hatton (2011, IFIP / SIAM / NIST Working Conference on Uncertainty Quantification in Scientific Computing, Boulder, August 2011).
△ Less
Submitted 20 July, 2012;
originally announced July 2012.
