-
Nudged Particle Filter with Optimal Resampling Applied to the Duffing Oscillator
Authors:
Ryne Beeson,
Uwe Hanebeck
Abstract:
Efficiently solving the continuous-time signal and discrete-time observation filtering problem for chaotic dynamical systems presents unique challenges in that the advected distribution between observations may encounter a separatrix structure that results in the prior distribution being far from the observation or the distribution may become split into multiple disjoint components. In an attempt…
▽ More
Efficiently solving the continuous-time signal and discrete-time observation filtering problem for chaotic dynamical systems presents unique challenges in that the advected distribution between observations may encounter a separatrix structure that results in the prior distribution being far from the observation or the distribution may become split into multiple disjoint components. In an attempt to sense and overcome these dynamical issues, as well as approximate a non-Gaussian distribution, a nudged particle filtering approach has been introduced. In the nudged particle filter method a control term is added, but has the potential drawback of degenerating the weights of the particles. To counter this issue, we introduce an intermediate resampling approach based on the modified Cramér-von Mises distance. The new method is applied to a challenging scenario of the non-chaotic, unforced nonlinear Duffing oscillator, which possesses a separatrix structure. Our results show that it consistently outperforms the standard particle filter with resampling and original nudged particle filter.
△ Less
Submitted 18 March, 2025;
originally announced April 2025.
-
Aligning Diffusion Model with Problem Constraints for Trajectory Optimization
Authors:
Anjian Li,
Ryne Beeson
Abstract:
Diffusion models have recently emerged as effective generative frameworks for trajectory optimization, capable of producing high-quality and diverse solutions. However, training these models in a purely data-driven manner without explicit incorporation of constraint information often leads to violations of critical constraints, such as goal-reaching, collision avoidance, and adherence to system dy…
▽ More
Diffusion models have recently emerged as effective generative frameworks for trajectory optimization, capable of producing high-quality and diverse solutions. However, training these models in a purely data-driven manner without explicit incorporation of constraint information often leads to violations of critical constraints, such as goal-reaching, collision avoidance, and adherence to system dynamics. To address this limitation, we propose a novel approach that aligns diffusion models explicitly with problem-specific constraints, drawing insights from the Dynamic Data-driven Application Systems (DDDAS) framework. Our approach introduces a hybrid loss function that explicitly measures and penalizes constraint violations during training. Furthermore, by statistically analyzing how constraint violations evolve throughout the diffusion steps, we develop a re-weighting strategy that aligns predicted violations to ground truth statistics at each diffusion step. Evaluated on a tabletop manipulation and a two-car reach-avoid problem, our constraint-aligned diffusion model significantly reduces constraint violations compared to traditional diffusion models, while maintaining the quality of trajectory solutions. This approach is well-suited for integration into the DDDAS framework for efficient online trajectory adaptation as new environmental data becomes available.
△ Less
Submitted 31 March, 2025;
originally announced April 2025.
-
Predictive Planner for Autonomous Driving with Consistency Models
Authors:
Anjian Li,
Sangjae Bae,
David Isele,
Ryne Beeson,
Faizan M. Tariq
Abstract:
Trajectory prediction and planning are essential for autonomous vehicles to navigate safely and efficiently in dynamic environments. Traditional approaches often treat them separately, limiting the ability for interactive planning. While recent diffusion-based generative models have shown promise in multi-agent trajectory generation, their slow sampling is less suitable for high-frequency planning…
▽ More
Trajectory prediction and planning are essential for autonomous vehicles to navigate safely and efficiently in dynamic environments. Traditional approaches often treat them separately, limiting the ability for interactive planning. While recent diffusion-based generative models have shown promise in multi-agent trajectory generation, their slow sampling is less suitable for high-frequency planning tasks. In this paper, we leverage the consistency model to build a predictive planner that samples from a joint distribution of ego and surrounding agents, conditioned on the ego vehicle's navigational goal. Trained on real-world human driving datasets, our consistency model generates higher-quality trajectories with fewer sampling steps than standard diffusion models, making it more suitable for real-time deployment. To enforce multiple planning constraints simultaneously on the ego trajectory, a novel online guided sampling approach inspired by the Alternating Direction Method of Multipliers (ADMM) is introduced. Evaluated on the Waymo Open Motion Dataset (WOMD), our method enables proactive behavior such as nudging and yielding, and also demonstrates smoother, safer, and more efficient trajectories and satisfaction of multiple constraints under a limited computational budget.
△ Less
Submitted 2 May, 2025; v1 submitted 11 February, 2025;
originally announced February 2025.
-
Global Search for Optimal Low Thrust Spacecraft Trajectories using Diffusion Models and the Indirect Method
Authors:
Jannik Graebner,
Ryne Beeson
Abstract:
Long time-duration low-thrust nonlinear optimal spacecraft trajectory global search is a computationally and time expensive problem characterized by clustering patterns in locally optimal solutions. During preliminary mission design, mission parameters are subject to frequent changes, necessitating that trajectory designers efficiently generate high-quality control solutions for these new scenario…
▽ More
Long time-duration low-thrust nonlinear optimal spacecraft trajectory global search is a computationally and time expensive problem characterized by clustering patterns in locally optimal solutions. During preliminary mission design, mission parameters are subject to frequent changes, necessitating that trajectory designers efficiently generate high-quality control solutions for these new scenarios. Generative machine learning models can be trained to learn how the solution structure varies with respect to a conditional parameter, thereby accelerating the global search for missions with updated parameters. In this work, state-of-the-art diffusion models are integrated with the indirect approach for trajectory optimization within a global search framework. This framework is tested on two low-thrust transfers of different complexity in the circular restricted three-body problem. By generating and analyzing a training data set, we develop mathematical relations and techniques to understand the complex structures in the costate domain of locally optimal solutions for these problems. A diffusion model is trained on this data and successfully accelerates the global search for both problems. The model predicts how the costate solution structure changes, based on the maximum spacecraft thrust magnitude. Warm-starting a numerical solver with diffusion model samples for the costates at the initial time increases the number of solutions generated per minute for problems with unseen thrust magnitudes by one to two orders of magnitude in comparison to samples from a uniform distribution and from an adjoint control transformation.
△ Less
Submitted 12 January, 2025;
originally announced January 2025.
-
Initial Guess Generation for Low-Thrust Trajectory Design with Robustness to Missed-Thrust-Events
Authors:
Amlan Sinha,
Ryne Beeson
Abstract:
The growing interest in cislunar space exploration in recent years has driven an increasing demand for efficient low-thrust missions to key cislunar orbits. These missions, typically possessing long thrust arcs, are particularly susceptible to operational uncertainties such as missed thrust events. Addressing these challenges requires efficient robust trajectory design frameworks during the prelim…
▽ More
The growing interest in cislunar space exploration in recent years has driven an increasing demand for efficient low-thrust missions to key cislunar orbits. These missions, typically possessing long thrust arcs, are particularly susceptible to operational uncertainties such as missed thrust events. Addressing these challenges requires efficient robust trajectory design frameworks during the preliminary mission design phase, where it is necessary to explore the solution space at a rapid cadence under evolving operational constraints. However, existing methods for missed thrust design rely on solving high-dimensional nonlinear programs, where generating effective initial guesses becomes challenging. To enhance computational efficiency, quality, and depth of robustness of solutions from global search, we compare two initial guess strategies: a baseline non-conditional global search, which samples from a static distribution with global support, and a conditional global search, which generates initial guesses conditioned on solutions to problems with less depth of robustness. The conditional search provides a sequential procedure for solving increasingly robust problems. We validate the improvements in the conditional approach using a low-thrust case study for the Lunar Gateway Power and Propulsion Element, where our results demonstrate that it significantly improves convergence rate and solution quality, highlighting its potential in preliminary robust trajectory design.
△ Less
Submitted 11 January, 2025;
originally announced January 2025.
-
Global Search of Optimal Spacecraft Trajectories using Amortization and Deep Generative Models
Authors:
Ryne Beeson,
Anjian Li,
Amlan Sinha
Abstract:
Preliminary spacecraft trajectory optimization is a parameter dependent global search problem that aims to provide a set of solutions that are of high quality and diverse. In the case of numerical solution, it is dependent on the original optimal control problem, the choice of a control transcription, and the behavior of a gradient based numerical solver. In this paper we formulate the parameteriz…
▽ More
Preliminary spacecraft trajectory optimization is a parameter dependent global search problem that aims to provide a set of solutions that are of high quality and diverse. In the case of numerical solution, it is dependent on the original optimal control problem, the choice of a control transcription, and the behavior of a gradient based numerical solver. In this paper we formulate the parameterized global search problem as the task of sampling a conditional probability distribution with support on the neighborhoods of local basins of attraction to the high quality solutions. The conditional distribution is learned and represented using deep generative models that allow for prediction of how the local basins change as parameters vary. The approach is benchmarked on a low thrust spacecraft trajectory optimization problem in the circular restricted three-body problem, showing significant speed-up over a simple multi-start method and vanilla machine learning approaches. The paper also provides an in-depth analysis of the multi-modal funnel structure of a low-thrust spacecraft trajectory optimization problem.
△ Less
Submitted 27 December, 2024;
originally announced December 2024.
-
Learning Optimal Control and Dynamical Structure of Global Trajectory Search Problems with Diffusion Models
Authors:
Jannik Graebner,
Anjian Li,
Amlan Sinha,
Ryne Beeson
Abstract:
Spacecraft trajectory design is a global search problem, where previous work has revealed specific solution structures that can be captured with data-driven methods. This paper explores two global search problems in the circular restricted three-body problem: hybrid cost function of minimum fuel/time-of-flight and transfers to energy-dependent invariant manifolds. These problems display a fundamen…
▽ More
Spacecraft trajectory design is a global search problem, where previous work has revealed specific solution structures that can be captured with data-driven methods. This paper explores two global search problems in the circular restricted three-body problem: hybrid cost function of minimum fuel/time-of-flight and transfers to energy-dependent invariant manifolds. These problems display a fundamental structure either in the optimal control profile or the use of dynamical structures. We build on our prior generative machine learning framework to apply diffusion models to learn the conditional probability distribution of the search problem and analyze the model's capability to capture these structures.
△ Less
Submitted 29 December, 2024; v1 submitted 3 October, 2024;
originally announced October 2024.
-
Algorithmic Considerations for Effective Global Search of Robust Low-Thrust Trajectories
Authors:
Amlan Sinha,
Ryne Beeson
Abstract:
The growing interest in the cislunar domain over the past decade has led to an increasing demand for low-thrust missions to key orbits within this region. These low-thrust missions, typically characterized by long thrust arcs, are highly susceptible to operational disruptions such as unforeseen thruster outages or missed thrust events. Consequently, there is a critical need for efficient trajector…
▽ More
The growing interest in the cislunar domain over the past decade has led to an increasing demand for low-thrust missions to key orbits within this region. These low-thrust missions, typically characterized by long thrust arcs, are highly susceptible to operational disruptions such as unforeseen thruster outages or missed thrust events. Consequently, there is a critical need for efficient trajectory design frameworks which incorporate robustness against such anomalies. In this study, we utilize a robust trajectory design framework to explore the solution space for the Power and Propulsion Element (PPE) module to the Earth-Moon L2 Southern 9:2 Near Rectilinear Halo Orbit. We propose algorithmic enhancements to improve the global search for robust solutions, and present a comprehensive analysis of two approaches: a nonconditional approach which involves a purely random search for robust solutions versus a conditional approach which involves warm-starting the search for robust solutions using the non-robust solutions. Our results indicate that by using non-robust solutions as initial guesses for the robust solutions, it is possible to achieve significant improvements in both the rate of convergence and the robustness of the final solutions.
△ Less
Submitted 6 March, 2025; v1 submitted 30 September, 2024;
originally announced October 2024.
-
Statistical Analysis of the Role of Invariant Manifolds on Robust Trajectories
Authors:
Amlan Sinha,
Ryne Beeson
Abstract:
As low-thrust space missions increase in prevalence, it is becoming increasingly important to design robust trajectories against unforeseen thruster outages or missed thrust events. Accounting for such events is particularly important in multibody systems, such as the cislunar realm, where the dynamics are chaotic and the dynamical flow is constrained by pertinent dynamical structures. Yet the rol…
▽ More
As low-thrust space missions increase in prevalence, it is becoming increasingly important to design robust trajectories against unforeseen thruster outages or missed thrust events. Accounting for such events is particularly important in multibody systems, such as the cislunar realm, where the dynamics are chaotic and the dynamical flow is constrained by pertinent dynamical structures. Yet the role of these dynamical structures in robust trajectory design is unclear. This paper provides the first comprehensive statistical study of robust and non-robust trajectories in relation to the invariant manifolds of resonant orbits in a circular restricted three-body problem. For both the non-robust and robust solutions analyzed in this study, the optimal subset demonstrates a closer alignment with the invariant manifolds, while the overall feasible set frequently exhibits considerable deviations. Robust optimal trajectories shadow the invariant manifolds as closely as the non-robust optimal trajectories, and in some cases, demonstrate closer alignment than the non-robust solutions. By maintaining proximity to these structures, low-thrust solutions are able to efficiently utilize the manifolds to achieve optimality even under operational uncertainties.
△ Less
Submitted 29 September, 2024;
originally announced September 2024.
-
Constraint-Aware Diffusion Models for Trajectory Optimization
Authors:
Anjian Li,
Zihan Ding,
Adji Bousso Dieng,
Ryne Beeson
Abstract:
The diffusion model has shown success in generating high-quality and diverse solutions to trajectory optimization problems. However, diffusion models with neural networks inevitably make prediction errors, which leads to constraint violations such as unmet goals or collisions. This paper presents a novel constraint-aware diffusion model for trajectory optimization. We introduce a novel hybrid loss…
▽ More
The diffusion model has shown success in generating high-quality and diverse solutions to trajectory optimization problems. However, diffusion models with neural networks inevitably make prediction errors, which leads to constraint violations such as unmet goals or collisions. This paper presents a novel constraint-aware diffusion model for trajectory optimization. We introduce a novel hybrid loss function for training that minimizes the constraint violation of diffusion samples compared to the groundtruth while recovering the original data distribution. Our model is demonstrated on tabletop manipulation and two-car reach-avoid problems, outperforming traditional diffusion models in minimizing constraint violations while generating samples close to locally optimal solutions.
△ Less
Submitted 3 June, 2024;
originally announced June 2024.
-
DiffuSolve: Diffusion-based Solver for Non-convex Trajectory Optimization
Authors:
Anjian Li,
Zihan Ding,
Adji Bousso Dieng,
Ryne Beeson
Abstract:
Optimal trajectory design is computationally expensive for nonlinear and high-dimensional dynamical systems. The challenge arises from the non-convex nature of the optimization problem with multiple local optima, which usually requires a global search. Traditional numerical solvers struggle to find diverse solutions efficiently without appropriate initial guesses. In this paper, we introduce Diffu…
▽ More
Optimal trajectory design is computationally expensive for nonlinear and high-dimensional dynamical systems. The challenge arises from the non-convex nature of the optimization problem with multiple local optima, which usually requires a global search. Traditional numerical solvers struggle to find diverse solutions efficiently without appropriate initial guesses. In this paper, we introduce DiffuSolve, a general diffusion model-based solver for non-convex trajectory optimization. An expressive diffusion model is trained on pre-collected locally optimal solutions and efficiently samples initial guesses, which then warm-starts numerical solvers to fine-tune the feasibility and optimality. We also present DiffuSolve+, a novel constrained diffusion model with an additional loss in training that further reduces the problem constraint violations of diffusion samples. Experimental evaluations on three tasks verify the improved robustness, diversity, and a 2$\times$ to 11$\times$ increase in computational efficiency with our proposed method, which generalizes well to trajectory optimization problems of varying challenges.
△ Less
Submitted 3 October, 2024; v1 submitted 21 February, 2024;
originally announced March 2024.
-
Amortized Global Search for Efficient Preliminary Trajectory Design with Deep Generative Models
Authors:
Anjian Li,
Amlan Sinha,
Ryne Beeson
Abstract:
Preliminary trajectory design is a global search problem that seeks multiple qualitatively different solutions to a trajectory optimization problem. Due to its high dimensionality and non-convexity, and the frequent adjustment of problem parameters, the global search becomes computationally demanding. In this paper, we exploit the clustering structure in the solutions and propose an amortized glob…
▽ More
Preliminary trajectory design is a global search problem that seeks multiple qualitatively different solutions to a trajectory optimization problem. Due to its high dimensionality and non-convexity, and the frequent adjustment of problem parameters, the global search becomes computationally demanding. In this paper, we exploit the clustering structure in the solutions and propose an amortized global search (AmorGS) framework. We use deep generative models to predict trajectory solutions that share similar structures with previously solved problems, which accelerates the global search for unseen parameter values. Our method is evaluated using De Jong's 5th function and a low-thrust circular restricted three-body problem.
△ Less
Submitted 7 August, 2023;
originally announced August 2023.
-
Quantitative Convergence of the Filter Solution for Multiple Timescale Nonlinear Systems with Coarse-Grain Correlated Noise
Authors:
Ryne Beeson,
N. Sri Namachchivaya,
Nicolas Perkowski
Abstract:
In this paper we prove a rate of convergence for the continuous time filtering solution of a multiple timescale correlated nonlinear system to a lower dimensional filtering equation in the limit of large timescale separation. Correlation is assumed to occur between the slow signal and observation processes. Convergence is almost sure in the weak topology. An asymptotic expansion of the dual proces…
▽ More
In this paper we prove a rate of convergence for the continuous time filtering solution of a multiple timescale correlated nonlinear system to a lower dimensional filtering equation in the limit of large timescale separation. Correlation is assumed to occur between the slow signal and observation processes. Convergence is almost sure in the weak topology. An asymptotic expansion of the dual process for the solution to the Zakai equation, and probabilistic representation using backward doubly stochastic differential equations is leveraged to prove the result.
△ Less
Submitted 17 January, 2022; v1 submitted 24 November, 2020;
originally announced November 2020.
-
Approximation of the Filter Equation for Multiple Timescale, Correlated, Nonlinear Systems
Authors:
Ryne Beeson,
N. Sri Namachchivaya,
Nicolas Perkowski
Abstract:
This paper considers the approximation of the continuous time filtering equation for the case of a multiple timescale (slow-intermediate, and fast scales) that may have correlation between the slow-intermediate process and the observation process. The signal process is considered fully coupled, taking values in $\mathbb{R^{m}} \times \mathbb{R^{n}}$ and without periodicity assumptions on coefficie…
▽ More
This paper considers the approximation of the continuous time filtering equation for the case of a multiple timescale (slow-intermediate, and fast scales) that may have correlation between the slow-intermediate process and the observation process. The signal process is considered fully coupled, taking values in $\mathbb{R^{m}} \times \mathbb{R^{n}}$ and without periodicity assumptions on coefficients. It is proved that in the weak topology, the solution of the filtering equation converges in probability to a solution of a lower dimensional averaged filtering equation in the limit of large timescale separation. The method of proof uses the perturbed test function approach (method of corrector) to handle the intermediate timescale in showing tightness and characterization of limits. The correctors are solutions of Poisson equations.
△ Less
Submitted 30 October, 2020;
originally announced October 2020.
