Showing 1–11 of 11 results for author: Johnson, J J

Zero-Shot Constrained Motion Planning Transformers Using Learned Sampling Dictionaries

Authors: Jacob J. Johnson, Ahmed H. Qureshi, Michael C. Yip

Abstract: Constrained robot motion planning is a ubiquitous need for robots interacting with everyday environments, but it is a notoriously difficult problem to solve. Many sampled points in a sample-based planner need to be rejected as they fall outside the constraint manifold, or require significant iterative effort to correct. Given this, few solutions exist that present a constraint-satisfying trajector… ▽ More Constrained robot motion planning is a ubiquitous need for robots interacting with everyday environments, but it is a notoriously difficult problem to solve. Many sampled points in a sample-based planner need to be rejected as they fall outside the constraint manifold, or require significant iterative effort to correct. Given this, few solutions exist that present a constraint-satisfying trajectory for robots, in reasonable time and of low path cost. In this work, we present a transformer-based model for motion planning with task space constraints for manipulation systems. Vector Quantized-Motion Planning Transformer (VQ-MPT) is a recent learning-based model that reduces the search space for unconstrained planning for sampling-based motion planners. We propose to adapt a pre-trained VQ-MPT model to reduce the search space for constraint planning without retraining or finetuning the model. We also propose to update the neural network output to move sampling regions closer to the constraint manifold. Our experiments show how VQ-MPT improves planning times and accuracy compared to traditional planners in simulated and real-world environments. Unlike previous learning methods, which require task-related data, our method uses pre-trained neural network models and requires no additional data for training and finetuning the model making this a \textit{one-shot} process. We also tested our method on a physical Franka Panda robot with real-world sensor data, demonstrating the generalizability of our algorithm. We anticipate this approach to be an accessible and broadly useful for transferring learned neural planners to various robotic-environment interaction scenarios. △ Less

Submitted 26 September, 2023; originally announced September 2023.

Learning Sampling Dictionaries for Efficient and Generalizable Robot Motion Planning with Transformers

Authors: Jacob J Johnson, Ahmed H Qureshi, Michael Yip

Abstract: Motion planning is integral to robotics applications such as autonomous driving, surgical robots, and industrial manipulators. Existing planning methods lack scalability to higher-dimensional spaces, while recent learning based planners have shown promise in accelerating sampling-based motion planners (SMP) but lack generalizability to out-of-distribution environments. To address this, we present… ▽ More Motion planning is integral to robotics applications such as autonomous driving, surgical robots, and industrial manipulators. Existing planning methods lack scalability to higher-dimensional spaces, while recent learning based planners have shown promise in accelerating sampling-based motion planners (SMP) but lack generalizability to out-of-distribution environments. To address this, we present a novel approach, Vector Quantized-Motion Planning Transformers (VQ-MPT) that overcomes the key generalization and scaling drawbacks of previous learning-based methods. VQ-MPT consists of two stages. Stage 1 is a Vector Quantized-Variational AutoEncoder model that learns to represent the planning space using a finite number of sampling distributions, and stage 2 is an Auto-Regressive model that constructs a sampling region for SMPs by selecting from the learned sampling distribution sets. By splitting large planning spaces into discrete sets and selectively choosing the sampling regions, our planner pairs well with out-of-the-box SMPs, generating near-optimal paths faster than without VQ-MPT's aid. It is generalizable in that it can be applied to systems of varying complexities, from 2D planar to 14D bi-manual robots with diverse environment representations, including costmaps and point clouds. Trained VQ-MPT models generalize to environments unseen during training and achieve higher success rates than previous methods. △ Less

Submitted 26 September, 2023; v1 submitted 1 June, 2023; originally announced June 2023.

Chance-Constrained Motion Planning using Modeled Distance-to-Collision Functions

Authors: Jacob J. Johnson, Michael C. Yip

Abstract: This paper introduces Chance Constrained Gaussian Process-Motion Planning (CCGP-MP), a motion planning algorithm for robotic systems under motion and state estimate uncertainties. The paper's key idea is to capture the variations in the distance-to-collision measurements caused by the uncertainty in state estimation techniques using a Gaussian Process (GP) model. We formulate the planning problem… ▽ More This paper introduces Chance Constrained Gaussian Process-Motion Planning (CCGP-MP), a motion planning algorithm for robotic systems under motion and state estimate uncertainties. The paper's key idea is to capture the variations in the distance-to-collision measurements caused by the uncertainty in state estimation techniques using a Gaussian Process (GP) model. We formulate the planning problem as a chance constraint problem and propose a deterministic constraint that uses the modeled distance function to verify the chance-constraints. We apply Simplicial Homology Global Optimization (SHGO) approach to find the global minimum of the deterministic constraint function along the trajectory and use the minimum value to verify the chance-constraints. Under this formulation, we can show that the optimization function is smooth under certain conditions and that SHGO converges to the global minimum. Therefore, CCGP-MP will always guarantee that all points on a planned trajectory satisfy the given chance-constraints. The experiments in this paper show that CCGP-MP can generate paths that reduce collisions and meet optimality criteria under motion and state uncertainties. The implementation of our robot models and path planning algorithm can be found on GitHub. △ Less

Submitted 22 July, 2021; originally announced July 2021.

Comments: Paper published in CASE21

Motion Planning Transformers: A Motion Planning Framework for Mobile Robots

Authors: Jacob J. Johnson, Uday S. Kalra, Ankit Bhatia, Linjun Li, Ahmed H. Qureshi, Michael C. Yip

Abstract: Fast and efficient sampling-based motion planning (SMP) is an integral component of many robotic systems, such as autonomous cars. A popular technique to improve the efficiency of these planners is to restrict search space in the planning domain. Existing algorithms define parametric functions to bound the search space, but these do not extend to non-holonomic robotic systems. Recent learning-base… ▽ More Fast and efficient sampling-based motion planning (SMP) is an integral component of many robotic systems, such as autonomous cars. A popular technique to improve the efficiency of these planners is to restrict search space in the planning domain. Existing algorithms define parametric functions to bound the search space, but these do not extend to non-holonomic robotic systems. Recent learning-based methods use a combination of convolutional and fully connected networks to encode the planning space. However, these methods are restricted to fixed map sizes, which are often not realistic in the real world. In this paper, we introduce a transformer-based approach, Motion Planning Transformer, to restrict the search space by learning to discern regions with a valid path from prior data. The model learns not only to restrict search spaces for simple 2D systems but also for non-holonomic robotic systems. We validate our method on various randomly generated environments with different map sizes and plan trajectories for a physical non-holonomic robot. We also provide a ROS2 plugin of our method for the Nav2 planning stack. The results show that our method reduces search space nodes by 2-12 times compared to traditional planners and has better generalizability than recent learning-based planners. △ Less

Submitted 13 November, 2022; v1 submitted 5 June, 2021; originally announced June 2021.

Dynamically Constrained Motion Planning Networks for Non-Holonomic Robots

Authors: Jacob J. Johnson, Linjun Li, Fei Liu, Ahmed H. Qureshi, Michael C. Yip

Abstract: Reliable real-time planning for robots is essential in today's rapidly expanding automated ecosystem. In such environments, traditional methods that plan by relaxing constraints become unreliable or slow-down for kinematically constrained robots. This paper describes the algorithm Dynamic Motion Planning Networks (Dynamic MPNet), an extension to Motion Planning Networks, for non-holonomic robots t… ▽ More Reliable real-time planning for robots is essential in today's rapidly expanding automated ecosystem. In such environments, traditional methods that plan by relaxing constraints become unreliable or slow-down for kinematically constrained robots. This paper describes the algorithm Dynamic Motion Planning Networks (Dynamic MPNet), an extension to Motion Planning Networks, for non-holonomic robots that address the challenge of real-time motion planning using a neural planning approach. We propose modifications to the training and planning networks that make it possible for real-time planning while improving the data efficiency of training and trained models' generalizability. We evaluate our model in simulation for planning tasks for a non-holonomic robot. We also demonstrate experimental results for an indoor navigation task using a Dubins car. △ Less

Submitted 12 August, 2020; originally announced August 2020.

Comments: Accepted for IROS 2020

Composing Task-Agnostic Policies with Deep Reinforcement Learning

Authors: Ahmed H. Qureshi, Jacob J. Johnson, Yuzhe Qin, Taylor Henderson, Byron Boots, Michael C. Yip

Abstract: The composition of elementary behaviors to solve challenging transfer learning problems is one of the key elements in building intelligent machines. To date, there has been plenty of work on learning task-specific policies or skills but almost no focus on composing necessary, task-agnostic skills to find a solution to new problems. In this paper, we propose a novel deep reinforcement learning-base… ▽ More The composition of elementary behaviors to solve challenging transfer learning problems is one of the key elements in building intelligent machines. To date, there has been plenty of work on learning task-specific policies or skills but almost no focus on composing necessary, task-agnostic skills to find a solution to new problems. In this paper, we propose a novel deep reinforcement learning-based skill transfer and composition method that takes the agent's primitive policies to solve unseen tasks. We evaluate our method in difficult cases where training policy through standard reinforcement learning (RL) or even hierarchical RL is either not feasible or exhibits high sample complexity. We show that our method not only transfers skills to new problem settings but also solves the challenging environments requiring both task planning and motion control with high data efficiency. △ Less

Submitted 30 December, 2019; v1 submitted 25 May, 2019; originally announced May 2019.

Comments: ICLR 2020

Infrared Observations of Southern Classical Novae 1991 to 1992

Authors: Thomas E. Harrison, Joni J. Johnson

Abstract: We report on a program to monitor classical novae (CNe) to determine if they produced dust in the ejecta created by their outbursts. Of the ten systems we followed, five produced dust. We also present limited infrared and optical spectroscopy of these objects. We present a complete $JHKLM$ spectrum for V992 Sco. V992 Sco was one of the brightest CNe in the infrared of all time, and our $M$-band sp… ▽ More We report on a program to monitor classical novae (CNe) to determine if they produced dust in the ejecta created by their outbursts. Of the ten systems we followed, five produced dust. We also present limited infrared and optical spectroscopy of these objects. We present a complete $JHKLM$ spectrum for V992 Sco. V992 Sco was one of the brightest CNe in the infrared of all time, and our $M$-band spectrum of this object shows strong emission from the CO fundamental. We believe this to be the first, and only, spectroscopic observation of this feature in a CNe. △ Less

Submitted 29 March, 2018; originally announced March 2018.

Comments: 47 pages, 23 figures

Upconverting Core-Shell Nanocrystals with High Quantum Yield under Low Irradiance: On the Role of Isotropic and Thick Shells

Authors: Stefan Fischer, Noah J. J. Johnson, Jothirmayanantham Pichaandi, Jan Christoph Goldschmidt, Frank C. J. M van Veggel

Abstract: Colloidal upconverter nanocrystals (UCNCs) that convert near-infrared photons to higher energies are promising for applications ranging from life sciences to solar energy harvesting. However, practical applications of UCNCs are hindered by their low upconversion quantum yield (UCQY) and the high irradiances necessary to produce relevant upconversion luminescence. Achieving high UCQY under practica… ▽ More Colloidal upconverter nanocrystals (UCNCs) that convert near-infrared photons to higher energies are promising for applications ranging from life sciences to solar energy harvesting. However, practical applications of UCNCs are hindered by their low upconversion quantum yield (UCQY) and the high irradiances necessary to produce relevant upconversion luminescence. Achieving high UCQY under practically relevant irradiance remains a major challenge. The UCQY is severely limited due to non-radiative surface quenching processes. We present a rate equation model for migration of the excitation energy to show that surface quenching does not only affect the lanthanide ions directly at the surface but also many other lanthanide ions quite far away from the surface. The average migration path length is in the order of several nanometers and depends on the doping as well as the irradiance of the excitation. Using Er3+-doped beta-NaYF4 UCNCs, we show that very isotropic and thick (~10 nm) beta-NaLuF4 inert shells dramatically reduce the surface-related quenching processes, resulting in much brighter upconversion luminescence at simultaneously considerably lower irradiances. For these UCNCs embedded in PMMA, we determined an internal UCQY of 2.0+-0.2 % using an irradiance of only 0.43+-0.03 W/cm2 at 1523 nm. Normalized to the irradiance, this UCQY is 120x higher than the highest values of comparable nanomaterials in the literature. Our findings demonstrate the important role of isotropic and thick shells in achieving high UCQY at low irradiances from UCNCs. Additionally, we measured the additional short-circuit current due to upconversion in silicon solar cell devices as a proof concept and to support our findings determined using optical measurements. △ Less

Submitted 24 November, 2015; v1 submitted 19 July, 2015; originally announced July 2015.

Comments: 12 pages, 6 figures; Supporting Information 13 pages, 8 figures

Journal ref: Journal of Applied Physics, 118, 193105 (2015)

The Supernova that Destroyed a Protogalaxy: Prompt Chemical Enrichment and Supermassive Black Hole Growth

Authors: Daniel J. Whalen, Jarrett J. Johnson, Joseph Smidt, Avery Meiksin, Alexander Heger, Wesley Even, Chris L. Fryer

Abstract: The first primitive galaxies formed from accretion and mergers by z ~ 15, and were primarily responsible for cosmological reionization and the chemical enrichment of the early cosmos. But a few of these galaxies may have formed in the presence of strong Lyman-Werner UV fluxes that sterilized them of H_2, preventing them from forming stars or expelling heavy elements into the IGM prior to assembly.… ▽ More The first primitive galaxies formed from accretion and mergers by z ~ 15, and were primarily responsible for cosmological reionization and the chemical enrichment of the early cosmos. But a few of these galaxies may have formed in the presence of strong Lyman-Werner UV fluxes that sterilized them of H_2, preventing them from forming stars or expelling heavy elements into the IGM prior to assembly. At masses of 10^8 Ms and virial temperatures of 10^4 K, these halos began to rapidly cool by atomic lines, perhaps forming 10^4 - 10^6 Ms Pop III stars and, later, the seeds of supermassive black holes. We have modeled the explosion of a supermassive Pop III star in the dense core of a line-cooled protogalaxy with the ZEUS-MP code. We find that the supernova (SN) expands to a radius of ~ 1 kpc, briefly engulfing the entire galaxy, but then collapses back into the potential well of the dark matter. Fallback fully mixes the interior of the protogalaxy with metals, igniting a violent starburst and fueling the rapid growth of a massive black hole at its center. The starburst would populate the protogalaxy with stars in greater numbers and at higher metallicities than in more slowly-evolving, nearby halos. The SN remnant becomes a strong synchrotron source that can be observed with eVLA and eMERLIN and has a unique signature that easily distinguishes it from less energetic SN remnants. Such explosions, and their attendant starbursts, may well have marked the birthplaces of supermassive black holes on the sky. △ Less

Submitted 9 July, 2013; v1 submitted 29 May, 2013; originally announced May 2013.

Comments: 11 pages, 10 figures, accepted for publication in ApJ

Report number: LA-UR-13-23474

Phase-Resolved Infrared H- and K-band Spectroscopy of EF Eridani

Authors: Thomas E. Harrison, Steve B. Howell, Paula Szkody, Derek Homeier, Joni J. Johnson, Heather L. Osborne

Abstract: We present new phase-resolved H and K-band spectroscopy of the ultra-short period magnetic cataclysmic variable EF Eri in its current, prolonged ``low'' state obtained using NIRI on Gemini-North, and NIRSPEC on Keck II. These new data show that the H-band spectrum of EF Eri appears to be dominated by cyclotron emission during the entire orbital cycle. The {\it K}-band spectrum of EF Eri is likew… ▽ More We present new phase-resolved H and K-band spectroscopy of the ultra-short period magnetic cataclysmic variable EF Eri in its current, prolonged ``low'' state obtained using NIRI on Gemini-North, and NIRSPEC on Keck II. These new data show that the H-band spectrum of EF Eri appears to be dominated by cyclotron emission during the entire orbital cycle. The {\it K}-band spectrum of EF Eri is likewise dominated by cyclotron emission during most of an orbital period, but near binary phase 0.0, the secondary star spectrum may be visible. We conclude that strong, and highly variable cyclotron emission is responsible for the photometric variation previously reported for EF Eri. The nature of this cyclotron emission is complex: the H-band spectra show that the dominant cyclotron harmonic at phase 0.5 peaks at 1.65 $μ$m, but at phase 0.0, the harmonic peaks near 1.72 $μ$m. At phase 0.5, there is another cyclotron feature present that peaks in between the H and K bands (near 1.93 $μ$m), but at phase 0.0, no such feature is present. These data suggest that cyclotron emission from both poles is occurring. △ Less

Submitted 29 September, 2004; originally announced September 2004.

Comments: 23 pages of text, 8 figures

Journal ref: Astrophys.J. 614 (2004) 947-954

Ultraviolet and visible spectropolarimetric variability in P Cygni

Authors: K. H. Nordsieck, J. Wisniewski, B. L. Babler, M. R. Meade, C. M. Anderson, K. S. Bjorkman, A. D. Code, G. K. Fox, J. J. Johnson, A. J. Weitenbeck, N. E. B. Zellner, O. L. Lupie

Abstract: We report on new data, including four vacuum ultraviolet spectropolarimetric observations by the Wisconsin Ultraviolet Photo-Polarimeter Experiment ("WUPPE") on the Astro-1 (one observation) and Astro-2 (three observations) shuttle missions, and 15 new visible-wavelength observations obtained by the HPOL CCD spectropolarimeter at the Pine Bluff Observatory of the University of Wisconsin. This in… ▽ More We report on new data, including four vacuum ultraviolet spectropolarimetric observations by the Wisconsin Ultraviolet Photo-Polarimeter Experiment ("WUPPE") on the Astro-1 (one observation) and Astro-2 (three observations) shuttle missions, and 15 new visible-wavelength observations obtained by the HPOL CCD spectropolarimeter at the Pine Bluff Observatory of the University of Wisconsin. This includes three HPOL observations made within 12 hours of each of the three Astro-2 WUPPE observations, giving essentially simultaneous observations extending from 1500 to 10500 Angstroms. An analysis of these data yields estimates on the properties of wind "clumps" when they are detectable by the polarization of their scattered light. We find that the clumps must be detected near the base of the wind, r/R* = 1.3 - 2.5. At this time the clump density is at least 10^13 cm^-3, 20 times the mean wind, and the temperature is roughly 10,000 K, about 20% cooler than the mean wind. The clumps leading to the largest observed polarization must have electron optical depth of 0.1 - 1 and an angular extent of 0.1 - 1 ster, and account for at most 2% of the wind mass loss. The H and HeI emission lines from the wind are unpolarized, but their P Cygni absorption is enhanced by a factor of 4 in the scattered light. We speculate on the possible relationship of the clumps detected polarimetrically to those seen as Discrete Absorption Features (DACs) and in interferometry. △ Less

Submitted 5 February, 2001; originally announced February 2001.

Comments: 12 pages latex, 7 figures. To appear in "P Cygni 2000 - 400 Years of Progress", a conference held at Armagh, Northern Ireland, 21 -23 Aug, 2000