Showing 1–19 of 19 results for author: Nashed, S

Safety Representations for Safer Policy Learning

Authors: Kaustubh Mani, Vincent Mai, Charlie Gauthier, Annie Chen, Samer Nashed, Liam Paull

Abstract: Reinforcement learning algorithms typically necessitate extensive exploration of the state space to find optimal policies. However, in safety-critical applications, the risks associated with such exploration can lead to catastrophic consequences. Existing safe exploration methods attempt to mitigate this by imposing constraints, which often result in overly conservative behaviours and inefficient… ▽ More Reinforcement learning algorithms typically necessitate extensive exploration of the state space to find optimal policies. However, in safety-critical applications, the risks associated with such exploration can lead to catastrophic consequences. Existing safe exploration methods attempt to mitigate this by imposing constraints, which often result in overly conservative behaviours and inefficient learning. Heavy penalties for early constraint violations can trap agents in local optima, deterring exploration of risky yet high-reward regions of the state space. To address this, we introduce a method that explicitly learns state-conditioned safety representations. By augmenting the state features with these safety representations, our approach naturally encourages safer exploration without being excessively cautious, resulting in more efficient and safer policy learning in safety-critical scenarios. Empirical evaluations across diverse environments show that our method significantly improves task performance while reducing constraint violations during training, underscoring its effectiveness in balancing exploration with safety. △ Less

Submitted 27 February, 2025; originally announced February 2025.

Comments: Accepted at International Conference on Learning Representations (ICLR) 2025

Imaging extended single crystal lattice distortion fields with multi-peak Bragg ptychography

Authors: Saugat Kandel, Siddharth Maddali, Marc Allain, Xiaojing Huang, Youssef S. G. Nashed, Chris Jacobsen, Stephan Hruszkewycz

Abstract: We describe a phase-retrieval-based imaging method to directly spatially resolve the vector lattice distortions in an extended crystalline sample by explicit coupling of independent Bragg ptychography data sets into the reconstruction process. Our method addresses this multi-peak Bragg ptychography (MPBP) inverse problem by explicit gradient descent optimization of an objective function based on m… ▽ More We describe a phase-retrieval-based imaging method to directly spatially resolve the vector lattice distortions in an extended crystalline sample by explicit coupling of independent Bragg ptychography data sets into the reconstruction process. Our method addresses this multi-peak Bragg ptychography (MPBP) inverse problem by explicit gradient descent optimization of an objective function based on modeling of the probe-lattice interaction, along with corrective steps to address spurious reconstruction artifacts. Robust convergence of the optimization process is ensured by computing exact gradients with the automatic differentiation capabilities of high-performance computing software packages. We demonstrate MPBP reconstruction with simulated ptychography data mimicking diffraction from a single crystal membrane containing heterogeneities that manifest as phase discontinuities in the diffracted wave. We show the superior ability of such an optimization-based approach in removing reconstruction artifacts compared to existing phase retrieval and lattice distortion reconstruction approaches. △ Less

Submitted 22 December, 2023; originally announced December 2023.

RL$^3$: Boosting Meta Reinforcement Learning via RL inside RL$^2$

Authors: Abhinav Bhatia, Samer B. Nashed, Shlomo Zilberstein

Abstract: Meta reinforcement learning (meta-RL) methods such as RL$^2$ have emerged as promising approaches for learning data-efficient RL algorithms tailored to a given task distribution. However, they show poor asymptotic performance and struggle with out-of-distribution tasks because they rely on sequence models, such as recurrent neural networks or transformers, to process experiences rather than summar… ▽ More Meta reinforcement learning (meta-RL) methods such as RL$^2$ have emerged as promising approaches for learning data-efficient RL algorithms tailored to a given task distribution. However, they show poor asymptotic performance and struggle with out-of-distribution tasks because they rely on sequence models, such as recurrent neural networks or transformers, to process experiences rather than summarize them using general-purpose RL components such as value functions. In contrast, traditional RL algorithms are data-inefficient as they do not use domain knowledge, but do converge to an optimal policy in the limit. We propose RL$^3$, a principled hybrid approach that incorporates action-values, learned per task via traditional RL, in the inputs to meta-RL. We show that RL$^3$ earns greater cumulative reward in the long term compared to RL$^2$ while drastically reducing meta-training time and generalizes better to out-of-distribution tasks. Experiments are conducted on both custom and benchmark discrete domains from the meta-RL literature that exhibit a range of short-term, long-term, and complex dependencies. △ Less

Submitted 14 December, 2024; v1 submitted 28 June, 2023; originally announced June 2023.

Fairness and Sequential Decision Making: Limits, Lessons, and Opportunities

Authors: Samer B. Nashed, Justin Svegliato, Su Lin Blodgett

Abstract: As automated decision making and decision assistance systems become common in everyday life, research on the prevention or mitigation of potential harms that arise from decisions made by these systems has proliferated. However, various research communities have independently conceptualized these harms, envisioned potential applications, and proposed interventions. The result is a somewhat fracture… ▽ More As automated decision making and decision assistance systems become common in everyday life, research on the prevention or mitigation of potential harms that arise from decisions made by these systems has proliferated. However, various research communities have independently conceptualized these harms, envisioned potential applications, and proposed interventions. The result is a somewhat fractured landscape of literature focused generally on ensuring decision-making algorithms "do the right thing". In this paper, we compare and discuss work across two major subsets of this literature: algorithmic fairness, which focuses primarily on predictive systems, and ethical decision making, which focuses primarily on sequential decision making and planning. We explore how each of these settings has articulated its normative concerns, the viability of different techniques for these different settings, and how ideas from each setting may have utility for the other. △ Less

Submitted 13 January, 2023; originally announced January 2023.

Comments: 10 pages

A differentiable forward model for the concurrent, multi-peak Bragg coherent x-ray diffraction imaging problem

Authors: S. Maddali, T. D. Frazer, N. Delegan, K. J. Harmon, S. E. Sullivan, M. Allain, W. Cha, A. Dibos, I. Poudyal, S. Kandel, Y. S. G. Nashed, F. J. Heremans, H. You, Y. Cao, S. O. Hruszkewycz

Abstract: We present a general analytic approach to spatially resolve the nano-scale lattice distortion field of strained and defected compact crystals with Bragg coherent x-ray diffraction imaging (BCDI). Our approach relies on fitting a differentiable forward model simultaneously to multiple BCDI datasets corresponding to independent Bragg reflections from the same single crystal. It is designed to be fai… ▽ More We present a general analytic approach to spatially resolve the nano-scale lattice distortion field of strained and defected compact crystals with Bragg coherent x-ray diffraction imaging (BCDI). Our approach relies on fitting a differentiable forward model simultaneously to multiple BCDI datasets corresponding to independent Bragg reflections from the same single crystal. It is designed to be faithful to heterogeneities that potentially manifest as phase discontinuities in the coherently diffracted wave, such as lattice dislocations in an imperfect crystal. We retain fidelity to such small features in the reconstruction process through a Fourier transform -based resampling algorithm designed to largely avoid the point spread tendencies of commonly employed interpolation methods. The reconstruction model defined in this manner brings BCDI reconstruction into the scope of explicit optimization driven by automatic differentiation. With results from simulations and experimental diffraction data, we demonstrate significant improvement in the final image quality compared to conventional phase retrieval, enabled by explicitly coupling multiple BCDI datasets into the reconstruction loss function. △ Less

Submitted 1 August, 2022; originally announced August 2022.

Comments: 30 pages, 23 figures

Causal Explanations for Sequential Decision Making Under Uncertainty

Authors: Samer B. Nashed, Saaduddin Mahmud, Claudia V. Goldman, Shlomo Zilberstein

Abstract: We introduce a novel framework for causal explanations of stochastic, sequential decision-making systems built on the well-studied structural causal model paradigm for causal reasoning. This single framework can identify multiple, semantically distinct explanations for agent actions -- something not previously possible. In this paper, we establish exact methods and several approximation techniques… ▽ More We introduce a novel framework for causal explanations of stochastic, sequential decision-making systems built on the well-studied structural causal model paradigm for causal reasoning. This single framework can identify multiple, semantically distinct explanations for agent actions -- something not previously possible. In this paper, we establish exact methods and several approximation techniques for causal inference on Markov decision processes using this framework, followed by results on the applicability of the exact methods and some run time bounds. We discuss several scenarios that illustrate the framework's flexibility and the results of experiments with human subjects that confirm the benefits of this approach. △ Less

Submitted 10 January, 2023; v1 submitted 30 May, 2022; originally announced May 2022.

Comments: 9 pages, 7 figures

End-to-End Simultaneous Learning of Single-particle Orientation and 3D Map Reconstruction from Cryo-electron Microscopy Data

Authors: Youssef S. G. Nashed, Frederic Poitevin, Harshit Gupta, Geoffrey Woollard, Michael Kagan, Chuck Yoon, Daniel Ratner

Abstract: Cryogenic electron microscopy (cryo-EM) provides images from different copies of the same biomolecule in arbitrary orientations. Here, we present an end-to-end unsupervised approach that learns individual particle orientations from cryo-EM data while reconstructing the average 3D map of the biomolecule, starting from a random initialization. The approach relies on an auto-encoder architecture wher… ▽ More Cryogenic electron microscopy (cryo-EM) provides images from different copies of the same biomolecule in arbitrary orientations. Here, we present an end-to-end unsupervised approach that learns individual particle orientations from cryo-EM data while reconstructing the average 3D map of the biomolecule, starting from a random initialization. The approach relies on an auto-encoder architecture where the latent space is explicitly interpreted as orientations used by the decoder to form an image according to the linear projection model. We evaluate our method on simulated data and show that it is able to reconstruct 3D particle maps from noisy- and CTF-corrupted 2D projection images of unknown particle orientations. △ Less

Submitted 6 July, 2021; originally announced July 2021.

Comments: 13 pages, 4 figures

A matrix-free Levenberg-Marquardt algorithm for efficient ptychographic phase retrieval

Authors: Saugat Kandel, S. Maddali, Youssef S G Nashed, Stephan O Hruszkewycz, Chris Jacobsen, Marc Allain

Abstract: The phase retrieval problem, where one aims to recover a complex-valued image from far-field intensity measurements, is a classic problem encountered in a range of imaging applications. Modern phase retrieval approaches usually rely on gradient descent methods in a nonlinear minimization framework. Calculating closed-form gradients for use in these methods is tedious work, and formulating second o… ▽ More The phase retrieval problem, where one aims to recover a complex-valued image from far-field intensity measurements, is a classic problem encountered in a range of imaging applications. Modern phase retrieval approaches usually rely on gradient descent methods in a nonlinear minimization framework. Calculating closed-form gradients for use in these methods is tedious work, and formulating second order derivatives is even more laborious. Additionally, second order techniques often require the storage and inversion of large matrices of partial derivatives, with memory requirements that can be prohibitive for data-rich imaging modalities. We use a reverse-mode automatic differentiation (AD) framework to implement an efficient matrix-free version of the Levenberg-Marquardt (LM) algorithm, a longstanding method that finds popular use in nonlinear least-square minimization problems but which has seen little use in phase retrieval. Furthermore, we extend the basic LM algorithm so that it can be applied for general constrained optimization problems beyond just the least-square applications. Since we use AD, we only need to specify the physics-based forward model for a specific imaging application; the derivative terms are calculated automatically through matrix-vector products, without explicitly forming any large Jacobian or Gauss-Newton matrices. We demonstrate that this algorithm can be used to solve both the unconstrained ptychographic object retrieval problem and the constrained "blind" ptychographic object and probe retrieval problems, under both the Gaussian and Poisson noise models, and that this method outperforms best-in-class first-order ptychographic reconstruction methods: it provides excellent convergence guarantees with (in many cases) a superlinear rate of convergence, all with a computational cost comparable to, or lower than, the tested first-order algorithms. △ Less

Submitted 26 February, 2021; originally announced March 2021.

Laser2Vec: Similarity-based Retrieval for Robotic Perception Data

Authors: Samer B. Nashed

Abstract: As mobile robot capabilities improve and deployment times increase, tools to analyze the growing volume of data are becoming necessary. Current state-of-the-art logging, playback, and exploration systems are insufficient for practitioners seeking to discover systemic points of failure in robotic systems. This paper presents a suite of algorithms for similarity-based queries of robotic perception d… ▽ More As mobile robot capabilities improve and deployment times increase, tools to analyze the growing volume of data are becoming necessary. Current state-of-the-art logging, playback, and exploration systems are insufficient for practitioners seeking to discover systemic points of failure in robotic systems. This paper presents a suite of algorithms for similarity-based queries of robotic perception data and implements a system for storing 2D LiDAR data from many deployments cheaply and evaluating top-k queries for complete or partial scans efficiently. We generate compressed representations of laser scans via a convolutional variational autoencoder and store them in a database, where a light-weight dense network for distance function approximation is run at query time. Our query evaluator leverages the local continuity of the embedding space to generate evaluation orders that, in expectation, dominate full linear scans of the database. The accuracy, robustness, scalability, and efficiency of our system is tested on real-world data gathered from dozens of deployments and synthetic data generated by corrupting real data. We find our system accurately and efficiently identifies similar scans across a number of episodes where the robot encountered the same location, or similar indoor structures or objects. △ Less

Submitted 30 July, 2020; originally announced July 2020.

Comments: 6 pages

ACM Class: I.2.9

Curating Long-term Vector Maps

Authors: Samer Nashed, Joydeep Biswas

Abstract: Autonomous service mobile robots need to consistently, accurately, and robustly localize in human environments despite changes to such environments over time. Episodic non-Markov Localization addresses the challenge of localization in such changing environments by classifying observations as arising from Long-Term, Short-Term, or Dynamic Features. However, in order to do so, EnML relies on an esti… ▽ More Autonomous service mobile robots need to consistently, accurately, and robustly localize in human environments despite changes to such environments over time. Episodic non-Markov Localization addresses the challenge of localization in such changing environments by classifying observations as arising from Long-Term, Short-Term, or Dynamic Features. However, in order to do so, EnML relies on an estimate of the Long-Term Vector Map (LTVM) that does not change over time. In this paper, we introduce a recursive algorithm to build and update the LTVM over time by reasoning about visibility constraints of objects observed over multiple robot deployments. We use a signed distance function (SDF) to filter out observations of short-term and dynamic features from multiple deployments of the robot. The remaining long-term observations are used to build a vector map by robust local linear regression. The uncertainty in the resulting LTVM is computed via Monte Carlo resampling the observations arising from long-term features. By combining occupancy-grid based SDF filtering of observations with continuous space regression of the filtered observations, our proposed approach builds, updates, and amends LTVMs over time, reasoning about all observations from all robot deployments in an environment. We present experimental results demonstrating the accuracy, robustness, and compact nature of the extracted LTVMs from several long-term robot datasets. △ Less

Submitted 30 July, 2020; originally announced July 2020.

Comments: 6 pages

ACM Class: I.2.9

Journal ref: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 4643-4648, 2016, IEEE

Real-time 3D Nanoscale Coherent Imaging via Physics-aware Deep Learning

Authors: Henry Chan, Youssef S. G. Nashed, Saugat Kandel, Stephan Hruszkewycz, Subramanian Sankaranarayanan, Ross J. Harder, Mathew J. Cherukara

Abstract: Phase retrieval, the problem of recovering lost phase information from measured intensity alone, is an inverse problem that is widely faced in various imaging modalities ranging from astronomy to nanoscale imaging. The current process of phase recovery is iterative in nature. As a result, the image formation is time-consuming and computationally expensive, precluding real-time imaging. Here, we us… ▽ More Phase retrieval, the problem of recovering lost phase information from measured intensity alone, is an inverse problem that is widely faced in various imaging modalities ranging from astronomy to nanoscale imaging. The current process of phase recovery is iterative in nature. As a result, the image formation is time-consuming and computationally expensive, precluding real-time imaging. Here, we use 3D nanoscale X-ray imaging as a representative example to develop a deep learning model to address this phase retrieval problem. We introduce 3D-CDI-NN, a deep convolutional neural network and differential programming framework trained to predict 3D structure and strain solely from input 3D X-ray coherent scattering data. Our networks are designed to be "physics-aware" in multiple aspects; in that the physics of x-ray scattering process is explicitly enforced in the training of the network, and the training data are drawn from atomistic simulations that are representative of the physics of the material. We further refine the neural network prediction through a physics-based optimization procedure to enable maximum accuracy at lowest computational cost. 3D-CDI-NN can invert a 3D coherent diffraction pattern to real-space structure and strain hundreds of times faster than traditional iterative phase retrieval methods, with negligible loss in accuracy. Our integrated machine learning and differential programming solution to the phase retrieval problem is broadly applicable across inverse problems in other application areas. △ Less

Submitted 16 June, 2020; originally announced June 2020.

InSituNet: Deep Image Synthesis for Parameter Space Exploration of Ensemble Simulations

Authors: Wenbin He, Junpeng Wang, Hanqi Guo, Ko-Chih Wang, Han-Wei Shen, Mukund Raj, Youssef S. G. Nashed, Tom Peterka

Abstract: We propose InSituNet, a deep learning based surrogate model to support parameter space exploration for ensemble simulations that are visualized in situ. In situ visualization, generating visualizations at simulation time, is becoming prevalent in handling large-scale simulations because of the I/O and storage constraints. However, in situ visualization approaches limit the flexibility of post-hoc… ▽ More We propose InSituNet, a deep learning based surrogate model to support parameter space exploration for ensemble simulations that are visualized in situ. In situ visualization, generating visualizations at simulation time, is becoming prevalent in handling large-scale simulations because of the I/O and storage constraints. However, in situ visualization approaches limit the flexibility of post-hoc exploration because the raw simulation data are no longer available. Although multiple image-based approaches have been proposed to mitigate this limitation, those approaches lack the ability to explore the simulation parameters. Our approach allows flexible exploration of parameter space for large-scale ensemble simulations by taking advantage of the recent advances in deep learning. Specifically, we design InSituNet as a convolutional regression model to learn the mapping from the simulation and visualization parameters to the visualization results. With the trained model, users can generate new images for different simulation parameters under various visualization settings, which enables in-depth analysis of the underlying ensemble simulations. We demonstrate the effectiveness of InSituNet in combustion, cosmology, and ocean simulations through quantitative and qualitative evaluations. △ Less

Submitted 16 October, 2019; v1 submitted 1 August, 2019; originally announced August 2019.

Three dimensions, two microscopes, one code: automatic differentiation for x-ray nanotomography beyond the depth of focus limit

Authors: Ming Du, Youssef S. G. Nashed, Saugat Kandel, Doga Gursoy, Chris Jacobsen

Abstract: Conventional tomographic reconstruction algorithms assume that one has obtained pure projection images, involving no within-specimen diffraction effects nor multiple scattering. Advances in x-ray nanotomography are leading towards the violation of these assumptions, by combining the high penetration power of x-rays which enables thick specimens to be imaged, with improved spatial resolution which… ▽ More Conventional tomographic reconstruction algorithms assume that one has obtained pure projection images, involving no within-specimen diffraction effects nor multiple scattering. Advances in x-ray nanotomography are leading towards the violation of these assumptions, by combining the high penetration power of x-rays which enables thick specimens to be imaged, with improved spatial resolution which decreases the depth of focus of the imaging system. We describe a reconstruction method where multiple scattering and diffraction effects in thick samples are modeled by multislice propagation, and the 3D object function is retrieved through iterative optimization. We show that the same proposed method works for both full-field microscopy, and for coherent scanning techniques like ptychography. Our implementation utilizes the optimization toolbox and the automatic differentiation capability of the open-source deep learning package TensorFlow, which demonstrates a much straightforward way to solve optimization problems in computational imaging, and endows our program great flexibility and portability. △ Less

Submitted 24 May, 2019; originally announced May 2019.

Journal ref: Science Advances. 6, eaay3700 (2020)

High-energy coherent X-ray diffraction microscopy of polycrystal grains: first steps towards a multi-scale approach

Authors: Siddharth Maddali, Jun-Sang Park, Hemant Sharma, Sarvjit Shastri, Peter Kenesei, Jonathan Almer, Ross Harder, Matthew J. Highland, Youssef S. G. Nashed, Stephan O. Hruszkewycz

Abstract: We present proof-of-concept imaging measurements of a polycrystalline material that integrate the elements of conventional high-energy X-ray diffraction microscopy with coherent diffraction imaging techniques, and that can enable in-situ strain-sensitive imaging of lattice structure in ensembles of deeply embedded crystals over five decades of length scale upon full realization. Such multi-scale i… ▽ More We present proof-of-concept imaging measurements of a polycrystalline material that integrate the elements of conventional high-energy X-ray diffraction microscopy with coherent diffraction imaging techniques, and that can enable in-situ strain-sensitive imaging of lattice structure in ensembles of deeply embedded crystals over five decades of length scale upon full realization. Such multi-scale imaging capabilities are critical to addressing important questions in a variety of research areas such as materials science and engineering, chemistry, and solid state physics. Towards this eventual goal, the following key aspects are demonstrated: 1) high-energy Bragg coherent diffraction imaging (HE-BCDI) of sub-micron-scale crystallites at 52 keV at current third-generation synchrotron light sources, 2) HE-BCDI performed in conjunction with far-field high-energy diffraction microscopy (ff-HEDM) on the grains of a polycrystalline sample in an smoothly integrated manner, and 3) the orientation information of an ensemble of grains obtained via ff-HEDM used to perform complementary HE-BCDI on multiple Bragg reflections of a single targeted grain. These steps lay the foundation for integration of HE-BCDI, which typically provides a spatial resolution tens of nanometers, into a broad suite of well-established HEDM methods, extending HEDM beyond the few-micrometer resolution bound and into the nanoscale, and positioning the approach to take full advantage of the orders-of-magnitude improvement of X-ray coherence expected at fourth generation light sources presently being built and commissioned worldwide. △ Less

Submitted 17 April, 2019; v1 submitted 28 March, 2019; originally announced March 2019.

Comments: 11 pages, 7 figures

Journal ref: Phys. Rev. Applied 14, 024085 (2020)

Using Automatic Differentiation as a General Framework for Ptychographic Reconstruction

Authors: Saugat Kandel, S. Maddali, Marc Allain, Stephan O. Hruszkewycz, Chris Jacobsen, Youssef S G Nashed

Abstract: Coherent diffraction imaging methods enable imaging beyond lens-imposed resolution limits. In these methods, the object can be recovered by minimizing an error metric that quantifies the difference between diffraction patterns as observed, and those calculated from a present guess of the object. Efficient minimization methods require analytical calculation of the derivatives of the error metric, w… ▽ More Coherent diffraction imaging methods enable imaging beyond lens-imposed resolution limits. In these methods, the object can be recovered by minimizing an error metric that quantifies the difference between diffraction patterns as observed, and those calculated from a present guess of the object. Efficient minimization methods require analytical calculation of the derivatives of the error metric, which is not always straightforward. This limits our ability to explore variations of basic imaging approaches. In this paper, we propose to substitute analytical derivative expressions with the automatic differentiation method, whereby we can achieve object reconstruction by specifying only the physics-based experimental forward model. We demonstrate the generality of the proposed method through straightforward object reconstruction for a variety of complex ptychographic experimental models. △ Less

Submitted 21 May, 2019; v1 submitted 8 February, 2019; originally announced February 2019.

Comments: 23 pages (including references and supplemental material), 19 externally generated figure files

Real-time coherent diffraction inversion using deep generative networks

Authors: Mathew J. Cherukara, Youssef S. G. Nashed, Ross J. Harder

Abstract: Phase retrieval, or the process of recovering phase information in reciprocal space to reconstruct images from measured intensity alone, is the underlying basis to a variety of imaging applications including coherent diffraction imaging (CDI). Typical phase retrieval algorithms are iterative in nature, and hence, are time-consuming and computationally expensive, precluding real-time imaging. Furth… ▽ More Phase retrieval, or the process of recovering phase information in reciprocal space to reconstruct images from measured intensity alone, is the underlying basis to a variety of imaging applications including coherent diffraction imaging (CDI). Typical phase retrieval algorithms are iterative in nature, and hence, are time-consuming and computationally expensive, precluding real-time imaging. Furthermore, iterative phase retrieval algorithms struggle to converge to the correct solution especially in the presence of strong phase structures. In this work, we demonstrate the training and testing of CDI NN, a pair of deep deconvolutional networks trained to predict structure and phase in real space of a 2D object from its corresponding far-field diffraction intensities alone. Once trained, CDI NN can invert a diffraction pattern to an image within a few milliseconds of compute time on a standard desktop machine, opening the door to real-time imaging. △ Less

Submitted 7 June, 2018; originally announced June 2018.

Journal ref: Scientific Reports (2018) 8:16520

Localization under Topological Uncertainty for Lane Identification of Autonomous Vehicles

Authors: Samer B. Nashed, David M. Ilstrup, Joydeep Biswas

Abstract: Autonomous vehicles (AVs) require accurate metric and topological location estimates for safe, effective navigation and decision-making. Although many high-definition (HD) roadmaps exist, they are not always accurate since public roads are dynamic, shaped unpredictably by both human activity and nature. Thus, AVs must be able to handle situations in which the topology specified by the map does not… ▽ More Autonomous vehicles (AVs) require accurate metric and topological location estimates for safe, effective navigation and decision-making. Although many high-definition (HD) roadmaps exist, they are not always accurate since public roads are dynamic, shaped unpredictably by both human activity and nature. Thus, AVs must be able to handle situations in which the topology specified by the map does not agree with reality. We present the Variable Structure Multiple Hidden Markov Model (VSM-HMM) as a framework for localizing in the presence of topological uncertainty, and demonstrate its effectiveness on an AV where lane membership is modeled as a topological localization process. VSM-HMMs use a dynamic set of HMMs to simultaneously reason about location within a set of most likely current topologies and therefore may also be applied to topological structure estimation as well as AV lane estimation. In addition, we present an extension to the Earth Mover's Distance which allows uncertainty to be taken into account when computing the distance between belief distributions on simplices of arbitrary relative sizes. △ Less

Submitted 4 March, 2018; originally announced March 2018.

Comments: 6 pages, to appear in ICRA 2018

Human-in-the-Loop SLAM

Authors: Samer B. Nashed, Joydeep Biswas

Abstract: Building large-scale, globally consistent maps is a challenging problem, made more difficult in environments with limited access, sparse features, or when using data collected by novice users. For such scenarios, where state-of-the-art mapping algorithms produce globally inconsistent maps, we introduce a systematic approach to incorporating sparse human corrections, which we term Human-in-the-Loop… ▽ More Building large-scale, globally consistent maps is a challenging problem, made more difficult in environments with limited access, sparse features, or when using data collected by novice users. For such scenarios, where state-of-the-art mapping algorithms produce globally inconsistent maps, we introduce a systematic approach to incorporating sparse human corrections, which we term Human-in-the-Loop Simultaneous Localization and Mapping (HitL-SLAM). Given an initial factor graph for pose graph SLAM, HitL-SLAM accepts approximate, potentially erroneous, and rank-deficient human input, infers the intended correction via expectation maximization (EM), back-propagates the extracted corrections over the pose graph, and finally jointly optimizes the factor graph including the human inputs as human correction factor terms, to yield globally consistent large-scale maps. We thus contribute an EM formulation for inferring potentially rank-deficient human corrections to mapping, and human correction factor extensions to the factor graphs for pose graph SLAM that result in a principled approach to joint optimization of the pose graph while simultaneously accounting for multiple forms of human correction. We present empirical results showing the effectiveness of HitL-SLAM at generating globally accurate and consistent maps even when given poor initial estimates of the map. △ Less

Submitted 22 November, 2017; originally announced November 2017.

Comments: AAAI 2018

Pinning Susceptibility: The effect of dilute, quenched disorder on jamming

Authors: Amy L. Graves, Samer Nashed, Elliot Padgett, Carl P. Goodrich, Andrea J. Liu, James P. Sethna

Abstract: We study the effect of dilute pinning on the jamming transition. Pinning reduces the average contact number needed to jam unpinned particles and shifts the jamming threshold to lower densities, leading to a pinning susceptibility, $χ_p$. Our main results are that this susceptibility obeys scaling form and diverges in the thermodynamic limit as $χ_p \propto |φ- φ_c^\infty|^{-γ_p}$ where… ▽ More We study the effect of dilute pinning on the jamming transition. Pinning reduces the average contact number needed to jam unpinned particles and shifts the jamming threshold to lower densities, leading to a pinning susceptibility, $χ_p$. Our main results are that this susceptibility obeys scaling form and diverges in the thermodynamic limit as $χ_p \propto |φ- φ_c^\infty|^{-γ_p}$ where $φ_c^\infty$ is the jamming threshold in the absence of pins. Finite-size scaling arguments yield these values with associated statistical (systematic) errors $γ_p = 1.018 \pm 0.026 (0.291) $ in $d=2$ and $γ_p =1.534 \pm 0.120 (0.822)$ in $d=3$. Logarithmic corrections raise the exponent in $d=2$ to close to the $d=3$ value, although the systematic errors are very large. △ Less

Submitted 18 May, 2016; v1 submitted 2 September, 2015; originally announced September 2015.

Comments: 5 pages, 3 figures (1a, 1b, 2, 3a, 3b, 3c)

Journal ref: Phys. Rev. Lett. 116, 235501 (2016)