Skip to main content

Showing 1–14 of 14 results for author: Joshi, N J

.
  1. arXiv:2405.16021  [pdf, other

    cs.RO

    VADER: Visual Affordance Detection and Error Recovery for Multi Robot Human Collaboration

    Authors: Michael Ahn, Montserrat Gonzalez Arenas, Matthew Bennice, Noah Brown, Christine Chan, Byron David, Anthony Francis, Gavin Gonzalez, Rainer Hessmer, Tomas Jackson, Nikhil J Joshi, Daniel Lam, Tsang-Wei Edward Lee, Alex Luong, Sharath Maddineni, Harsh Patel, Jodilyn Peralta, Jornell Quiambao, Diego Reyes, Rosario M Jauregui Ruano, Dorsa Sadigh, Pannag Sanketi, Leila Takayama, Pavel Vodenski, Fei Xia

    Abstract: Robots today can exploit the rich world knowledge of large language models to chain simple behavioral skills into long-horizon tasks. However, robots often get interrupted during long-horizon tasks due to primitive skill failures and dynamic environments. We propose VADER, a plan, execute, detect framework with seeking help as a new skill that enables robots to recover and complete long-horizon ta… ▽ More

    Submitted 30 May, 2024; v1 submitted 24 May, 2024; originally announced May 2024.

    Comments: 9 pages, 4 figures

  2. arXiv:2403.12943  [pdf, other

    cs.RO cs.AI

    Vid2Robot: End-to-end Video-conditioned Policy Learning with Cross-Attention Transformers

    Authors: Vidhi Jain, Maria Attarian, Nikhil J Joshi, Ayzaan Wahid, Danny Driess, Quan Vuong, Pannag R Sanketi, Pierre Sermanet, Stefan Welker, Christine Chan, Igor Gilitschenski, Yonatan Bisk, Debidatta Dwibedi

    Abstract: Large-scale multi-task robotic manipulation systems often rely on text to specify the task. In this work, we explore whether a robot can learn by observing humans. To do so, the robot must understand a person's intent and perform the inferred task despite differences in the embodiments and environments. We introduce Vid2Robot, an end-to-end video-conditioned policy that takes human videos demonstr… ▽ More

    Submitted 27 August, 2024; v1 submitted 19 March, 2024; originally announced March 2024.

    Comments: Robotics: Science & Systems (RSS) 2024. https://vid2robot.github.io/

  3. arXiv:2311.00899  [pdf, other

    cs.RO

    RoboVQA: Multimodal Long-Horizon Reasoning for Robotics

    Authors: Pierre Sermanet, Tianli Ding, Jeffrey Zhao, Fei Xia, Debidatta Dwibedi, Keerthana Gopalakrishnan, Christine Chan, Gabriel Dulac-Arnold, Sharath Maddineni, Nikhil J Joshi, Pete Florence, Wei Han, Robert Baruch, Yao Lu, Suvir Mirchandani, Peng Xu, Pannag Sanketi, Karol Hausman, Izhak Shafran, Brian Ichter, Yuan Cao

    Abstract: We present a scalable, bottom-up and intrinsically diverse data collection scheme that can be used for high-level reasoning with long and medium horizons and that has 2.2x higher throughput compared to traditional narrow top-down step-by-step collection. We collect realistic data by performing any user requests within the entirety of 3 office buildings and using multiple robot and human embodiment… ▽ More

    Submitted 1 November, 2023; originally announced November 2023.

  4. arXiv:2310.08864  [pdf, other

    cs.RO

    Open X-Embodiment: Robotic Learning Datasets and RT-X Models

    Authors: Open X-Embodiment Collaboration, Abby O'Neill, Abdul Rehman, Abhinav Gupta, Abhiram Maddukuri, Abhishek Gupta, Abhishek Padalkar, Abraham Lee, Acorn Pooley, Agrim Gupta, Ajay Mandlekar, Ajinkya Jain, Albert Tung, Alex Bewley, Alex Herzog, Alex Irpan, Alexander Khazatsky, Anant Rai, Anchit Gupta, Andrew Wang, Andrey Kolobov, Anikait Singh, Animesh Garg, Aniruddha Kembhavi, Annie Xie , et al. (269 additional authors not shown)

    Abstract: Large, high-capacity models trained on diverse datasets have shown remarkable successes on efficiently tackling downstream applications. In domains from NLP to Computer Vision, this has led to a consolidation of pretrained models, with general pretrained backbones serving as a starting point for many applications. Can such a consolidation happen in robotics? Conventionally, robotic learning method… ▽ More

    Submitted 14 May, 2025; v1 submitted 13 October, 2023; originally announced October 2023.

    Comments: Project website: https://robotics-transformer-x.github.io

  5. arXiv:2212.06817  [pdf, other

    cs.RO cs.AI cs.CL cs.CV cs.LG

    RT-1: Robotics Transformer for Real-World Control at Scale

    Authors: Anthony Brohan, Noah Brown, Justice Carbajal, Yevgen Chebotar, Joseph Dabis, Chelsea Finn, Keerthana Gopalakrishnan, Karol Hausman, Alex Herzog, Jasmine Hsu, Julian Ibarz, Brian Ichter, Alex Irpan, Tomas Jackson, Sally Jesmonth, Nikhil J Joshi, Ryan Julian, Dmitry Kalashnikov, Yuheng Kuang, Isabel Leal, Kuang-Huei Lee, Sergey Levine, Yao Lu, Utsav Malla, Deeksha Manjunath , et al. (26 additional authors not shown)

    Abstract: By transferring knowledge from large, diverse, task-agnostic datasets, modern machine learning models can solve specific downstream tasks either zero-shot or with small task-specific datasets to a high level of performance. While this capability has been demonstrated in other fields such as computer vision, natural language processing or speech recognition, it remains to be shown in robotics, wher… ▽ More

    Submitted 11 August, 2023; v1 submitted 13 December, 2022; originally announced December 2022.

    Comments: See website at robotics-transformer1.github.io

  6. arXiv:2204.01691  [pdf, other

    cs.RO cs.CL cs.LG

    Do As I Can, Not As I Say: Grounding Language in Robotic Affordances

    Authors: Michael Ahn, Anthony Brohan, Noah Brown, Yevgen Chebotar, Omar Cortes, Byron David, Chelsea Finn, Chuyuan Fu, Keerthana Gopalakrishnan, Karol Hausman, Alex Herzog, Daniel Ho, Jasmine Hsu, Julian Ibarz, Brian Ichter, Alex Irpan, Eric Jang, Rosario Jauregui Ruano, Kyle Jeffrey, Sally Jesmonth, Nikhil J Joshi, Ryan Julian, Dmitry Kalashnikov, Yuheng Kuang, Kuang-Huei Lee , et al. (20 additional authors not shown)

    Abstract: Large language models can encode a wealth of semantic knowledge about the world. Such knowledge could be extremely useful to robots aiming to act upon high-level, temporally extended instructions expressed in natural language. However, a significant weakness of language models is that they lack real-world experience, which makes it difficult to leverage them for decision making within a given embo… ▽ More

    Submitted 16 August, 2022; v1 submitted 4 April, 2022; originally announced April 2022.

    Comments: See website at https://say-can.github.io/ V1. Initial Upload. V2. Added PaLM results. Added study about new capabilities (drawer manipulation, chain of thought prompting, multilingual instructions). Added an ablation study of language model size. Added an open-source version of \algname on a simulated tabletop environment. Improved readability

  7. arXiv:2009.13323  [pdf

    eess.IV cs.CV cs.LG

    AI Progress in Skin Lesion Analysis

    Authors: Philippe M. Burlina, William Paul, Phil A. Mathew, Neil J. Joshi, Alison W. Rebman, John N. Aucott

    Abstract: We examine progress in the use of AI for detecting skin lesions, with particular emphasis on the erythema migrans rash of acute Lyme disease, and other lesions, such as those from conditions like herpes zoster (shingles), tinea corporis, erythema multiforme, cellulitis, insect bites, or tick bites. We discuss important challenges for these applications, in particular the problems of AI bias regard… ▽ More

    Submitted 9 October, 2020; v1 submitted 28 September, 2020; originally announced September 2020.

  8. The Physics of the B Factories

    Authors: A. J. Bevan, B. Golob, Th. Mannel, S. Prell, B. D. Yabsley, K. Abe, H. Aihara, F. Anulli, N. Arnaud, T. Aushev, M. Beneke, J. Beringer, F. Bianchi, I. I. Bigi, M. Bona, N. Brambilla, J. B rodzicka, P. Chang, M. J. Charles, C. H. Cheng, H. -Y. Cheng, R. Chistov, P. Colangelo, J. P. Coleman, A. Drutskoy , et al. (2009 additional authors not shown)

    Abstract: This work is on the Physics of the B Factories. Part A of this book contains a brief description of the SLAC and KEK B Factories as well as their detectors, BaBar and Belle, and data taking related issues. Part B discusses tools and methods used by the experiments in order to obtain results. The results themselves can be found in Part C. Please note that version 3 on the archive is the auxiliary… ▽ More

    Submitted 31 October, 2015; v1 submitted 24 June, 2014; originally announced June 2014.

    Comments: 928 pages, version 3 (arXiv:1406.6311v3) corresponds to the alpha, beta, gamma version of the book, the other versions use the phi1, phi2, phi3 notation

    Report number: SLAC-PUB-15968, KEK Preprint 2014-3

    Journal ref: Eur. Phys. J. C74 (2014) 3026

  9. Observation of transverse polarization asymmetries of charged pion pairs in e+e- annihilation near sqrt s=10.58 GeV

    Authors: A. Vossen, R. Seidl, I. Adachi, H. Aihara, T. Aushev, V. Balagura, W. Bartel, M. Bischofberger, A. Bondar, M. Bračko, T. E. Browder, M. -C. Chang, A. Chen, P. Chen, B. G. Cheon, K. Cho, Y. Choi, S. Eidelman, M. Feindt, V. Gaur, N. Gabyshev, A. Garmash, B. Golob, M. Grosse-Perdekamp, J. Haba , et al. (75 additional authors not shown)

    Abstract: The interference fragmentation function translates the fragmentation of a quark with a transverse projection of the spin into an azimuthal asymmetry of two final-state hadrons. In e+e- annihilation the product of two interference fragmentation functions is measured. We report nonzero asymmetries for pairs of charge-ordered pi+pi- pairs, which indicate a significant interference fragmentation funct… ▽ More

    Submitted 26 June, 2011; v1 submitted 13 April, 2011; originally announced April 2011.

    Comments: 19 pages, 5 figures (including publication's supplement file), Submitted to Physical Review Letters

    Report number: Belle DRAFT 2011-5 KEK Preprint 2010-53

    Journal ref: Phys.Rev.Lett.107:072004,2011

  10. Evidence for the Suppressed Decay B- -> DK-, D -> K+pi-

    Authors: Belle Collaboration, Y. Horii, K. Trabelsi, H. Yamamoto, I. Adachi, H. Aihara, K. Arinstein, V. Aulchenko, T. Aushev, V. Balagura, E. Barberio, K. Belous, B. Bhuyan, M. Bischofberger, A. Bozek, M. Bracko, T. E. Browder, M. -C. Chang, P. Chang, A. Chen, P. Chen, B. G. Cheon, C. -C. Chiang, I. -S. Cho, K. Cho , et al. (121 additional authors not shown)

    Abstract: The suppressed decay chain B- -> DK-, D -> K+pi-, where D indicates a anti-D0 or D0 state, provides important information on the CP-violating angle phi_3. We measure the ratio R_{DK} of the decay rates to the favored mode B- -> DK-, D -> K-pi+ to be R_{DK} = [1.63^{+0.44}_{-0.41}(stat)^{+0.07}_{-0.13}(syst)] x 10^{-2}, which indicates the first evidence of the signal with a significance of 4.1sigm… ▽ More

    Submitted 18 May, 2011; v1 submitted 30 March, 2011; originally announced March 2011.

    Comments: 6 pages, 2 figures, 2 tables, accepted by Physical Review Letters

    Report number: Belle Preprint 2011-4, KEK Preprint 2010-52

    Journal ref: Phys.Rev.Lett.106:231803,2011

  11. Measurement of the decay $B^0\toπ^-\ell^+ν$ and determination of $|V_{ub}|$

    Authors: H. Ha, E. Won, I. Adachi, H. Aihara, T. Aziz, A. M. Bakich, V. Balagura, E. Barberio, A. Bay, K. Belous, V. Bhardwaj, B. Bhuyan, M. Bischofberger, A. Bondar, A. Bozek, M. Bracko, T. E. Browder, Y. Chao, A. Chen, P. Chen, B. G. Cheon, C. -C. Chiang, I. -S. Cho, K. Cho, K. -S. Choi , et al. (118 additional authors not shown)

    Abstract: We present a measurement of the charmless semileptonic decay $B^0\toπ^-\ell^+ν$ using a data sample containing 657$\times 10^6$ $B\bar{B}$ events collected with the Belle detector at the KEKB asymmetric-energy $e^+e^-$ collider operating near the $Υ(4S)$ resonance. We determine the total branching fraction of the decay,… ▽ More

    Submitted 28 January, 2011; v1 submitted 30 November, 2010; originally announced December 2010.

    Comments: 8 pages, 3 figures, Submitted to PRD(RC)

    Report number: Belle Preprint 2010-22, KEK Preprint 2010-37

    Journal ref: Phys.Rev.D83:071101,2011

  12. Observation of Bs->Ds(*)+Ds(*)- using e+e- collisions and a determination of the Bs-Bsbar width difference ΔΓ_s

    Authors: S. Esen, A. J. Schwartz, I. Adachi, H. Aihara, K. Arinstein, V. Aulchenko, T. Aushev, T. Aziz, A. M. Bakich, V. Balagura, E. Barberio, A. Bay, M. Bischofberger, A. Bondar, A. Bozek, M. Bracko, T. E. Browder, M. -C. Chang, P. Chang, A. Chen, P. Chen, B. G. Cheon, C. -C. Chiang, Y. Choi, J. Dalseno , et al. (103 additional authors not shown)

    Abstract: We have made the first observation of Bs->Ds(*)+Ds(*)- decays using 23.6 fb-1 of data recorded by the Belle experiment running on the Upsilon(5S) resonance. The branching fractions are measured to be B(B^0_s\ra D^+_s D^-_s) = (1.0\,^{+0.4}_{-0.3}\,^{+0.3}_{-0.2})%, B(B^0_s\ra D^{*\pm}_s D^{\mp}_s) = (2.8\,^{+0.8}_{-0.7}\,\pm 0.7)%, and B(B^0_s\ra D^{*+}_s D^{*-}_s) = (3.1\,^{+1.2}_{-1.0}\,\pm 0.8)… ▽ More

    Submitted 7 December, 2010; v1 submitted 27 May, 2010; originally announced May 2010.

    Comments: 13 pages, 2 figures, 2 tables. v2: text added for clarification, version published in Phys. Rev. Letters

    Report number: University of Cincinnati preprint UCHEP-10-03; KEK Preprint 2010-13

    Journal ref: Phys.Rev.Lett.105:201802,2010

  13. First Measurement of Inclusive B -> X_s eta Decays

    Authors: Belle Collaboration, K. Nishimura, T. E. Browder, I. Adachi, H. Aihara, K. Arinstein, T. Aushev, A. M. Bakich, V. Balagura, E. Barberio, K. Belous, V. Bhardwaj, M. Bischofberger, A. Bondar, A. Bozek, M. Bracko, M. -C. Chang, Y. Chao, A. Chen, K. -F. Chen, P. Chen, B. G. Cheon, C. -C. Chiang, I. -S. Cho, Y. Choi , et al. (118 additional authors not shown)

    Abstract: We report a first measurement of inclusive B -> X_s eta decays, where X_s is a charmless state with unit strangeness. The measurement is based on a pseudo-inclusive reconstruction technique and uses a sample of 657 x 10^6 BB-bar pairs accumulated with the Belle detector at the KEKB e^+e^- collider. For M_{X_s} < 2.6 GeV/c^2, we measure a branching fraction of (26.1 +/- 3.0 (stat) +1.9 -2.1 (syst)… ▽ More

    Submitted 20 August, 2010; v1 submitted 25 October, 2009; originally announced October 2009.

    Comments: 6 pages, 1 figure, 1 table, submitted to Physical Review Letters

    Report number: Belle preprint 2010-19, KEK preprint 2010-30

    Journal ref: Phys.Rev.Lett.105:191803,2010

  14. Gravitational Lensing In Case of Massive Particles

    Authors: Nikhil J. Joshi

    Abstract: Gravitation lensing calculations, which are generally done for light ray, are extended to that for a massive particle. Many interesting results were observed. We discuss the scattering cross section along-with many consequential quantities here. In particular, the case of Schrwarzschild metric was taken as illustration, though the analysis applies to a wide range of cases, such as extended black… ▽ More

    Submitted 30 November, 2003; originally announced December 2003.

    Comments: 8 pages, 4 figures, written in Latex