Skip to main content

Showing 1–50 of 54 results for author: Kemp, C

Searching in archive cs. Search in all archives.
.
  1. arXiv:2502.04635  [pdf, other

    cs.RO

    Exercise Specialists Evaluation of Robot-led Physical Therapy for People with Parkinsons Disease

    Authors: Matthew Lamsey, Meredith D. Wells, Lydia Hamby, Paige Scanlon, Rouida Siddiqui, You Liang Tan, Jerry Feldman, Charles C. Kemp, Madeleine E. Hackney

    Abstract: Robot-led physical therapy (PT) offers a promising avenue to enhance the care provided by clinical exercise specialists (ES) and physical and occupational therapists to improve patients' adherence to prescribed exercises outside of a clinic, such as at home. Collaborative efforts among roboticists, ES, physical and occupational therapists, and patients are essential for developing interactive, per… ▽ More

    Submitted 6 February, 2025; originally announced February 2025.

    Comments: 11 pages, 4 figures

  2. Word reuse and combination support efficient communication of emerging concepts

    Authors: Aotao Xu, Charles Kemp, Lea Frermann, Yang Xu

    Abstract: A key function of the lexicon is to express novel concepts as they emerge over time through a process known as lexicalization. The most common lexicalization strategies are the reuse and combination of existing words, but they have typically been studied separately in the areas of word meaning extension and word formation. Here we offer an information-theoretic account of how both strategies are c… ▽ More

    Submitted 8 November, 2024; originally announced November 2024.

    Comments: Published in Proceedings of the National Academy of Sciences

    Journal ref: Proceedings of the National Academy of Sciences, 121(46), e2406971121 (2024)

  3. arXiv:2407.06939  [pdf, other

    cs.RO cs.CV

    Towards Open-World Mobile Manipulation in Homes: Lessons from the Neurips 2023 HomeRobot Open Vocabulary Mobile Manipulation Challenge

    Authors: Sriram Yenamandra, Arun Ramachandran, Mukul Khanna, Karmesh Yadav, Jay Vakil, Andrew Melnik, Michael Büttner, Leon Harz, Lyon Brown, Gora Chand Nandi, Arjun PS, Gaurav Kumar Yadav, Rahul Kala, Robert Haschke, Yang Luo, Jinxin Zhu, Yansen Han, Bingyi Lu, Xuan Gu, Qinyuan Liu, Yaping Zhao, Qiting Ye, Chenxiao Dou, Yansong Chua, Volodymyr Kuzma , et al. (20 additional authors not shown)

    Abstract: In order to develop robots that can effectively serve as versatile and capable home assistants, it is crucial for them to reliably perceive and interact with a wide variety of objects across diverse environments. To this end, we proposed Open Vocabulary Mobile Manipulation as a key benchmark task for robotics: finding any object in a novel environment and placing it on any receptacle surface withi… ▽ More

    Submitted 9 July, 2024; originally announced July 2024.

  4. arXiv:2402.12690  [pdf, other

    cs.CL

    Simpson's Paradox and the Accuracy-Fluency Tradeoff in Translation

    Authors: Zheng Wei Lim, Ekaterina Vylomova, Trevor Cohn, Charles Kemp

    Abstract: A good translation should be faithful to the source and should respect the norms of the target language. We address a theoretical puzzle about the relationship between these objectives. On one hand, intuition and some prior work suggest that accuracy and fluency should trade off against each other, and that capturing every detail of the source can only be achieved at the cost of fluency. On the ot… ▽ More

    Submitted 10 June, 2024; v1 submitted 19 February, 2024; originally announced February 2024.

  5. arXiv:2402.10510  [pdf, other

    cs.HC cs.AI

    Human Goal Recognition as Bayesian Inference: Investigating the Impact of Actions, Timing, and Goal Solvability

    Authors: Chenyuan Zhang, Charles Kemp, Nir Lipovetzky

    Abstract: Goal recognition is a fundamental cognitive process that enables individuals to infer intentions based on available cues. Current goal recognition algorithms often take only observed actions as input, but here we use a Bayesian framework to explore the role of actions, timing, and goal solvability in goal recognition. We analyze human responses to goal-recognition problems in the Sokoban domain, a… ▽ More

    Submitted 16 February, 2024; originally announced February 2024.

    Comments: Accepted by AAMAS 2024

  6. arXiv:2312.13279  [pdf, other

    cs.RO

    Stretch with Stretch: Physical Therapy Exercise Games Led by a Mobile Manipulator

    Authors: Matthew Lamsey, You Liang Tan, Meredith D. Wells, Madeline Beatty, Zexuan Liu, Arjun Majumdar, Kendra Washington, Jerry Feldman, Naveen Kuppuswamy, Elizabeth Nguyen, Arielle Wallenstein, Madeleine E. Hackney, Charles C. Kemp

    Abstract: Physical therapy (PT) is a key component of many rehabilitation regimens, such as treatments for Parkinson's disease (PD). However, there are shortages of physical therapists and adherence to self-guided PT is low. Robots have the potential to support physical therapists and increase adherence to self-guided PT, but prior robotic systems have been large and immobile, which can be a barrier to use… ▽ More

    Submitted 21 December, 2023; v1 submitted 20 December, 2023; originally announced December 2023.

    Comments: This work has been submitted to the IEEE for possible publication

  7. arXiv:2312.11852  [pdf, other

    cs.CL

    Predicting Human Translation Difficulty with Neural Machine Translation

    Authors: Zheng Wei Lim, Ekaterina Vylomova, Charles Kemp, Trevor Cohn

    Abstract: Human translators linger on some words and phrases more than others, and predicting this variation is a step towards explaining the underlying cognitive processes. Using data from the CRITT Translation Process Research Database, we evaluate the extent to which surprisal and attentional features derived from a Neural Machine Translation (NMT) model account for reading and production times of human… ▽ More

    Submitted 18 December, 2023; originally announced December 2023.

  8. arXiv:2310.03743  [pdf, other

    cs.RO cs.LG

    The Un-Kidnappable Robot: Acoustic Localization of Sneaking People

    Authors: Mengyu Yang, Patrick Grady, Samarth Brahmbhatt, Arun Balajee Vasudevan, Charles C. Kemp, James Hays

    Abstract: How easy is it to sneak up on a robot? We examine whether we can detect people using only the incidental sounds they produce as they move, even when they try to be quiet. We collect a robotic dataset of high-quality 4-channel audio paired with 360 degree RGB data of people moving in different indoor settings. We train models that predict if there is a moving person nearby and their location using… ▽ More

    Submitted 9 May, 2024; v1 submitted 5 October, 2023; originally announced October 2023.

    Comments: ICRA 2024 camera ready

  9. arXiv:2309.12312  [pdf, other

    cs.RO cs.AI cs.CV cs.LG

    ForceSight: Text-Guided Mobile Manipulation with Visual-Force Goals

    Authors: Jeremy A. Collins, Cody Houff, You Liang Tan, Charles C. Kemp

    Abstract: We present ForceSight, a system for text-guided mobile manipulation that predicts visual-force goals using a deep neural network. Given a single RGBD image combined with a text prompt, ForceSight determines a target end-effector pose in the camera frame (kinematic goal) and the associated forces (force goal). Together, these two components form a visual-force goal. Prior work has demonstrated that… ▽ More

    Submitted 23 September, 2023; v1 submitted 21 September, 2023; originally announced September 2023.

  10. arXiv:2306.06548  [pdf, other

    cs.CL cs.AI

    Inductive reasoning in humans and large language models

    Authors: Simon J. Han, Keith Ransom, Andrew Perfors, Charles Kemp

    Abstract: The impressive recent performance of large language models has led many to wonder to what extent they can serve as models of general intelligence or are similar to human cognition. We address this issue by applying GPT-3.5 and GPT-4 to a classic problem in human inductive reasoning known as property induction. Over two experiments, we elicit human judgments on a range of property induction tasks s… ▽ More

    Submitted 3 August, 2023; v1 submitted 10 June, 2023; originally announced June 2023.

    Comments: 61 pages, 5 figures

  11. arXiv:2303.07344  [pdf, other

    cs.RO

    Visual Contact Pressure Estimation for Grippers in the Wild

    Authors: Jeremy A. Collins, Cody Houff, Patrick Grady, Charles C. Kemp

    Abstract: Sensing contact pressure applied by a gripper can benefit autonomous and teleoperated robotic manipulation, but adding tactile sensors to a gripper's surface can be difficult or impractical. If a gripper visibly deforms, contact pressure can be visually estimated using images from an external camera that observes the gripper. While researchers have demonstrated this capability in controlled labora… ▽ More

    Submitted 28 September, 2023; v1 submitted 13 March, 2023; originally announced March 2023.

    Comments: Accepted for presentation at the 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2023)

  12. arXiv:2301.02310  [pdf, other

    cs.CV

    PressureVision++: Estimating Fingertip Pressure from Diverse RGB Images

    Authors: Patrick Grady, Jeremy A. Collins, Chengcheng Tang, Christopher D. Twigg, Kunal Aneja, James Hays, Charles C. Kemp

    Abstract: Touch plays a fundamental role in manipulation for humans; however, machine perception of contact and pressure typically requires invasive sensors. Recent research has shown that deep models can estimate hand pressure based on a single RGB image. However, evaluations have been limited to controlled settings since collecting diverse data with ground-truth pressure measurements is difficult. We pres… ▽ More

    Submitted 3 January, 2024; v1 submitted 5 January, 2023; originally announced January 2023.

    Comments: WACV 2024

  13. arXiv:2210.00051  [pdf, other

    cs.RO

    Force/Torque Sensing for Soft Grippers using an External Camera

    Authors: Jeremy A. Collins, Patrick Grady, Charles C. Kemp

    Abstract: Robotic manipulation can benefit from wrist-mounted force/torque (F/T) sensors, but conventional F/T sensors can be expensive, difficult to install, and damaged by high loads. We present Visual Force/Torque Sensing (VFTS), a method that visually estimates the 6-axis F/T measurement that would be reported by a conventional F/T sensor. In contrast to approaches that sense loads using internal camera… ▽ More

    Submitted 7 May, 2023; v1 submitted 30 September, 2022; originally announced October 2022.

    Comments: Accepted for presentation at 2023 IEEE International Conference on Robotics and Automation (ICRA)

  14. arXiv:2204.07268  [pdf, other

    cs.RO

    Visual Pressure Estimation and Control for Soft Robotic Grippers

    Authors: Patrick Grady, Jeremy A. Collins, Samarth Brahmbhatt, Christopher D. Twigg, Chengcheng Tang, James Hays, Charles C. Kemp

    Abstract: Soft robotic grippers facilitate contact-rich manipulation, including robust grasping of varied objects. Yet the beneficial compliance of a soft gripper also results in significant deformation that can make precision manipulation challenging. We present visual pressure estimation & control (VPEC), a method that infers pressure applied by a soft gripper using an RGB image from an external camera. W… ▽ More

    Submitted 9 August, 2022; v1 submitted 14 April, 2022; originally announced April 2022.

    Comments: IROS 2022

  15. arXiv:2203.10385  [pdf, other

    cs.CV

    PressureVision: Estimating Hand Pressure from a Single RGB Image

    Authors: Patrick Grady, Chengcheng Tang, Samarth Brahmbhatt, Christopher D. Twigg, Chengde Wan, James Hays, Charles C. Kemp

    Abstract: People often interact with their surroundings by applying pressure with their hands. While hand pressure can be measured by placing pressure sensors between the hand and the environment, doing so can alter contact mechanics, interfere with human tactile perception, require costly sensors, and scale poorly to large environments. We explore the possibility of using a conventional RGB camera to infer… ▽ More

    Submitted 30 September, 2022; v1 submitted 19 March, 2022; originally announced March 2022.

    Comments: ECCV 2022 oral

  16. arXiv:2109.10892  [pdf, other

    cs.RO

    The Design of Stretch: A Compact, Lightweight Mobile Manipulator for Indoor Human Environments

    Authors: Charles C. Kemp, Aaron Edsinger, Henry M. Clever, Blaine Matulevich

    Abstract: Mobile manipulators for indoor human environments can serve as versatile devices that perform a variety of tasks, yet adoption of this technology has been limited. Reducing size, weight, and cost could facilitate adoption, but risks restricting capabilities. We present a novel design that reduces size, weight, and cost, while supporting a variety of tasks. The core design consists of a two-wheeled… ▽ More

    Submitted 20 October, 2022; v1 submitted 22 September, 2021; originally announced September 2021.

    Comments: 6 pages + refs, 9 figures. Published in peer-reviewed conference (ICRA 2022) with DOI 10.1109/ICRA46639.2022.9811922. Please cite like: [1] Charles C. Kemp, Aaron Edsinger, Henry M. Clever and Blaine Matulevich, "The Design of Stretch: A Compact, Lightweight Mobile Manipulator for Indoor Human Environments", IEEE International Conference on Robotics and Automation (ICRA), 2022

  17. arXiv:2109.04930  [pdf, other

    cs.RO

    Bodies Uncovered: Learning to Manipulate Real Blankets Around People via Physics Simulations

    Authors: Kavya Puthuveetil, Charles C. Kemp, Zackory Erickson

    Abstract: While robots present an opportunity to provide physical assistance to older adults and people with mobility impairments in bed, people frequently rest in bed with blankets that cover the majority of their body. To provide assistance for many daily self-care tasks, such as bathing, dressing, or ambulating, a caregiver must first uncover blankets from part of a person's body. In this work, we introd… ▽ More

    Submitted 6 January, 2022; v1 submitted 10 September, 2021; originally announced September 2021.

    Comments: to be published in IEEE Robotics and Automation Letters, 8 pages, 9 figures, 2 tables

  18. arXiv:2105.11582  [pdf, other

    cs.RO cs.HC

    Characterizing Multidimensional Capacitive Servoing for Physical Human-Robot Interaction

    Authors: Zackory Erickson, Henry M. Clever, Vamsee Gangaram, Eliot Xing, Greg Turk, C. Karen Liu, Charles C. Kemp

    Abstract: Towards the goal of robots performing robust and intelligent physical interactions with people, it is crucial that robots are able to accurately sense the human body, follow trajectories around the body, and track human motion. This study introduces a capacitive servoing control scheme that allows a robot to sense and navigate around human limbs during close physical interactions. Capacitive servo… ▽ More

    Submitted 27 August, 2021; v1 submitted 24 May, 2021; originally announced May 2021.

    Comments: 17 pages, 22 figures, 4 tables, 2 algorithms

  19. arXiv:2105.09936  [pdf, other

    cs.CV

    BodyPressure -- Inferring Body Pose and Contact Pressure from a Depth Image

    Authors: Henry M. Clever, Patrick Grady, Greg Turk, Charles C. Kemp

    Abstract: Contact pressure between the human body and its surroundings has important implications. For example, it plays a role in comfort, safety, posture, and health. We present a method that infers contact pressure between a human body and a mattress from a depth image. Specifically, we focus on using a depth image from a downward facing camera to infer pressure on a body at rest in bed occluded by beddi… ▽ More

    Submitted 20 May, 2021; originally announced May 2021.

    Comments: 19 pages, 11 figures, 4 tables

  20. arXiv:2104.07267  [pdf, other

    cs.CV

    ContactOpt: Optimizing Contact to Improve Grasps

    Authors: Patrick Grady, Chengcheng Tang, Christopher D. Twigg, Minh Vo, Samarth Brahmbhatt, Charles C. Kemp

    Abstract: Physical contact between hands and objects plays a critical role in human grasps. We show that optimizing the pose of a hand to achieve expected contact with an object can improve hand poses inferred via image-based methods. Given a hand mesh and an object mesh, a deep model trained on ground truth contact data infers desirable contact across the surfaces of the meshes. Then, ContactOpt efficientl… ▽ More

    Submitted 15 April, 2021; originally announced April 2021.

    Comments: Conference on Computer Vision and Pattern Recognition (CVPR) 2021

  21. arXiv:2103.02533  [pdf, other

    cs.GR cs.LG

    Learning to Manipulate Amorphous Materials

    Authors: Yunbo Zhang, Wenhao Yu, C. Karen Liu, Charles C. Kemp, Greg Turk

    Abstract: We present a method of training character manipulation of amorphous materials such as those often used in cooking. Common examples of amorphous materials include granular materials (salt, uncooked rice), fluids (honey), and visco-plastic materials (sticky rice, softened butter). A typical task is to spread a given material out across a flat surface using a tool such as a scraper or knife. We use r… ▽ More

    Submitted 3 March, 2021; originally announced March 2021.

  22. arXiv:2012.02176  [pdf, other

    cs.RO

    Material Recognition via Heat Transfer Given Ambiguous Initial Conditions

    Authors: Tapomayukh Bhattacharjee, Henry M. Clever, Joshua Wade, Charles C. Kemp

    Abstract: Humans and robots can recognize materials with distinct thermal effusivities by making physical contact and observing temperatures during heat transfer. This works well with room temperature materials and humans and robots at human body temperatures. Past research has shown that cooling or heating a material can result in temperatures that are similar to contact with another material. To thoroughl… ▽ More

    Submitted 3 December, 2020; originally announced December 2020.

    Comments: 13 pages, 7 figures, supplementary material included

  23. arXiv:2008.01567  [pdf, other

    eess.IV cs.CV

    Multi-Slice Fusion for Sparse-View and Limited-Angle 4D CT Reconstruction

    Authors: Soumendu Majee, Thilo Balke, Craig A. J. Kemp, Gregery T. Buzzard, Charles A. Bouman

    Abstract: Inverse problems spanning four or more dimensions such as space, time and other independent parameters have become increasingly important. State-of-the-art 4D reconstruction methods use model based iterative reconstruction (MBIR), but depend critically on the quality of the prior modeling. Recently, plug-and-play (PnP) methods have been shown to be an effective way to incorporate advanced prior mo… ▽ More

    Submitted 19 February, 2021; v1 submitted 31 July, 2020; originally announced August 2020.

    Comments: arXiv admin note: substantial text overlap with arXiv:1906.06601

  24. arXiv:2007.09545  [pdf, other

    cs.CV

    ContactPose: A Dataset of Grasps with Object Contact and Hand Pose

    Authors: Samarth Brahmbhatt, Chengcheng Tang, Christopher D. Twigg, Charles C. Kemp, James Hays

    Abstract: Grasping is natural for humans. However, it involves complex hand configurations and soft tissue deformation that can result in complicated regions of contact between the hand and the object. Understanding and modeling this contact can potentially improve hand models, AR/VR experiences, and robotic grasping. Yet, we currently lack datasets of hand-object contact paired with other data modalities,… ▽ More

    Submitted 18 July, 2020; originally announced July 2020.

    Comments: The European Conference on Computer Vision (ECCV) 2020

  25. arXiv:2007.04959  [pdf, other

    cs.RO cs.HC cs.LG

    Assistive VR Gym: Interactions with Real People to Improve Virtual Assistive Robots

    Authors: Zackory Erickson, Yijun Gu, Charles C. Kemp

    Abstract: Versatile robotic caregivers could benefit millions of people worldwide, including older adults and people with disabilities. Recent work has explored how robotic caregivers can learn to interact with people through physics simulations, yet transferring what has been learned to real robots remains challenging. Virtual reality (VR) has the potential to help bridge the gap between simulations and th… ▽ More

    Submitted 22 July, 2020; v1 submitted 9 July, 2020; originally announced July 2020.

    Comments: IEEE International Conference on Robot and Human Interactive Communication (RO-MAN 2020), 8 pages, 8 figures, 2 tables

  26. arXiv:2004.01166  [pdf, other

    cs.CV

    Bodies at Rest: 3D Human Pose and Shape Estimation from a Pressure Image using Synthetic Data

    Authors: Henry M. Clever, Zackory Erickson, Ariel Kapusta, Greg Turk, C. Karen Liu, Charles C. Kemp

    Abstract: People spend a substantial part of their lives at rest in bed. 3D human pose and shape estimation for this activity would have numerous beneficial applications, yet line-of-sight perception is complicated by occlusion from bedding. Pressure sensing mats are a promising alternative, but training data is challenging to collect at scale. We describe a physics-based method that simulates human bodies… ▽ More

    Submitted 2 April, 2020; originally announced April 2020.

    Comments: 18 pages, 18 figures, 5 tables. Accepted for oral presentation at CVPR 2020

  27. arXiv:2004.01160  [pdf, other

    cs.RO cs.LG

    Multimodal Material Classification for Robots using Spectroscopy and High Resolution Texture Imaging

    Authors: Zackory Erickson, Eliot Xing, Bharat Srirangam, Sonia Chernova, Charles C. Kemp

    Abstract: Material recognition can help inform robots about how to properly interact with and manipulate real-world objects. In this paper, we present a multimodal sensing technique, leveraging near-infrared spectroscopy and close-range high resolution texture imaging, that enables robots to estimate the materials of household objects. We release a dataset of high resolution texture images and spectral meas… ▽ More

    Submitted 30 July, 2020; v1 submitted 2 April, 2020; originally announced April 2020.

    Comments: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2020), 8 pages, 10 figures, 5 tables

  28. arXiv:1910.04700  [pdf, other

    cs.RO cs.AI cs.LG

    Assistive Gym: A Physics Simulation Framework for Assistive Robotics

    Authors: Zackory Erickson, Vamsee Gangaram, Ariel Kapusta, C. Karen Liu, Charles C. Kemp

    Abstract: Autonomous robots have the potential to serve as versatile caregivers that improve quality of life for millions of people worldwide. Yet, conducting research in this area presents numerous challenges, including the risks of physical interaction between people and robots. Physics simulations have been used to optimize and train robots for physical assistance, but have typically focused on a single… ▽ More

    Submitted 10 October, 2019; originally announced October 2019.

    Comments: 8 pages, 5 figures, 2 tables

  29. arXiv:1909.06682  [pdf, other

    cs.RO cs.AI

    Learning to Collaborate from Simulation for Robot-Assisted Dressing

    Authors: Alexander Clegg, Zackory Erickson, Patrick Grady, Greg Turk, Charles C. Kemp, C. Karen Liu

    Abstract: We investigated the application of haptic feedback control and deep reinforcement learning (DRL) to robot-assisted dressing. Our method uses DRL to simultaneously train human and robot control policies as separate neural networks using physics simulations. In addition, we modeled variations in human impairments relevant to dressing, including unilateral muscle weakness, involuntary arm motion, and… ▽ More

    Submitted 18 December, 2019; v1 submitted 14 September, 2019; originally announced September 2019.

    Comments: 8 pages, 8 figures, 3 tables; simulation to reality experiment added to evaluation; authors added; modified: title, abstract, conclusion, references; figure added

  30. arXiv:1907.07388  [pdf, other

    cs.CV

    Towards Markerless Grasp Capture

    Authors: Samarth Brahmbhatt, Charles C. Kemp, James Hays

    Abstract: Humans excel at grasping objects and manipulating them. Capturing human grasps is important for understanding grasping behavior and reconstructing it realistically in Virtual Reality (VR). However, grasp capture - capturing the pose of a hand grasping an object, and orienting it w.r.t. the object - is difficult because of the complexity and diversity of the human hand, and occlusion. Reflective ma… ▽ More

    Submitted 17 July, 2019; originally announced July 2019.

    Comments: Third Workshop on Computer Vision for AR/VR, CVPR 2019

  31. arXiv:1906.06601  [pdf, other

    eess.IV cs.CV

    4D X-Ray CT Reconstruction using Multi-Slice Fusion

    Authors: Soumendu Majee, Thilo Balke, Craig A. J. Kemp, Gregery T. Buzzard, Charles A. Bouman

    Abstract: There is an increasing need to reconstruct objects in four or more dimensions corresponding to space, time and other independent parameters. The best 4D reconstruction algorithms use regularized iterative reconstruction approaches such as model based iterative reconstruction (MBIR), which depends critically on the quality of the prior modeling. Recently, Plug-and-Play methods have been shown to be… ▽ More

    Submitted 15 June, 2019; originally announced June 2019.

    Comments: 8 pages, 8 figures, IEEE International Conference on Computational Photography 2019, Tokyo

  32. arXiv:1905.04562  [pdf, other

    cs.CL

    Semantic categories of artifacts and animals reflect efficient coding

    Authors: Noga Zaslavsky, Terry Regier, Naftali Tishby, Charles Kemp

    Abstract: It has been argued that semantic categories across languages reflect pressure for efficient communication. Recently, this idea has been cast in terms of a general information-theoretic principle of efficiency, the Information Bottleneck (IB) principle, and it has been shown that this principle accounts for the emergence and evolution of named color categories across languages, including soft struc… ▽ More

    Submitted 11 May, 2019; originally announced May 2019.

    Comments: To appear in the proceedings of the 41st Annual Conference of the Cognitive Science Society (CogSci 2019)

  33. arXiv:1904.06830  [pdf, other

    cs.CV

    ContactDB: Analyzing and Predicting Grasp Contact via Thermal Imaging

    Authors: Samarth Brahmbhatt, Cusuh Ham, Charles C. Kemp, James Hays

    Abstract: Grasping and manipulating objects is an important human skill. Since hand-object contact is fundamental to grasping, capturing it can lead to important insights. However, observing contact through external sensors is challenging because of occlusion and the complexity of the human hand. We present ContactDB, a novel dataset of contact maps for household objects that captures the rich hand-object c… ▽ More

    Submitted 14 April, 2019; originally announced April 2019.

    Comments: CVPR 2019 Oral

  34. arXiv:1904.03568  [pdf, other

    cs.RO

    Active Robot-Assisted Feeding with a General-Purpose Mobile Manipulator: Design, Evaluation, and Lessons Learned

    Authors: Daehyung Park, Yuuna Hoshi, Harshal P. Mahajan, Ho Keun Kim, Zackory Erickson, Wendy A. Rogers, Charles C. Kemp

    Abstract: Eating is an essential activity of daily living (ADL) for staying healthy and living at home independently. Although numerous assistive devices have been introduced, many people with disabilities are still restricted from independent eating due to the devices' physical or perceptual limitations. In this work, we present a new meal-assistance system and evaluations of this system with people with m… ▽ More

    Submitted 16 September, 2019; v1 submitted 6 April, 2019; originally announced April 2019.

  35. arXiv:1904.02111  [pdf, other

    cs.RO

    Multidimensional Capacitive Sensing for Robot-Assisted Dressing and Bathing

    Authors: Zackory Erickson, Henry M. Clever, Vamsee Gangaram, Greg Turk, C. Karen Liu, Charles C. Kemp

    Abstract: Robotic assistance presents an opportunity to benefit the lives of many people with physical disabilities, yet accurately sensing the human body and tracking human motion remain difficult for robots. We present a multidimensional capacitive sensing technique that estimates the local pose of a human limb in real time. A key benefit of this sensing method is that it can sense the limb through opaque… ▽ More

    Submitted 24 May, 2019; v1 submitted 3 April, 2019; originally announced April 2019.

    Comments: 8 pages, 16 figures, International Conference on Rehabilitation Robotics 2019

  36. arXiv:1808.03353  [pdf, other

    cs.CL

    Efficient human-like semantic representations via the Information Bottleneck principle

    Authors: Noga Zaslavsky, Charles Kemp, Terry Regier, Naftali Tishby

    Abstract: Maintaining efficient semantic representations of the environment is a major challenge both for humans and for machines. While human languages represent useful solutions to this problem, it is not yet clear what computational principle could give rise to similar solutions in machines. In this work we propose an answer to this open question. We suggest that languages compress percepts into words by… ▽ More

    Submitted 9 August, 2018; originally announced August 2018.

    Journal ref: Cognitively Informed Artificial Intelligence Workshop at NIPS 2017

  37. arXiv:1805.06165  [pdf, other

    cs.CL

    Color naming reflects both perceptual structure and communicative need

    Authors: Noga Zaslavsky, Charles Kemp, Naftali Tishby, Terry Regier

    Abstract: Gibson et al. (2017) argued that color naming is shaped by patterns of communicative need. In support of this claim, they showed that color naming systems across languages support more precise communication about warm colors than cool colors, and that the objects we talk about tend to be warm-colored rather than cool-colored. Here, we present new analyses that alter this picture. We show that grea… ▽ More

    Submitted 2 August, 2018; v1 submitted 16 May, 2018; originally announced May 2018.

    Journal ref: Proceedings of the 40th Annual Conference of the Cognitive Science Society (pp. 1250 - 1255), 2018

  38. arXiv:1805.04051  [pdf, other

    cs.RO stat.ML

    Classification of Household Materials via Spectroscopy

    Authors: Zackory Erickson, Nathan Luskey, Sonia Chernova, Charles C. Kemp

    Abstract: Recognizing an object's material can inform a robot on the object's fragility or appropriate use. To estimate an object's material during manipulation, many prior works have explored the use of haptic sensing. In this paper, we explore a technique for robots to estimate the materials of objects using spectroscopy. We demonstrate that spectrometers provide several benefits for material recognition,… ▽ More

    Submitted 6 January, 2019; v1 submitted 10 May, 2018; originally announced May 2018.

    Comments: 8 pages, 15 figures, 1 table

  39. arXiv:1804.07873  [pdf, other

    cs.RO cs.CV

    3D Human Pose Estimation on a Configurable Bed from a Pressure Image

    Authors: Henry M. Clever, Ariel Kapusta, Daehyung Park, Zackory Erickson, Yash Chitalia, Charles C. Kemp

    Abstract: Robots have the potential to assist people in bed, such as in healthcare settings, yet bedding materials like sheets and blankets can make observation of the human body difficult for robots. A pressure-sensing mat on a bed can provide pressure images that are relatively insensitive to bedding materials. However, prior work on estimating human pose from pressure images has been restricted to 2D pos… ▽ More

    Submitted 29 August, 2018; v1 submitted 20 April, 2018; originally announced April 2018.

    Comments: 8 pages, 10 figures

  40. arXiv:1804.07328  [pdf, other

    cs.RO

    Task-centric Optimization of Configurations for Assistive Robots

    Authors: Ariel Kapusta, Charles C. Kemp

    Abstract: Robots can provide assistance to a human by moving objects to locations around the person's body. With a well chosen initial configuration, a robot can better reach locations important to an assistive task despite model error, pose uncertainty and other sources of variation. However, finding effective configurations can be challenging due to complex geometry, a large number of degrees of freedom,… ▽ More

    Submitted 19 April, 2018; originally announced April 2018.

    Comments: 21 pages, 14 figures, submitted to Autonomous Robots journal by Springer

  41. In-home and remote use of robotic body surrogates by people with profound motor deficits

    Authors: Phillip M. Grice, Charles C. Kemp

    Abstract: By controlling robots comparable to the human body, people with profound motor deficits could potentially perform a variety of physical tasks for themselves, improving their quality of life. The extent to which this is achievable has been unclear due to the lack of suitable interfaces by which to control robotic body surrogates and a dearth of studies involving substantial numbers of people with p… ▽ More

    Submitted 21 March, 2019; v1 submitted 4 March, 2018; originally announced March 2018.

    Comments: 43 Pages, 13 Figures

    Journal ref: PLoS ONE 14(3): e0212904 (2019)

  42. arXiv:1711.01490  [pdf, other

    cs.RO

    Analyzing Material Recognition Performance of Thermal Tactile Sensing using a Large Materials Database and a Real Robot

    Authors: Haoping Bai, Haofeng Chen, Elizabeth Healy, Charles C. Kemp, Tapomayukh Bhattacharjee

    Abstract: In this paper we focus on analyzing the thermal modality of tactile sensing for material recognition using a large materials database. Many factors affect thermal recognition performance, including sensor noise, the initial temperatures of the sensor and the object, the thermal effusivities of the materials, and the duration of contact. To analyze the influence of these factors on thermal recognit… ▽ More

    Submitted 1 November, 2022; v1 submitted 4 November, 2017; originally announced November 2017.

    Comments: Published in IEEE ROBIO 2022

  43. arXiv:1711.00614  [pdf, other

    cs.RO cs.LG

    A Multimodal Anomaly Detector for Robot-Assisted Feeding Using an LSTM-based Variational Autoencoder

    Authors: Daehyung Park, Yuuna Hoshi, Charles C. Kemp

    Abstract: The detection of anomalous executions is valuable for reducing potential hazards in assistive manipulation. Multimodal sensory signals can be helpful for detecting a wide range of anomalies. However, the fusion of high-dimensional and heterogeneous modalities is a challenging problem. We introduce a long short-term memory based variational autoencoder (LSTM-VAE) that fuses signals and reconstructs… ▽ More

    Submitted 2 November, 2017; originally announced November 2017.

    Comments: 8 pages, under review

  44. arXiv:1709.09735  [pdf, other

    cs.RO cs.AI stat.ML

    Deep Haptic Model Predictive Control for Robot-Assisted Dressing

    Authors: Zackory Erickson, Henry M. Clever, Greg Turk, C. Karen Liu, Charles C. Kemp

    Abstract: Robot-assisted dressing offers an opportunity to benefit the lives of many people with disabilities, such as some older adults. However, robots currently lack common sense about the physical implications of their actions on people. The physical implications of dressing are complicated by non-rigid garments, which can result in a robot indirectly applying high forces to a person's body. We present… ▽ More

    Submitted 24 May, 2019; v1 submitted 27 September, 2017; originally announced September 2017.

    Comments: 8 pages, 12 figures, 1 table, 2018 IEEE International Conference on Robotics and Automation (ICRA)

  45. Tracking Human Pose During Robot-Assisted Dressing using Single-Axis Capacitive Proximity Sensing

    Authors: Zackory Erickson, Maggie Collier, Ariel Kapusta, Charles C. Kemp

    Abstract: Dressing is a fundamental task of everyday living and robots offer an opportunity to assist people with motor impairments. While several robotic systems have explored robot-assisted dressing, few have considered how a robot can manage errors in human pose estimation, or adapt to human motion in real time during dressing assistance. In addition, estimating pose changes due to human motion can be ch… ▽ More

    Submitted 24 May, 2019; v1 submitted 22 September, 2017; originally announced September 2017.

    Comments: 8 pages, 13 figures, 2018 IEEE Robotics and Automation Letters (RA-L)

  46. arXiv:1709.07033  [pdf, other

    cs.RO

    Learning Human Behaviors for Robot-Assisted Dressing

    Authors: Alexander Clegg, Wenhao Yu, Jie Tan, Charlie C. Kemp, Greg Turk, C. Karen Liu

    Abstract: We investigate robotic assistants for dressing that can anticipate the motion of the person who is being helped. To this end, we use reinforcement learning to create models of human behavior during assistance with dressing. To explore this kind of interaction, we assume that the robot presents an open sleeve of a hospital gown to a person, and that the person moves their arm into the sleeve. The c… ▽ More

    Submitted 20 September, 2017; originally announced September 2017.

    Comments: 8 pages, 9 figures

  47. arXiv:1707.02796  [pdf, other

    cs.RO cs.LG stat.ML

    Semi-Supervised Haptic Material Recognition for Robots using Generative Adversarial Networks

    Authors: Zackory Erickson, Sonia Chernova, Charles C. Kemp

    Abstract: Material recognition enables robots to incorporate knowledge of material properties into their interactions with everyday objects. For example, material recognition opens up opportunities for clearer communication with a robot, such as "bring me the metal coffee mug", and recognizing plastic versus metal is crucial when using a microwave or oven. However, collecting labeled training data with a ro… ▽ More

    Submitted 26 October, 2017; v1 submitted 10 July, 2017; originally announced July 2017.

    Comments: 11 pages, 6 figures, 6 tables, 1st Conference on Robot Learning (CoRL 2017)

    Journal ref: PMLR 78:157-166 (2017)

  48. arXiv:1605.07996  [pdf, other

    cs.RO

    Towards Assistive Feeding with a General-Purpose Mobile Manipulator

    Authors: Daehyung Park, You Keun Kim, Zackory M. Erickson, Charles C. Kemp

    Abstract: General-purpose mobile manipulators have the potential to serve as a versatile form of assistive technology. However, their complexity creates challenges, including the risk of being too difficult to use. We present a proof-of-concept robotic system for assistive feeding that consists of a Willow Garage PR2, a high-level web-based interface, and specialized autonomous behaviors for scooping and fe… ▽ More

    Submitted 25 May, 2016; originally announced May 2016.

    Comments: This short 4-page paper was accepted and presented as a poster on May. 16, 2016 in ICRA 2016 workshop on 'Human-Robot Interfaces for Enhanced Physical Interactions' organized by Arash Ajoudani, Barkan Ugurlu, Panagiotis Artemiadis, Jun Morimoto. It was peer reviewed by one reviewer

    Journal ref: ICRA2016 workshop on Human-Robot Interfaces for Enhanced Physical Interactions, 2016

  49. arXiv:1511.03152  [pdf, other

    cs.RO

    A Handheld Device for the In Situ Acquisition of Multimodal Tactile Sensing Data

    Authors: Joshua Wade, Tapomayukh Bhattacharjee, Charles C. Kemp

    Abstract: Multimodal tactile sensing could potentially enable robots to improve their performance at manipulation tasks by rapidly discriminating between task-relevant objects. Data-driven approaches to this tactile perception problem show promise, but there is a dearth of suitable training data. In this two-page paper, we present a portable handheld device for the efficient acquisition of multimodal tactil… ▽ More

    Submitted 12 November, 2015; v1 submitted 10 November, 2015; originally announced November 2015.

    Comments: This short 2-page paper was accepted and presented as a poster (https://goo.gl/8TqDTK) on Sep. 28, 2015 in IROS 2015 Workshop on 'See and Touch: 1st Workshop on multimodal sensor-based robot control for HRI and soft manipulation" organized by A. Cherubini, Y. Mezouar, D. Navarro-Alarcon, M. Prats, and J. A. Corrales Ramon. It was peer reviewed by 2 reviewers

  50. arXiv:1409.4972  [pdf, other

    cs.RO

    Inferring Object Properties with a Tactile Sensing Array Given Varying Joint Stiffness and Velocity

    Authors: Tapomayukh Bhattacharjee, James M. Rehg, Charles C. Kemp

    Abstract: Whole-arm tactile sensing enables a robot to sense contact and infer contact properties across its entire arm. Within this paper, we demonstrate that using data-driven methods, a humanoid robot can infer mechanical properties of objects from contact with its forearm during a simple reaching motion. A key issue is the extent to which the performance of data-driven methods can generalize to robot ac… ▽ More

    Submitted 4 November, 2017; v1 submitted 17 September, 2014; originally announced September 2014.

    Comments: This updated version [v2] was accepted to the International Journal of Humanoid Robotics, Special Issue on Tactile Sensing for Manipulation : New Progress and Challenges