Skip to main content

Showing 1–10 of 10 results for author: Mascaro, E V

Searching in archive cs. Search in all archives.
.
  1. arXiv:2409.10308  [pdf, other

    cs.RO cs.AI

    Know your limits! Optimize the robot's behavior through self-awareness

    Authors: Esteve Valls Mascaro, Dongheui Lee

    Abstract: As humanoid robots transition from labs to real-world environments, it is essential to democratize robot control for non-expert users. Recent human-robot imitation algorithms focus on following a reference human motion with high precision, but they are susceptible to the quality of the reference motion and require the human operator to simplify its movements to match the robot's capabilities. Inst… ▽ More

    Submitted 16 October, 2024; v1 submitted 16 September, 2024; originally announced September 2024.

    Comments: Accepted to Humanoids 2024 and HFR 2024. Project Page: https://evm7.github.io/Self-AWare

  2. arXiv:2405.08726  [pdf, other

    cs.RO cs.AI

    I-CTRL: Imitation to Control Humanoid Robots Through Constrained Reinforcement Learning

    Authors: Yashuai Yan, Esteve Valls Mascaro, Tobias Egle, Dongheui Lee

    Abstract: Humanoid robots have the potential to mimic human motions with high visual fidelity, yet translating these motions into practical, physical execution remains a significant challenge. Existing techniques in the graphics community often prioritize visual fidelity over physics-based feasibility, posing a significant challenge for deploying bipedal systems in practical applications. This paper address… ▽ More

    Submitted 17 February, 2025; v1 submitted 14 May, 2024; originally announced May 2024.

  3. arXiv:2402.04768  [pdf, other

    cs.RO cs.CV cs.HC

    Robot Interaction Behavior Generation based on Social Motion Forecasting for Human-Robot Interaction

    Authors: Esteve Valls Mascaro, Yashuai Yan, Dongheui Lee

    Abstract: Integrating robots into populated environments is a complex challenge that requires an understanding of human social dynamics. In this work, we propose to model social motion forecasting in a shared human-robot representation space, which facilitates us to synthesize robot motions that interact with humans in social scenarios despite not observing any robot in the motion training. We develop a tra… ▽ More

    Submitted 8 April, 2024; v1 submitted 7 February, 2024; originally announced February 2024.

    Comments: Accepted at ICRA 2024. Webpage: https://evm7.github.io/ECHO/

  4. arXiv:2309.16524  [pdf, other

    cs.CV cs.RO

    HOI4ABOT: Human-Object Interaction Anticipation for Human Intention Reading Collaborative roBOTs

    Authors: Esteve Valls Mascaro, Daniel Sliwowski, Dongheui Lee

    Abstract: Robots are becoming increasingly integrated into our lives, assisting us in various tasks. To ensure effective collaboration between humans and robots, it is essential that they understand our intentions and anticipate our actions. In this paper, we propose a Human-Object Interaction (HOI) anticipation framework for collaborative robots. We propose an efficient and robust transformer-based model t… ▽ More

    Submitted 8 April, 2024; v1 submitted 28 September, 2023; originally announced September 2023.

    Comments: Proceedings in Conference on Robot Learning 2023. Webpage: https://evm7.github.io/HOI4ABOT_page/

  5. arXiv:2309.05310  [pdf, other

    cs.RO cs.AI

    ImitationNet: Unsupervised Human-to-Robot Motion Retargeting via Shared Latent Space

    Authors: Yashuai Yan, Esteve Valls Mascaro, Dongheui Lee

    Abstract: This paper introduces a novel deep-learning approach for human-to-robot motion retargeting, enabling robots to mimic human poses accurately. Contrary to prior deep-learning-based works, our method does not require paired human-to-robot data, which facilitates its translation to new robots. First, we construct a shared latent space between humans and robots via adaptive contrastive learning that ta… ▽ More

    Submitted 8 April, 2024; v1 submitted 11 September, 2023; originally announced September 2023.

    Comments: Accepted to Humanoids 2023. Website: https://evm7.github.io/UnsH2R/

  6. arXiv:2308.07301  [pdf, other

    cs.CV cs.GR cs.RO

    A Unified Masked Autoencoder with Patchified Skeletons for Motion Synthesis

    Authors: Esteve Valls Mascaro, Hyemin Ahn, Dongheui Lee

    Abstract: The synthesis of human motion has traditionally been addressed through task-dependent models that focus on specific challenges, such as predicting future motions or filling in intermediate poses conditioned on known key-poses. In this paper, we present a novel task-independent model called UNIMASK-M, which can effectively address these challenges using a unified architecture. Our model obtains com… ▽ More

    Submitted 8 April, 2024; v1 submitted 14 August, 2023; originally announced August 2023.

    Comments: Accepted to AAAI2024. Webpage: https://evm7.github.io/UNIMASKM-page/

  7. Human-Object Interaction Prediction in Videos through Gaze Following

    Authors: Zhifan Ni, Esteve Valls MascarĂ³, Hyemin Ahn, Dongheui Lee

    Abstract: Understanding the human-object interactions (HOIs) from a video is essential to fully comprehend a visual scene. This line of research has been addressed by detecting HOIs from images and lately from videos. However, the video-based HOI anticipation task in the third-person view remains understudied. In this paper, we design a framework to detect current HOIs and anticipate future HOIs in videos.… ▽ More

    Submitted 6 June, 2023; originally announced June 2023.

    Comments: Accepted by CVIU https://doi.org/10.1016/j.cviu.2023.103741

  8. arXiv:2302.14503  [pdf, other

    cs.CV cs.AI

    Can We Use Diffusion Probabilistic Models for 3D Motion Prediction?

    Authors: Hyemin Ahn, Esteve Valls Mascaro, Dongheui Lee

    Abstract: After many researchers observed fruitfulness from the recent diffusion probabilistic model, its effectiveness in image generation is actively studied these days. In this paper, our objective is to evaluate the potential of diffusion probabilistic models for 3D human motion-related tasks. To this end, this paper presents a study of employing diffusion probabilistic models to predict future 3D human… ▽ More

    Submitted 28 February, 2023; originally announced February 2023.

    Comments: 7 pages, 3 figures, ICRA 2023

  9. Robust Human Motion Forecasting using Transformer-based Model

    Authors: Esteve Valls Mascaro, Shuo Ma, Hyemin Ahn, Dongheui Lee

    Abstract: Comprehending human motion is a fundamental challenge for developing Human-Robot Collaborative applications. Computer vision researchers have addressed this field by only focusing on reducing error in predictions, but not taking into account the requirements to facilitate its implementation in robots. In this paper, we propose a new model based on Transformer that simultaneously deals with the rea… ▽ More

    Submitted 8 April, 2024; v1 submitted 16 February, 2023; originally announced February 2023.

    Comments: Accepted to IROS2022. Webpage: https://evm7.github.io/2CHTR-page/

    Journal ref: 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

  10. arXiv:2207.12080  [pdf, other

    cs.CV

    Intention-Conditioned Long-Term Human Egocentric Action Forecasting

    Authors: Esteve Valls Mascaro, Hyemin Ahn, Dongheui Lee

    Abstract: To anticipate how a human would act in the future, it is essential to understand the human intention since it guides the human towards a certain goal. In this paper, we propose a hierarchical architecture which assumes a sequence of human action (low-level) can be driven from the human intention (high-level). Based on this, we deal with Long-Term Action Anticipation task in egocentric videos. Our… ▽ More

    Submitted 8 April, 2024; v1 submitted 25 July, 2022; originally announced July 2022.

    Comments: Winner of CVPR@2022 and ECCV@2022 EGO4D LTA Challenge. Accepted in WACV2023. Webpage: https://evm7.github.io/icvae-page/