Skip to main content
Cornell University
We gratefully acknowledge support from the Simons Foundation, member institutions, and all contributors. Donate
arxiv logo > cs > arXiv:2308.06493v2

Help | Advanced Search

arXiv logo
Cornell University Logo

quick links

  • Login
  • Help Pages
  • About

Computer Science > Computer Vision and Pattern Recognition

arXiv:2308.06493v2 (cs)
[Submitted on 12 Aug 2023 (v1), revised 17 Aug 2023 (this version, v2), latest version 6 Sep 2024 (v3)]

Title:EgoPoser: Robust Real-Time Ego-Body Pose Estimation in Large Scenes

Authors:Jiaxi Jiang, Paul Streli, Manuel Meier, Christian Holz
View a PDF of the paper titled EgoPoser: Robust Real-Time Ego-Body Pose Estimation in Large Scenes, by Jiaxi Jiang and 3 other authors
View PDF
Abstract:Full-body ego-pose estimation from head and hand poses alone has become an active area of research to power articulate avatar representation on headset-based platforms. However, existing methods over-rely on the confines of the motion-capture spaces in which datasets were recorded, while simultaneously assuming continuous capture of joint motions and uniform body dimensions. In this paper, we propose EgoPoser, which overcomes these limitations by 1) rethinking the input representation for headset-based ego-pose estimation and introducing a novel motion decomposition method that predicts full-body pose independent of global positions, 2) robustly modeling body pose from intermittent hand position and orientation tracking only when inside a headset's field of view, and 3) generalizing across various body sizes for different users. Our experiments show that EgoPoser outperforms state-of-the-art methods both qualitatively and quantitatively, while maintaining a high inference speed of over 600 fps. EgoPoser establishes a robust baseline for future work, where full-body pose estimation needs no longer rely on outside-in capture and can scale to large-scene environments.
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR); Human-Computer Interaction (cs.HC)
MSC classes: 68T07, 68T45, 68U01
ACM classes: I.2; I.3; I.4; I.5
Cite as: arXiv:2308.06493 [cs.CV]
  (or arXiv:2308.06493v2 [cs.CV] for this version)
  https://doi.org/10.48550/arXiv.2308.06493
arXiv-issued DOI via DataCite

Submission history

From: Jiaxi Jiang [view email]
[v1] Sat, 12 Aug 2023 07:46:50 UTC (7,902 KB)
[v2] Thu, 17 Aug 2023 14:50:11 UTC (7,902 KB)
[v3] Fri, 6 Sep 2024 11:28:04 UTC (6,229 KB)
Full-text links:

Access Paper:

    View a PDF of the paper titled EgoPoser: Robust Real-Time Ego-Body Pose Estimation in Large Scenes, by Jiaxi Jiang and 3 other authors
  • View PDF
  • Other Formats
view license
Current browse context:
cs.CV
< prev   |   next >
new | recent | 2023-08
Change to browse by:
cs
cs.AI
cs.GR
cs.HC

References & Citations

  • NASA ADS
  • Google Scholar
  • Semantic Scholar
a export BibTeX citation Loading...

BibTeX formatted citation

×
Data provided by:

Bookmark

BibSonomy logo Reddit logo

Bibliographic and Citation Tools

Bibliographic Explorer (What is the Explorer?)
Connected Papers (What is Connected Papers?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)

Code, Data and Media Associated with this Article

alphaXiv (What is alphaXiv?)
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Hugging Face (What is Huggingface?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)

Demos

Replicate (What is Replicate?)
Hugging Face Spaces (What is Spaces?)
TXYZ.AI (What is TXYZ.AI?)

Recommenders and Search Tools

Influence Flower (What are Influence Flowers?)
CORE Recommender (What is CORE?)
  • Author
  • Venue
  • Institution
  • Topic

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)
  • About
  • Help
  • contact arXivClick here to contact arXiv Contact
  • subscribe to arXiv mailingsClick here to subscribe Subscribe
  • Copyright
  • Privacy Policy
  • Web Accessibility Assistance
  • arXiv Operational Status
    Get status notifications via email or slack