-
Influence of Depth Camera Noise Models on Respiration Estimation
Authors:
Maurice Rohr,
Sebastian Dill
Abstract:
Depth cameras are an interesting modality for capturing vital signs such as respiratory rate. Plenty approaches exist to extract vital signs in a controlled setting, but in order to apply them more flexibly for example in multi-camera settings, a simulated environment is needed to generate enough data for training and testing of new algorithms. We show first results of a 3D-rendering simulation pi…
▽ More
Depth cameras are an interesting modality for capturing vital signs such as respiratory rate. Plenty approaches exist to extract vital signs in a controlled setting, but in order to apply them more flexibly for example in multi-camera settings, a simulated environment is needed to generate enough data for training and testing of new algorithms. We show first results of a 3D-rendering simulation pipeline that focuses on different noise models in order to generate realistic, depth-camera based respiratory signals using both synthetic and real respiratory signals as a baseline. While most noise can be accurately modelled as Gaussian in this context, we can show that as soon as the available image resolution is too low, the differences between different noise models surface.
△ Less
Submitted 15 November, 2024;
originally announced November 2024.
-
mnmDTW: An extension to Dynamic Time Warping for Camera-based Movement Error Localization
Authors:
Sebastian Dill,
Maurice Rohr
Abstract:
In this proof of concept, we use Computer Vision (CV) methods to extract pose information out of exercise videos. We then employ a modified version of Dynamic Time Warping (DTW) to calculate the deviation from a gold standard execution of the exercise. Specifically, we calculate the distance between each body part individually to get a more precise measure for exercise accuracy. We can show that e…
▽ More
In this proof of concept, we use Computer Vision (CV) methods to extract pose information out of exercise videos. We then employ a modified version of Dynamic Time Warping (DTW) to calculate the deviation from a gold standard execution of the exercise. Specifically, we calculate the distance between each body part individually to get a more precise measure for exercise accuracy. We can show that exercise mistakes are clearly visible, identifiable and localizable through this metric.
△ Less
Submitted 13 October, 2023;
originally announced October 2023.
-
Automatic Generation of Labeled Data for Video-Based Human Pose Analysis via NLP applied to YouTube Subtitles
Authors:
Sebastian Dill,
Susi Zhihan,
Maurice Rohr,
Maziar Sharbafi,
Christoph Hoog Antink
Abstract:
With recent advancements in computer vision as well as machine learning (ML), video-based at-home exercise evaluation systems have become a popular topic of current research. However, performance depends heavily on the amount of available training data. Since labeled datasets specific to exercising are rare, we propose a method that makes use of the abundance of fitness videos available online. Sp…
▽ More
With recent advancements in computer vision as well as machine learning (ML), video-based at-home exercise evaluation systems have become a popular topic of current research. However, performance depends heavily on the amount of available training data. Since labeled datasets specific to exercising are rare, we propose a method that makes use of the abundance of fitness videos available online. Specifically, we utilize the advantage that videos often not only show the exercises, but also provide language as an additional source of information. With push-ups as an example, we show that through the analysis of subtitle data using natural language processing (NLP), it is possible to create a labeled (irrelevant, relevant correct, relevant incorrect) dataset containing relevant information for pose analysis. In particular, we show that irrelevant clips ($n=332$) have significantly different joint visibility values compared to relevant clips ($n=298$). Inspecting cluster centroids also show different poses for the different classes.
△ Less
Submitted 2 May, 2023; v1 submitted 23 March, 2023;
originally announced April 2023.
-
Active Exploitation of Redundancies in Reconfigurable Multi-Robot Systems
Authors:
Thomas M. Roehr
Abstract:
While traditional robotic systems come with a monolithic system design, reconfigurable multi-robot systems can share and shift physical resources in an on-demand fashion. Multi-robot operations can benefit from this flexibility by actively managing system redundancies depending on current tasks and having more options to respond to failure events. To support this active exploitation of redundancie…
▽ More
While traditional robotic systems come with a monolithic system design, reconfigurable multi-robot systems can share and shift physical resources in an on-demand fashion. Multi-robot operations can benefit from this flexibility by actively managing system redundancies depending on current tasks and having more options to respond to failure events. To support this active exploitation of redundancies in robotic systems, this paper details an organization model as basis for planning with reconfigurable multi-robot systems. The model allows to exploit redundancies when optimizing a multi-robot system's probability of survival with respect to a desired mission. The resulting planning approach trades safety against efficiency in robotic operations and thereby offers a new perspective and tool to design and improve multi-robot missions. We use a simulated multi-robot planetary exploration mission to evaluate this approach and highlight an exemplary performance landscape.
△ Less
Submitted 22 June, 2021;
originally announced June 2021.
-
A Development Cycle for Automated Self-Exploration of Robot Behaviors
Authors:
Thomas M. Roehr,
Daniel Harnack,
Hendrik Wöhrle,
Felix Wiebe,
Moritz Schilling,
Oscar Lima,
Malte Langosz,
Shivesh Kumar,
Sirko Straube,
Frank Kirchner
Abstract:
In this paper we introduce Q-Rock, a development cycle for the automated self-exploration and qualification of robot behaviors. With Q-Rock, we suggest a novel, integrative approach to automate robot development processes. Q-Rock combines several machine learning and reasoning techniques to deal with the increasing complexity in the design of robotic systems. The Q-Rock development cycle consists…
▽ More
In this paper we introduce Q-Rock, a development cycle for the automated self-exploration and qualification of robot behaviors. With Q-Rock, we suggest a novel, integrative approach to automate robot development processes. Q-Rock combines several machine learning and reasoning techniques to deal with the increasing complexity in the design of robotic systems. The Q-Rock development cycle consists of three complementary processes: (1) automated exploration of capabilities that a given robotic hardware provides, (2) classification and semantic annotation of these capabilities to generate more complex behaviors, and (3) mapping between application requirements and available behaviors. These processes are based on a graph-based representation of a robot's structure, including hardware and software components. A central, scalable knowledge base enables collaboration of robot designers including mechanical, electrical and systems engineers, software developers and machine learning experts. In this paper we formalize Q-Rock's integrative development cycle and highlight its benefits with a proof-of-concept implementation and a use case demonstration.
△ Less
Submitted 20 March, 2021; v1 submitted 29 July, 2020;
originally announced July 2020.
