-
RoboCup@Home 2024 OPL Winner NimbRo: Anthropomorphic Service Robots using Foundation Models for Perception and Planning
Authors:
Raphael Memmesheimer,
Jan Nogga,
Bastian Pätzold,
Evgenii Kruzhkov,
Simon Bultmann,
Michael Schreiber,
Jonas Bode,
Bertan Karacora,
Juhui Park,
Alena Savinykh,
Sven Behnke
Abstract:
We present the approaches and contributions of the winning team NimbRo@Home at the RoboCup@Home 2024 competition in the Open Platform League held in Eindhoven, NL. Further, we describe our hardware setup and give an overview of the results for the task stages and the final demonstration. For this year's competition, we put a special emphasis on open-vocabulary object segmentation and grasping appr…
▽ More
We present the approaches and contributions of the winning team NimbRo@Home at the RoboCup@Home 2024 competition in the Open Platform League held in Eindhoven, NL. Further, we describe our hardware setup and give an overview of the results for the task stages and the final demonstration. For this year's competition, we put a special emphasis on open-vocabulary object segmentation and grasping approaches that overcome the labeling overhead of supervised vision approaches, commonly used in RoboCup@Home. We successfully demonstrated that we can segment and grasp non-labeled objects by text descriptions. Further, we extensively employed LLMs for natural language understanding and task planning. Throughout the competition, our approaches showed robustness and generalization capabilities. A video of our performance can be found online.
△ Less
Submitted 19 December, 2024;
originally announced December 2024.
-
A Comparison of Prompt Engineering Techniques for Task Planning and Execution in Service Robotics
Authors:
Jonas Bode,
Bastian Pätzold,
Raphael Memmesheimer,
Sven Behnke
Abstract:
Recent advances in LLM have been instrumental in autonomous robot control and human-robot interaction by leveraging their vast general knowledge and capabilities to understand and reason across a wide range of tasks and scenarios. Previous works have investigated various prompt engineering techniques for improving the performance of LLM to accomplish tasks, while others have proposed methods that…
▽ More
Recent advances in LLM have been instrumental in autonomous robot control and human-robot interaction by leveraging their vast general knowledge and capabilities to understand and reason across a wide range of tasks and scenarios. Previous works have investigated various prompt engineering techniques for improving the performance of LLM to accomplish tasks, while others have proposed methods that utilize LLMs to plan and execute tasks based on the available functionalities of a given robot platform. In this work, we consider both lines of research by comparing prompt engineering techniques and combinations thereof within the application of high-level task planning and execution in service robotics. We define a diverse set of tasks and a simple set of functionalities in simulation, and measure task completion accuracy and execution time for several state-of-the-art models.
△ Less
Submitted 6 November, 2024; v1 submitted 30 October, 2024;
originally announced October 2024.
-
Privacy-Preserving Sharing of Data Analytics Runtime Metrics for Performance Modeling
Authors:
Jonathan Will,
Dominik Scheinert,
Jan Bode,
Cedric Kring,
Seraphin Zunzer,
Lauritz Thamsen
Abstract:
Performance modeling for large-scale data analytics workloads can improve the efficiency of cluster resource allocations and job scheduling. However, the performance of these workloads is influenced by numerous factors, such as job inputs and the assigned cluster resources. As a result, performance models require significant amounts of training data. This data can be obtained by exchanging runtime…
▽ More
Performance modeling for large-scale data analytics workloads can improve the efficiency of cluster resource allocations and job scheduling. However, the performance of these workloads is influenced by numerous factors, such as job inputs and the assigned cluster resources. As a result, performance models require significant amounts of training data. This data can be obtained by exchanging runtime metrics between collaborating organizations. Yet, not all organizations may be inclined to publicly disclose such metadata.
We present a privacy-preserving approach for sharing runtime metrics based on differential privacy and data synthesis. Our evaluation on performance data from 736 Spark job executions indicates that fully anonymized training data largely maintains performance prediction accuracy, particularly when there is minimal original data available. With 30 or fewer available original data samples, the use of synthetic training data resulted only in a one percent reduction in performance model accuracy on average.
△ Less
Submitted 13 March, 2024; v1 submitted 8 March, 2024;
originally announced March 2024.
-
Towards Avoiding the Data Mess: Industry Insights from Data Mesh Implementations
Authors:
Jan Bode,
Niklas Kühl,
Dominik Kreuzberger,
Sebastian Hirschl,
Carsten Holtmann
Abstract:
With the increasing importance of data and artificial intelligence, organizations strive to become more data-driven. However, current data architectures are not necessarily designed to keep up with the scale and scope of data and analytics use cases. In fact, existing architectures often fail to deliver the promised value associated with them. Data mesh is a socio-technical, decentralized, distrib…
▽ More
With the increasing importance of data and artificial intelligence, organizations strive to become more data-driven. However, current data architectures are not necessarily designed to keep up with the scale and scope of data and analytics use cases. In fact, existing architectures often fail to deliver the promised value associated with them. Data mesh is a socio-technical, decentralized, distributed concept for enterprise data management. As the concept of data mesh is still novel, it lacks empirical insights from the field. Specifically, an understanding of the motivational factors for introducing data mesh, the associated challenges, implementation strategies, its business impact, and potential archetypes is missing. To address this gap, we conduct 15 semi-structured interviews with industry experts. Our results show, among other insights, that organizations have difficulties with the transition toward federated governance associated with the data mesh concept, the shift of responsibility for the development, provision, and maintenance of data products, and the comprehension of the overall concept. In our work, we derive multiple implementation strategies and suggest organizations introduce a cross-domain steering unit, observe the data product usage, create quick wins in the early phases, and favor small dedicated teams that prioritize data products. While we acknowledge that organizations need to apply implementation strategies according to their individual needs, we also deduct two archetypes that provide suggestions in more detail. Our findings synthesize insights from industry experts and provide researchers and professionals with preliminary guidelines for the successful adoption of data mesh.
△ Less
Submitted 6 June, 2024; v1 submitted 3 February, 2023;
originally announced February 2023.
-
Size and shape of Chariklo from multi-epoch stellar occultations
Authors:
R Leiva,
B Sicardy,
J I B Camargo,
J -L Ortiz,
J Desmars,
D Bérard,
E Lellouch,
E Meza,
P Kervella,
C Snodgrass,
R Duffard,
N Morales,
A R Gomes-Júnior,
G Benedetti-Rossi,
R Vieira-Martins,
F Braga-Ribas,
M Assafin,
B E Morgado,
F Colas,
C De Witt,
A A Sickafoose,
H Breytenbach,
J -L Dauvergne,
P Schoenau,
L Maquet
, et al. (6 additional authors not shown)
Abstract:
We use data from five stellar occultations observed between 2013 and 2016 to constrain Chariklo's size and shape, and the ring reflectivity. We consider four possible models for Chariklo (sphere, Maclaurin spheroid, tri-axial ellipsoid and Jacobi ellipsoid) and we use a Bayesian approach to estimate the corresponding parameters. The spherical model has a radius $R=129\pm3$ km. The Maclaurin model…
▽ More
We use data from five stellar occultations observed between 2013 and 2016 to constrain Chariklo's size and shape, and the ring reflectivity. We consider four possible models for Chariklo (sphere, Maclaurin spheroid, tri-axial ellipsoid and Jacobi ellipsoid) and we use a Bayesian approach to estimate the corresponding parameters. The spherical model has a radius $R=129\pm3$ km. The Maclaurin model has equatorial and polar radii $a=b=143^{+3}_{-6}$ km and $c=96^{+14}_{-4}$ km, respectively, with density $970^{+300}_{-180}$ kg m$^{-3}$. The ellipsoidal model has semiaxes $a=148^{+6}_{-4}$ km, $b=132^{+6}_{-5}$ km and $c=102^{+10}_{-8}$ km. Finally, the Jacobi model has semiaxes $a$=157$\pm$4 km, $b$=139$\pm$ 4 km and $c$=86$\pm$1 km, and density $796^{+2}_{-4}$ kg m$^{-3}$ . Depending on the model, we obtain topographic features of 6-11 km, typical of Saturn icy satellites with similar size and density. We constrain Chariklo's geometric albedo between 3.1\% (sphere) and 4.9\% (ellipsoid), while the ring $I/F$ reflectivity is less constrained between 0.6\% (Jacobi) and 8.9\% (sphere). The ellipsoid model explains both the optical light curve and the long-term photometry variation of the system, giving a plausible value for the geometric albedo of the ring particles of $10-15\%$. The derived Chariklo's mass of 6-8$\times10^{18}$ kg places the rings close to the 3:1 resonance between the ring mean motion and Chariklo's rotation period.
△ Less
Submitted 29 August, 2017;
originally announced August 2017.
-
The structure of Chariklo's rings from stellar occultations
Authors:
D. Bérard,
B. Sicardy,
J. I. B. Camargo,
J. Desmars,
F. Braga-Ribas,
J. L. Ortiz,
R. Duffard,
N. Morales,
E. Meza,
R. Leiva,
G. Benedetti-Rossi,
R. Vieira-Martins,
A. R. Gomes-Júnior,
M. Assafin,
F. Colas,
J. L. Dauvergne,
P. Kervella,
J. Lecacheux,
L. Maquet,
F. Vachier,
S. Renner,
B. Monard,
A. A. Sickafoose,
H. Breytenbach,
A. Genade
, et al. (57 additional authors not shown)
Abstract:
Two narrow and dense rings (called C1R and C2R) were discovered around the Centaur object (10199) Chariklo during a stellar occultation observed on 2013 June 3. Following this discovery, we planned observations of several occultations by Chariklo's system in order to better characterize the physical properties of the ring and main body. Here, we use 12 successful occulations by Chariklo observed b…
▽ More
Two narrow and dense rings (called C1R and C2R) were discovered around the Centaur object (10199) Chariklo during a stellar occultation observed on 2013 June 3. Following this discovery, we planned observations of several occultations by Chariklo's system in order to better characterize the physical properties of the ring and main body. Here, we use 12 successful occulations by Chariklo observed between 2014 and 2016. They provide ring profiles (physical width, opacity, edge structure) and constraints on the radii and pole position. Our new observations are currently consistent with the circular ring solution and pole position, to within the $\pm 3.3$ km formal uncertainty for the ring radii derived by Braga-Ribas et al. The six resolved C1R profiles reveal significant width variations from $\sim 5$ to 7.5 km. The width of the fainter ring C2R is less constrained, and may vary between 0.1 and 1 km. The inner and outer edges of C1R are consistent with infinitely sharp boundaries, with typical upper limits of one kilometer for the transition zone between the ring and empty space. No constraint on the sharpness of C2R's edges is available. A 1$σ$ upper limit of $\sim 20$ m is derived for the equivalent width of narrow (physical width <4 km) rings up to distances of 12,000 km, counted in the ring plane.
△ Less
Submitted 18 September, 2017; v1 submitted 1 June, 2017;
originally announced June 2017.
-
Simultaneous Multi-Harmonic Imaging of Nanoparticles in Tissues for Increased Selectivity
Authors:
Andrii Rogov,
Marie Irondelle,
Fernanda Ramos-Gomes,
Julia Bode,
Davide Staedler,
Solène Passemard,
Sébastien Courvoisier,
Yasuaki Yamamoto,
François Waharte,
Daniel Ciepielewski,
Philippe Rideau,
Sandrine Gerber-Lemaire,
Frauke Alves,
Jean Salamero,
Luigi Bonacina,
Jean-Pierre Wolf
Abstract:
We investigate the use of Bismuth Ferrite (BFO) nanoparticles for tumor tissue labelling in combination with infrared multi-photon excitation at 1250 nm. We report the efficient and simultaneous generation of second and third harmonic by the nanoparticles. On this basis, we set up a novel imaging protocol based on the co-localization of the two harmonic signals and demonstrate its benefits in term…
▽ More
We investigate the use of Bismuth Ferrite (BFO) nanoparticles for tumor tissue labelling in combination with infrared multi-photon excitation at 1250 nm. We report the efficient and simultaneous generation of second and third harmonic by the nanoparticles. On this basis, we set up a novel imaging protocol based on the co-localization of the two harmonic signals and demonstrate its benefits in terms of increased selectivity against endogenous background sources in tissue samples. Finally, we discuss the use of BFO nanoparticles as mapping reference structures for correlative light-electron microscopy.
△ Less
Submitted 3 October, 2015; v1 submitted 29 October, 2014;
originally announced October 2014.
-
Production of EMRIs in Supermassive Black Hole Binaries
Authors:
J. Nate Bode,
Christopher Wegg
Abstract:
We consider the formation of extreme mass-ratio inspirals (EMRIs) sourced from a stellar cusp centred on a primary supermassive black hole (SMBH) and perturbed by an inspiraling less massive secondary SMBH. The problem is approached numerically, assuming the stars are non-interacting over these short timescales and performing an ensemble of restricted three-body integrations. From these simulation…
▽ More
We consider the formation of extreme mass-ratio inspirals (EMRIs) sourced from a stellar cusp centred on a primary supermassive black hole (SMBH) and perturbed by an inspiraling less massive secondary SMBH. The problem is approached numerically, assuming the stars are non-interacting over these short timescales and performing an ensemble of restricted three-body integrations. From these simulations we see that not only can EMRIs be produced during this process, but the dynamics are also quite rich. In particular, most of the EMRIs are produced through a process akin to the Kozai-Lidov mechanism, but with strong effects due to the non-Keplerian stellar potential, general relativity, and non-secular oscillations in the angular momentum on the orbital timescale of the binary SMBH system.
△ Less
Submitted 21 October, 2013;
originally announced October 2013.
-
Slightly Two or Three Dimensional Self-Similar Solutions
Authors:
Re'em Sari,
J. Nate Bode,
Almog Yalinewich,
Andrew MacFadyen
Abstract:
Self similarity allows for analytic or semi-analytic solutions to many hydrodynamics problems. Most of these solutions are one dimensional. Using linear perturbation theory, expanded around such a one-dimensional solution, we find self-similar hydrodynamic solutions that are two- or three-dimensional. Since the deviation from a one-dimensional solution is small, we call these slightly two-dimensio…
▽ More
Self similarity allows for analytic or semi-analytic solutions to many hydrodynamics problems. Most of these solutions are one dimensional. Using linear perturbation theory, expanded around such a one-dimensional solution, we find self-similar hydrodynamic solutions that are two- or three-dimensional. Since the deviation from a one-dimensional solution is small, we call these slightly two-dimensional and slightly three-dimensional self-similar solutions, respectively. As an example, we treat strong spherical explosions of the second type. A strong explosion propagates into an ideal gas with negligible temperature and density profile of the form rho(r,theta,phi)=r^{-omega}[1+sigma*F(theta,phi)], where omega>3 and sigma << 1. Analytical solutions are obtained by expanding the arbitrary function F(theta,phi) in spherical harmonics. We compare our results with two dimensional numerical simulations, and find good agreement.
△ Less
Submitted 15 September, 2011;
originally announced September 2011.
-
Multiple Tidal Disruptions as an Indicator of Binary Super-Massive Black Hole Systems
Authors:
Christopher Wegg,
J. Nate Bode
Abstract:
We find that the majority of systems hosting multiple tidal disruptions are likely to contain hard binary SMBH systems, and also show that the rates of these repeated events are high enough to be detected by LSST over its lifetime. Therefore, these multiple tidal disruption events provide a novel method to identify super-massive black hole (SMBH) binary systems with parsec to sub-parsec separation…
▽ More
We find that the majority of systems hosting multiple tidal disruptions are likely to contain hard binary SMBH systems, and also show that the rates of these repeated events are high enough to be detected by LSST over its lifetime. Therefore, these multiple tidal disruption events provide a novel method to identify super-massive black hole (SMBH) binary systems with parsec to sub-parsec separations. The rates of tidal disruptions are investigated using simulations of non-interacting stars initially orbiting a primary SMBH and the potential of the model stellar cusp. The stars are then evolved forward in time and perturbed by a secondary SMBH inspiraling from the edge of the cusp to its stalling radius. We find with conservative magnitude estimates that the next generation transient survey LSST should detect multiple tidal disruptions in approximately 3 galaxies over 5 years of observation, though less conservative estimates could increase this rate by an order of magnitude.
△ Less
Submitted 26 November, 2010;
originally announced November 2010.
