-
Seamless Augmented Reality Integration in Arthroscopy: A Pipeline for Articular Reconstruction and Guidance
Authors:
Hongchao Shu,
Mingxu Liu,
Lalithkumar Seenivasan,
Suxi Gu,
Ping-Cheng Ku,
Jonathan Knopf,
Russell Taylor,
Mathias Unberath
Abstract:
Arthroscopy is a minimally invasive surgical procedure used to diagnose and treat joint problems. The clinical workflow of arthroscopy typically involves inserting an arthroscope into the joint through a small incision, during which surgeons navigate and operate largely by relying on their visual assessment through the arthroscope. However, the arthroscope's restricted field of view and lack of de…
▽ More
Arthroscopy is a minimally invasive surgical procedure used to diagnose and treat joint problems. The clinical workflow of arthroscopy typically involves inserting an arthroscope into the joint through a small incision, during which surgeons navigate and operate largely by relying on their visual assessment through the arthroscope. However, the arthroscope's restricted field of view and lack of depth perception pose challenges in navigating complex articular structures and achieving surgical precision during procedures. Aiming at enhancing intraoperative awareness, we present a robust pipeline that incorporates simultaneous localization and mapping, depth estimation, and 3D Gaussian splatting to realistically reconstruct intra-articular structures solely based on monocular arthroscope video. Extending 3D reconstruction to Augmented Reality (AR) applications, our solution offers AR assistance for articular notch measurement and annotation anchoring in a human-in-the-loop manner. Compared to traditional Structure-from-Motion and Neural Radiance Field-based methods, our pipeline achieves dense 3D reconstruction and competitive rendering fidelity with explicit 3D representation in 7 minutes on average. When evaluated on four phantom datasets, our method achieves RMSE = 2.21mm reconstruction error, PSNR = 32.86 and SSIM = 0.89 on average. Because our pipeline enables AR reconstruction and guidance directly from monocular arthroscopy without any additional data and/or hardware, our solution may hold the potential for enhancing intraoperative awareness and facilitating surgical precision in arthroscopy. Our AR measurement tool achieves accuracy within 1.59 +/- 1.81mm and the AR annotation tool achieves a mIoU of 0.721.
△ Less
Submitted 1 October, 2024;
originally announced October 2024.
-
MITHOS: Interactive Mixed Reality Training to Support Professional Socio-Emotional Interactions at Schools
Authors:
Lara Chehayeb,
Chirag Bhuvaneshwara,
Manuel Anglet,
Bernhard Hilpert,
Ann-Kristin Meyer,
Dimitra Tsovaltzi,
Patrick Gebhard,
Antje Biermann,
Sinah Auchtor,
Nils Lauinger,
Julia Knopf,
Andreas Kaiser,
Fabian Kersting,
Gregor Mehlmann,
Florian Lingenfelser,
Elisabeth André
Abstract:
Teachers in challenging conflict situations often experience shame and self-blame, which relate to the feeling of incompetence but may externalise as anger. Sensing mixed signals fails the contingency rule for developing affect regulation and may result in confusion for students about their own emotions and hinder their emotion regulation. Therefore, being able to constructively regulate emotions…
▽ More
Teachers in challenging conflict situations often experience shame and self-blame, which relate to the feeling of incompetence but may externalise as anger. Sensing mixed signals fails the contingency rule for developing affect regulation and may result in confusion for students about their own emotions and hinder their emotion regulation. Therefore, being able to constructively regulate emotions not only benefits individual experience of emotions but also fosters effective interpersonal emotion regulation and influences how a situation is managed. MITHOS is a system aimed at training teachers' conflict resolution skills through realistic situative learning opportunities during classroom conflicts. In four stages, MITHOS supports teachers' socio-emotional self-awareness, perspective-taking and positive regard. It provides: a) a safe virtual environment to train free social interaction and receive natural social feedback from reciprocal student-agent reactions, b) spatial situational perspective taking through an avatar, c) individual virtual reflection guidance on emotional experiences through co-regulation processes, and d) expert feedback on professional behavioural strategies. This chapter presents the four stages and their implementation in a semi-automatic Wizard-of-Oz (WoZ) System. The WoZ system affords collecting data that are used for developing the fully automated hybrid (machine learning and model-based) system, and to validate the underlying psychological and conflict resolution models. We present results validating the approach in terms of scenario realism, as well as a systematic testing of the effects of external avatar similarity on antecedents of self-awareness with behavior similarity. The chapter contributes to a common methodology of conducting interdisciplinary research for human-centered and generalisable XR and presents a system designed to support it.
△ Less
Submitted 2 September, 2024;
originally announced September 2024.
-
DEPFET active pixel detectors for a future linear $e^+e^-$ collider
Authors:
O. Alonso,
R. Casanova,
A. Dieguez,
J. Dingfelder,
T. Hemperek,
T. Kishishita amd T. Kleinohl,
M. Koch,
H. Krueger,
M. Lemarenko,
F. Luetticke,
C. Marinas,
M. Schnell,
N. Wermes,
A. Campbell,
T. Ferber,
C. Kleinwort,
C. Niebuhr,
Y. Soloviev,
M. Steder,
R. Volkenborn,
S. Yaschenko,
P. Fischer,
C. Kreidl,
I. Peric,
J. Knopf
, et al. (62 additional authors not shown)
Abstract:
The DEPFET collaboration develops highly granular, ultra-transparent active pixel detectors for high-performance vertex reconstruction at future collider experiments. The characterization of detector prototypes has proven that the key principle, the integration of a first amplification stage in a detector-grade sensor material, can provide a comfortable signal to noise ratio of over 40 for a senso…
▽ More
The DEPFET collaboration develops highly granular, ultra-transparent active pixel detectors for high-performance vertex reconstruction at future collider experiments. The characterization of detector prototypes has proven that the key principle, the integration of a first amplification stage in a detector-grade sensor material, can provide a comfortable signal to noise ratio of over 40 for a sensor thickness of 50-75 $\mathrm{\mathbf{μm}}$. ASICs have been designed and produced to operate a DEPFET pixel detector with the required read-out speed. A complete detector concept is being developed, including solutions for mechanical support, cooling and services. In this paper the status of DEPFET R & D project is reviewed in the light of the requirements of the vertex detector at a future linear $\mathbf{e^+ e^-}$ collider.
△ Less
Submitted 10 December, 2012;
originally announced December 2012.
-
Belle II Technical Design Report
Authors:
T. Abe,
I. Adachi,
K. Adamczyk,
S. Ahn,
H. Aihara,
K. Akai,
M. Aloi,
L. Andricek,
K. Aoki,
Y. Arai,
A. Arefiev,
K. Arinstein,
Y. Arita,
D. M. Asner,
V. Aulchenko,
T. Aushev,
T. Aziz,
A. M. Bakich,
V. Balagura,
Y. Ban,
E. Barberio,
T. Barvich,
K. Belous,
T. Bergauer,
V. Bhardwaj
, et al. (387 additional authors not shown)
Abstract:
The Belle detector at the KEKB electron-positron collider has collected almost 1 billion Y(4S) events in its decade of operation. Super-KEKB, an upgrade of KEKB is under construction, to increase the luminosity by two orders of magnitude during a three-year shutdown, with an ultimate goal of 8E35 /cm^2 /s luminosity. To exploit the increased luminosity, an upgrade of the Belle detector has been pr…
▽ More
The Belle detector at the KEKB electron-positron collider has collected almost 1 billion Y(4S) events in its decade of operation. Super-KEKB, an upgrade of KEKB is under construction, to increase the luminosity by two orders of magnitude during a three-year shutdown, with an ultimate goal of 8E35 /cm^2 /s luminosity. To exploit the increased luminosity, an upgrade of the Belle detector has been proposed. A new international collaboration Belle-II, is being formed. The Technical Design Report presents physics motivation, basic methods of the accelerator upgrade, as well as key improvements of the detector.
△ Less
Submitted 1 November, 2010;
originally announced November 2010.
-
Roadmap for selected key measurements of LHCb
Authors:
The LHCb Collaboration,
B. Adeva,
M. Adinolfi,
A. Affolder,
Z. Ajaltouni,
J. Albrecht,
F. Alessio,
M. Alexander,
P. Alvarez Cartelle,
A. A. Alves Jr,
S. Amato,
Y. Amhis,
J. Amoraal,
J. Anderson,
O. Aquines Gutierrez,
L. Arrabito,
M. Artuso,
E. Aslanides,
G. Auriemma,
S. Bachmann,
Y. Bagaturia,
D. S. Bailey,
V. Balagura,
W. Baldini,
MdC. Barandela Pazos
, et al. (487 additional authors not shown)
Abstract:
Six of the key physics measurements that will be made by the LHCb experiment, concerning CP asymmetries and rare B decays, are discussed in detail. The "road map" towards the precision measurements is presented, including the use of control channels and other techniques to understand the performance of the detector with the first data from the LHC.
Six of the key physics measurements that will be made by the LHCb experiment, concerning CP asymmetries and rare B decays, are discussed in detail. The "road map" towards the precision measurements is presented, including the use of control channels and other techniques to understand the performance of the detector with the first data from the LHC.
△ Less
Submitted 23 November, 2010; v1 submitted 18 December, 2009;
originally announced December 2009.
