-
A Framework for Multimodal Medical Image Interaction
Authors:
Laura Schütz,
Sasan Matinfar,
Gideon Schafroth,
Navid Navab,
Merle Fairhurst,
Arthur Wagner,
Benedikt Wiestler,
Ulrich Eck,
Nassir Navab
Abstract:
Medical doctors rely on images of the human anatomy, such as magnetic resonance imaging (MRI), to localize regions of interest in the patient during diagnosis and treatment. Despite advances in medical imaging technology, the information conveyance remains unimodal. This visual representation fails to capture the complexity of the real, multisensory interaction with human tissue. However, perceivi…
▽ More
Medical doctors rely on images of the human anatomy, such as magnetic resonance imaging (MRI), to localize regions of interest in the patient during diagnosis and treatment. Despite advances in medical imaging technology, the information conveyance remains unimodal. This visual representation fails to capture the complexity of the real, multisensory interaction with human tissue. However, perceiving multimodal information about the patient's anatomy and disease in real-time is critical for the success of medical procedures and patient outcome. We introduce a Multimodal Medical Image Interaction (MMII) framework to allow medical experts a dynamic, audiovisual interaction with human tissue in three-dimensional space. In a virtual reality environment, the user receives physically informed audiovisual feedback to improve the spatial perception of anatomical structures. MMII uses a model-based sonification approach to generate sounds derived from the geometry and physical properties of tissue, thereby eliminating the need for hand-crafted sound design. Two user studies involving 34 general and nine clinical experts were conducted to evaluate the proposed interaction framework's learnability, usability, and accuracy. Our results showed excellent learnability of audiovisual correspondence as the rate of correct associations significantly improved (p < 0.001) over the course of the study. MMII resulted in superior brain tumor localization accuracy (p < 0.05) compared to conventional medical image interaction. Our findings substantiate the potential of this novel framework to enhance interaction with medical images, for example, during surgical procedures where immediate and precise feedback is needed.
△ Less
Submitted 9 July, 2024;
originally announced July 2024.
-
Interactive Shape Sonification for Tumor Localization in Breast Cancer Surgery
Authors:
Laura Schütz,
Trishia El Chemaly,
Emmanuelle Weber,
Anh Thien Doan,
Jacqueline Tsai,
Christoph Leuze,
Bruce Daniel,
Nassir Navab
Abstract:
About 20 percent of patients undergoing breast-conserving surgery require reoperation due to cancerous tissue remaining inside the breast. Breast cancer localization systems utilize auditory feedback to convey the distance between a localization probe and a small marker (seed) implanted into the breast tumor prior to surgery. However, no information on the location of the tumor margin is provided.…
▽ More
About 20 percent of patients undergoing breast-conserving surgery require reoperation due to cancerous tissue remaining inside the breast. Breast cancer localization systems utilize auditory feedback to convey the distance between a localization probe and a small marker (seed) implanted into the breast tumor prior to surgery. However, no information on the location of the tumor margin is provided. To reduce the reoperation rate by improving the usability and accuracy of the surgical task, we developed an auditory display using shape sonification to assist with tumor margin localization. Accuracy and usability of the interactive shape sonification were determined on models of the female breast in three user studies with both breast surgeons and non-clinical participants. The comparative studies showed a significant increase in usability (p<0.05) and localization accuracy (p<0.001) of the shape sonification over the auditory feedback currently used in surgery.
△ Less
Submitted 28 January, 2024; v1 submitted 26 December, 2023;
originally announced December 2023.
-
Community-developed checklists for publishing images and image analysis
Authors:
Christopher Schmied,
Michael Nelson,
Sergiy Avilov,
Gert-Jan Bakker,
Cristina Bertocchi,
Johanna Bischof,
Ulrike Boehm,
Jan Brocher,
Mariana Carvalho,
Catalin Chiritescu,
Jana Christopher,
Beth Cimini,
Eduardo Conde-Sousa,
Michael Ebner,
Rupert Ecker,
Kevin Eliceiri,
Julia Fernandez-Rodriguez,
Nathalie Gaudreault,
Laurent Gelman,
David Grunwald,
Tingting Gu,
Nadia Halidi,
Mathias Hammer,
Matthew Hartley,
Marie Held
, et al. (29 additional authors not shown)
Abstract:
Images document scientific discoveries and are prevalent in modern biomedical research. Microscopy imaging in particular is currently undergoing rapid technological advancements. However for scientists wishing to publish the obtained images and image analyses results, there are to date no unified guidelines. Consequently, microscopy images and image data in publications may be unclear or difficult…
▽ More
Images document scientific discoveries and are prevalent in modern biomedical research. Microscopy imaging in particular is currently undergoing rapid technological advancements. However for scientists wishing to publish the obtained images and image analyses results, there are to date no unified guidelines. Consequently, microscopy images and image data in publications may be unclear or difficult to interpret. Here we present community-developed checklists for preparing light microscopy images and image analysis for publications. These checklists offer authors, readers, and publishers key recommendations for image formatting and annotation, color selection, data availability, and for reporting image analysis workflows. The goal of our guidelines is to increase the clarity and reproducibility of image figures and thereby heighten the quality of microscopy data is in publications.
△ Less
Submitted 14 September, 2023; v1 submitted 14 February, 2023;
originally announced February 2023.
-
QUAREP-LiMi: A community-driven initiative to establish guidelines for quality assessment and reproducibility for instruments and images in light microscopy
Authors:
Glyn Nelson,
Ulrike Boehm,
Steve Bagley,
Peter Bajcsy,
Johanna Bischof,
Claire M Brown,
Aurelien Dauphin,
Ian M Dobbie,
John E Eriksson,
Orestis Faklaris,
Julia Fernandez-Rodriguez,
Alexia Ferrand,
Laurent Gelman,
Ali Gheisari,
Hella Hartmann,
Christian Kukat,
Alex Laude,
Miso Mitkovski,
Sebastian Munck,
Alison J North,
Tobias M Rasse,
Ute Resch-Genger,
Lucas C Schuetz,
Arne Seitz,
Caterina Strambio-De-Castillia
, et al. (75 additional authors not shown)
Abstract:
In April 2020, the QUality Assessment and REProducibility for Instruments and Images in Light Microscopy (QUAREP-LiMi) initiative was formed. This initiative comprises imaging scientists from academia and industry who share a common interest in achieving a better understanding of the performance and limitations of microscopes and improved quality control (QC) in light microscopy. The ultimate goal…
▽ More
In April 2020, the QUality Assessment and REProducibility for Instruments and Images in Light Microscopy (QUAREP-LiMi) initiative was formed. This initiative comprises imaging scientists from academia and industry who share a common interest in achieving a better understanding of the performance and limitations of microscopes and improved quality control (QC) in light microscopy. The ultimate goal of the QUAREP-LiMi initiative is to establish a set of common QC standards, guidelines, metadata models, and tools, including detailed protocols, with the ultimate aim of improving reproducible advances in scientific research. This White Paper 1) summarizes the major obstacles identified in the field that motivated the launch of the QUAREP-LiMi initiative; 2) identifies the urgent need to address these obstacles in a grassroots manner, through a community of stakeholders including, researchers, imaging scientists, bioimage analysts, bioimage informatics developers, corporate partners, funding agencies, standards organizations, scientific publishers, and observers of such; 3) outlines the current actions of the QUAREP-LiMi initiative, and 4) proposes future steps that can be taken to improve the dissemination and acceptance of the proposed guidelines to manage QC. To summarize, the principal goal of the QUAREP-LiMi initiative is to improve the overall quality and reproducibility of light microscope image data by introducing broadly accepted standard practices and accurately captured image data metrics.
△ Less
Submitted 27 January, 2021; v1 submitted 21 January, 2021;
originally announced January 2021.
-
On the supnorm form of Leray's problem for the incompressible Navier-Stokes equations
Authors:
Lineia Schutz,
Janaína P. Zingano,
Paulo R. Zingano
Abstract:
We show that t^{3/4}|| u(.,t) ||_{sup} --> 0 as t --> infty for all (global) Leray solutions of the incompressible Navier-Stokes equations in R3. It is also shown that t || u(.,t) - v(.,t) ||_{sup} --> 0 as t --> infty, where v(.,t) is the Stokes approximation, as well as other fundamental results. In spite of the difficulty of these questions, our approach is elementary and is based on standard t…
▽ More
We show that t^{3/4}|| u(.,t) ||_{sup} --> 0 as t --> infty for all (global) Leray solutions of the incompressible Navier-Stokes equations in R3. It is also shown that t || u(.,t) - v(.,t) ||_{sup} --> 0 as t --> infty, where v(.,t) is the Stokes approximation, as well as other fundamental results. In spite of the difficulty of these questions, our approach is elementary and is based on standard tools like conventional Fourier and energy methods.
△ Less
Submitted 30 June, 2018;
originally announced July 2018.
-
Sharp pointwise estimates for functions in the Sobolev spaces Hs(Rn)
Authors:
Lineia Schutz,
Juliana S. Ziebel,
Janaina P. Zingano,
Paulo R. Zingano
Abstract:
We obtain the optimal value of the constant K(n,s) in the Sobolev-Nirenberg-Gagliardo inequality $ \|\,u\,\|_{L^{\infty}(\mathbb{R}^{n})} \leq K(n,s) \,\|\, u \,\|_{L^{2}(\mathbb{R}^{n})}^{1 - n/(2s)} \|\, u \,\|_{\dot{H}^{s}(\mathbb{R}^{n})}^{n/(2s)} $ where $ s > n/2 $.
We obtain the optimal value of the constant K(n,s) in the Sobolev-Nirenberg-Gagliardo inequality $ \|\,u\,\|_{L^{\infty}(\mathbb{R}^{n})} \leq K(n,s) \,\|\, u \,\|_{L^{2}(\mathbb{R}^{n})}^{1 - n/(2s)} \|\, u \,\|_{\dot{H}^{s}(\mathbb{R}^{n})}^{n/(2s)} $ where $ s > n/2 $.
△ Less
Submitted 4 February, 2016;
originally announced February 2016.
-
On the Blow-up Criterion of Magnetohydrodynamics Equations in Homogeneous Sobolev Spaces
Authors:
Diego Marcon,
Wilberclay G. Melo,
Lineia Schutz,
Juliana S. Ziebell
Abstract:
In this paper, we obtain new lower bounds on the Homogeneous Sobolev--norms of the maximal solution of the Magnetohydrodynamics Equations. This gives us some insight on the blow-up behavior of the solution. We utilize standard techniques from the Navier--Stokes Equations.
In this paper, we obtain new lower bounds on the Homogeneous Sobolev--norms of the maximal solution of the Magnetohydrodynamics Equations. This gives us some insight on the blow-up behavior of the solution. We utilize standard techniques from the Navier--Stokes Equations.
△ Less
Submitted 3 June, 2015;
originally announced June 2015.
