-
Automatic Tissue Differentiation in Parotidectomy using Hyperspectral Imaging
Authors:
Eric L. Wisotzky,
Alexander Schill,
Anna Hilsmann,
Peter Eisert,
Michael Knoke
Abstract:
In head and neck surgery, continuous intraoperative tissue differentiation is of great importance to avoid injury to sensitive structures such as nerves and vessels. Hyperspectral imaging (HSI) with neural network analysis could support the surgeon in tissue differentiation. A 3D Convolutional Neural Network with hyperspectral data in the range of $400-1000$ nm is used in this work. The acquisitio…
▽ More
In head and neck surgery, continuous intraoperative tissue differentiation is of great importance to avoid injury to sensitive structures such as nerves and vessels. Hyperspectral imaging (HSI) with neural network analysis could support the surgeon in tissue differentiation. A 3D Convolutional Neural Network with hyperspectral data in the range of $400-1000$ nm is used in this work. The acquisition system consisted of two multispectral snapshot cameras creating a stereo-HSI-system. For the analysis, 27 images with annotations of glandular tissue, nerve, muscle, skin and vein in 18 patients undergoing parotidectomy are included. Three patients are removed for evaluation following the leave-one-subject-out principle. The remaining images are used for training, with the data randomly divided into a training group and a validation group. In the validation, an overall accuracy of $98.7\%$ is achieved, indicating robust training. In the evaluation on the excluded patients, an overall accuracy of $83.4\%$ has been achieved showing good detection and identification abilities. The results clearly show that it is possible to achieve robust intraoperative tissue differentiation using hyperspectral imaging. Especially the high sensitivity in parotid or nerve tissue is of clinical importance. It is interesting to note that vein was often confused with muscle. This requires further analysis and shows that a very good and comprehensive data basis is essential. This is a major challenge, especially in surgery.
△ Less
Submitted 6 December, 2024;
originally announced December 2024.
-
This Paper Had the Smartest Reviewers -- Flattery Detection Utilising an Audio-Textual Transformer-Based Approach
Authors:
Lukas Christ,
Shahin Amiriparian,
Friederike Hawighorst,
Ann-Kathrin Schill,
Angelo Boutalikakis,
Lorenz Graf-Vlachy,
Andreas König,
Björn W. Schuller
Abstract:
Flattery is an important aspect of human communication that facilitates social bonding, shapes perceptions, and influences behavior through strategic compliments and praise, leveraging the power of speech to build rapport effectively. Its automatic detection can thus enhance the naturalness of human-AI interactions. To meet this need, we present a novel audio textual dataset comprising 20 hours of…
▽ More
Flattery is an important aspect of human communication that facilitates social bonding, shapes perceptions, and influences behavior through strategic compliments and praise, leveraging the power of speech to build rapport effectively. Its automatic detection can thus enhance the naturalness of human-AI interactions. To meet this need, we present a novel audio textual dataset comprising 20 hours of speech and train machine learning models for automatic flattery detection. In particular, we employ pretrained AST, Wav2Vec2, and Whisper models for the speech modality, and Whisper TTS models combined with a RoBERTa text classifier for the textual modality. Subsequently, we build a multimodal classifier by combining text and audio representations. Evaluation on unseen test data demonstrates promising results, with Unweighted Average Recall scores reaching 82.46% in audio-only experiments, 85.97% in text-only experiments, and 87.16% using a multimodal approach.
△ Less
Submitted 25 June, 2024;
originally announced June 2024.
-
Operating the Cloud from Inside Out
Authors:
Josef Spillner,
Andrii Chaichenko,
Andrey Brito,
Francisco Brasileiro,
Alexander Schill
Abstract:
Virtual machine images and instances (VMs) in cloud computing centres are typically designed as isolation containers for applications, databases and networking functions. In order to build complex distributed applications, multiple virtual machines must be connected, orchestrated and combined with platform and infrastructure services from the hosting environment. There are several reasons why some…
▽ More
Virtual machine images and instances (VMs) in cloud computing centres are typically designed as isolation containers for applications, databases and networking functions. In order to build complex distributed applications, multiple virtual machines must be connected, orchestrated and combined with platform and infrastructure services from the hosting environment. There are several reasons why sometimes it is beneficial to introduce a new layer, Cloud-in-a-VM, which acts as a portable management interface to a cluster of VMs. We reason about the benefits and present our Cloud-in-a-VM implementation called Nested Cloud which allows consumers to become light-weight cloud operators on demand and reap multiple advantages, including fully utilised resource allocations. The practical usefulness and the performance of the intermediate cloud stack VM are evaluated in a marketplace scenario.
△ Less
Submitted 21 September, 2013;
originally announced September 2013.
-
π-Control: A Personal Cloud Control Centre
Authors:
Josef Spillner,
Alexander Schill
Abstract:
Consumption of online services and cloud computing offerings is on the rise, largely due to compelling advantages over traditional local applications. From a user perspective, these include zero-maintenance of software, the always-on nature of such services, mashups of different applications and the networking effect with other users. Associated disadvantages are known, but effective means and too…
▽ More
Consumption of online services and cloud computing offerings is on the rise, largely due to compelling advantages over traditional local applications. From a user perspective, these include zero-maintenance of software, the always-on nature of such services, mashups of different applications and the networking effect with other users. Associated disadvantages are known, but effective means and tools to limit their effect are not yet well-established and not yet generally available to service users. We propose (1) a user-centric model of cloud elements beyond the conventional <SPI>aaS layers, including activities across trust zones, and (2) a personal control console for all individual and collaborative user activities in the cloud.
△ Less
Submitted 5 February, 2012;
originally announced February 2012.
