Assessing unconstrained surgical cuttings in VR using CNNs
Authors:
Ilias Chrysovergis,
Manos Kamarianakis,
Mike Kentros,
Dimitris Angelis,
Antonis Protopsaltis,
George Papagiannakis
Abstract:
We present a Convolutional Neural Network (CNN) suitable to assess unconstrained surgical cuttings, trained on a dataset created with a data augmentation technique.
We present a Convolutional Neural Network (CNN) suitable to assess unconstrained surgical cuttings, trained on a dataset created with a data augmentation technique.
△ Less
Submitted 2 May, 2022;
originally announced May 2022.
Recording and replaying psychomotor user actions in VR
Authors:
Manos Kamarianakis,
Ilias Chrysovergis,
Mike Kentros,
George Papagiannakis
Abstract:
We introduce a novel method that describes the functionality and characteristics of an efficient VR recorder with replay capabilities, implemented in a modern game engine, publicly available for free.
We introduce a novel method that describes the functionality and characteristics of an efficient VR recorder with replay capabilities, implemented in a modern game engine, publicly available for free.
△ Less
Submitted 2 May, 2022;
originally announced May 2022.
Less Is More: Efficient Networked VR Transformation Handling Using Geometric Algebra
Authors:
Manos Kamarianakis,
Ilias Chrysovergis,
Nick Lydatakis,
Mike Kentros,
George Papagiannakis
Abstract:
As shared, collaborative, networked, virtual environments become increasingly popular, various challenges arise regarding the efficient transmission of model and scene transformation data over the network. As user immersion and real-time interactions heavily depend on VR stream synchronization, transmitting the entire data sat does not seem a suitable approach, especially for sessions involving a…
▽ More
As shared, collaborative, networked, virtual environments become increasingly popular, various challenges arise regarding the efficient transmission of model and scene transformation data over the network. As user immersion and real-time interactions heavily depend on VR stream synchronization, transmitting the entire data sat does not seem a suitable approach, especially for sessions involving a large number of users. Session recording is another momentum-gaining feature of VR applications that also faces the same challenge. The selection of a suitable data format can reduce the occupied volume, while it may also allow effective replication of the VR session and optimized post-processing for analytics and deep-learning algorithms. In this work, we propose two algorithms that can be applied in the context of a networked multiplayer VR session, to efficiently transmit the displacement and orientation data from the users' hand-based VR HMDs. Moreover, we present a novel method describing effective VR recording of the data exchanged in such a session. Our algorithms, based on the use of dual-quaternions and multivectors, impact the network consumption rate and are highly effective in scenarios involving multiple users. By sending less data over the network and interpolating the in-between frames locally, we manage to obtain better visual results than current state-of-the-art methods. Lastly, we prove that, for recording purposes, storing less data and interpolating them on-demand yields a data set quantitatively close to the original one.
△ Less
Submitted 25 July, 2022; v1 submitted 21 March, 2022;
originally announced March 2022.
