-
Exploring Keyboard Positioning and Ten-Finger Typing in Mixed Reality
Authors:
Cecilia Schmitz,
Joshua Reynolds,
Scott Kuhl,
Keith Vertanen
Abstract:
Accuracy and speed are pivotal when typing. Mixed reality typing is typically performed by typing on a midair keyboard with your index fingers. This deprives users of both the tactile feedback available on physical devices and the ability to press keys with the most convenient finger. Our first experiment investigated providing tactile feedback by positioning the virtual keyboard on a table or wal…
▽ More
Accuracy and speed are pivotal when typing. Mixed reality typing is typically performed by typing on a midair keyboard with your index fingers. This deprives users of both the tactile feedback available on physical devices and the ability to press keys with the most convenient finger. Our first experiment investigated providing tactile feedback by positioning the virtual keyboard on a table or wall. The keyboard was deterministic (without auto-correct), supported mixed case typing with symbols, and relied only on the hand-tracking provided by a commodity headset's egocentric cameras. Users preferred and had the highest entry rate of 12 words-per-minute using a midair keyboard. Error rates were similar in all conditions. Our second experiment explored ten-finger typing and used a novel eye-tracking technique to avoid accidental key presses. This technique was preferred for ten-finger typing and halved corrections. However, participants were faster using their index fingers without eye-tracking at 11 words-per-minute.
△ Less
Submitted 28 July, 2025; v1 submitted 5 October, 2024;
originally announced October 2024.
-
Experimental Investigation of Machine Learning based Soft-Failure Management using the Optical Spectrum
Authors:
Lars E. Kruse,
Sebastian Kühl,
Annika Dochhan,
Stephan Pachnicke
Abstract:
The demand for high-speed data is exponentially growing. To conquer this, optical networks underwent significant changes getting more complex and versatile. The increasing complexity necessitates the fault management to be more adaptive to enhance network assurance. In this paper, we experimentally compare the performance of soft-failure management of different machine learning algorithms. We furt…
▽ More
The demand for high-speed data is exponentially growing. To conquer this, optical networks underwent significant changes getting more complex and versatile. The increasing complexity necessitates the fault management to be more adaptive to enhance network assurance. In this paper, we experimentally compare the performance of soft-failure management of different machine learning algorithms. We further introduce a machine-learning based soft-failure management framework. It utilizes a variational autoencoder based generative adversarial network (VAE-GAN) running on optical spectral data obtained by optical spectrum analyzers. The framework is able to reliably run on a fraction of available training data as well as identifying unknown failure types. The investigations show, that the VAE-GAN outperforms the other machine learning algorithms when up to 10\% of the total training data is available in identification tasks. Furthermore, the advanced training mechanism for the GAN shows a high F1-score for unknown spectrum identification. The failure localization comparison shows the advantage of a low complexity neural network in combination with a VAE over established machine learning algorithms.
△ Less
Submitted 12 December, 2023;
originally announced December 2023.
-
SOCRATES: A Stereo Camera Trap for Monitoring of Biodiversity
Authors:
Timm Haucke,
Hjalmar S. Kühl,
Volker Steinhage
Abstract:
The development and application of modern technology is an essential basis for the efficient monitoring of species in natural habitats and landscapes to trace the development of ecosystems, species communities, and populations, and to analyze reasons of changes. For estimating animal abundance using methods such as camera trap distance sampling, spatial information of natural habitats in terms of…
▽ More
The development and application of modern technology is an essential basis for the efficient monitoring of species in natural habitats and landscapes to trace the development of ecosystems, species communities, and populations, and to analyze reasons of changes. For estimating animal abundance using methods such as camera trap distance sampling, spatial information of natural habitats in terms of 3D (three-dimensional) measurements is crucial. Additionally, 3D information improves the accuracy of animal detection using camera trapping. This study presents a novel approach to 3D camera trapping featuring highly optimized hardware and software. This approach employs stereo vision to infer 3D information of natural habitats and is designated as StereO CameRA Trap for monitoring of biodivErSity (SOCRATES). A comprehensive evaluation of SOCRATES shows not only a $3.23\%$ improvement in animal detection (bounding box $\text{mAP}_{75}$) but also its superior applicability for estimating animal abundance using camera trap distance sampling. The software and documentation of SOCRATES is provided at https://github.com/timmh/socrates
△ Less
Submitted 13 October, 2022; v1 submitted 19 September, 2022;
originally announced September 2022.
-
Compensating class imbalance for acoustic chimpanzee detection with convolutional recurrent neural networks
Authors:
Franz Anders,
Ammie K. Kalan,
Hjalmar S. Kühl,
Mirco Fuchs
Abstract:
Automatic detection systems are important in passive acoustic monitoring (PAM) systems, as these record large amounts of audio data which are infeasible for humans to evaluate manually. In this paper we evaluated methods for compensating class imbalance for deep-learning based automatic detection of acoustic chimpanzee calls. The prevalence of chimpanzee calls in natural habitats is very rare, i.e…
▽ More
Automatic detection systems are important in passive acoustic monitoring (PAM) systems, as these record large amounts of audio data which are infeasible for humans to evaluate manually. In this paper we evaluated methods for compensating class imbalance for deep-learning based automatic detection of acoustic chimpanzee calls. The prevalence of chimpanzee calls in natural habitats is very rare, i.e. databases feature a heavy imbalance between background and target calls. Such imbalances can have negative effects on classifier performances. We employed a state-of-the-art detection approach based on convolutional recurrent neural networks (CRNNs). We extended the detection pipeline through various stages for compensating class imbalance. These included (1) spectrogram denoising, (2) alternative loss functions, and (3) resampling. Our key findings are: (1) spectrogram denoising operations significantly improved performance for both target classes, (2) standard binary cross entropy reached the highest performance, and (3) manipulating relative class imbalance through resampling either decreased or maintained performance depending on the target class. Finally, we reached detection performances of 33% for drumming and 5% for vocalization, which is a >7 fold increase compared to previously published results. We conclude that supporting the network to learn decoupling noise conditions from foreground classes is of primary importance for increasing performance.
△ Less
Submitted 26 May, 2021;
originally announced May 2021.
-
Overcoming the Distance Estimation Bottleneck in Estimating Animal Abundance with Camera Traps
Authors:
Timm Haucke,
Hjalmar S. Kühl,
Jacqueline Hoyer,
Volker Steinhage
Abstract:
The biodiversity crisis is still accelerating, despite increasing efforts by the international community. Estimating animal abundance is of critical importance to assess, for example, the consequences of land-use change and invasive species on community composition, or the effectiveness of conservation interventions. Various approaches have been developed to estimate abundance of unmarked animal p…
▽ More
The biodiversity crisis is still accelerating, despite increasing efforts by the international community. Estimating animal abundance is of critical importance to assess, for example, the consequences of land-use change and invasive species on community composition, or the effectiveness of conservation interventions. Various approaches have been developed to estimate abundance of unmarked animal populations. Whereas these approaches differ in methodological details, they all require the estimation of the effective area surveyed in front of a camera trap. Until now camera-to-animal distance measurements are derived by laborious, manual and subjective estimation methods. To overcome this distance estimation bottleneck, this study proposes an automatized pipeline utilizing monocular depth estimation and depth image calibration methods. We are able to reduce the manual effort required by a factor greater than 21 and provide our system at https://timm.haucke.xyz/publications/distance-estimation-animal-abundance
△ Less
Submitted 22 December, 2021; v1 submitted 10 May, 2021;
originally announced May 2021.
