Showing 1–9 of 9 results for author: Freiwald, J

Bumpy Ride? Understanding the Effects of External Forces on Spatial Interactions in Moving Vehicles

Authors: Markus Sasalovici, Albin Zeqiri, Robin Connor Schramm, Oscar Javier Ariza Nunez, Pascal Jansen, Jann Philipp Freiwald, Mark Colley, Christian Winkler, Enrico Rukzio

Abstract: As the use of Head-Mounted Displays in moving vehicles increases, passengers can immerse themselves in visual experiences independent of their physical environment. However, interaction methods are susceptible to physical motion, leading to input errors and reduced task performance. This work investigates the impact of G-forces, vibrations, and unpredictable maneuvers on 3D interaction methods. We… ▽ More As the use of Head-Mounted Displays in moving vehicles increases, passengers can immerse themselves in visual experiences independent of their physical environment. However, interaction methods are susceptible to physical motion, leading to input errors and reduced task performance. This work investigates the impact of G-forces, vibrations, and unpredictable maneuvers on 3D interaction methods. We conducted a field study with 24 participants in both stationary and moving vehicles to examine the effects of vehicle motion on four interaction methods: (1) Gaze&Pinch, (2) DirectTouch, (3) Handray, and (4) HeadGaze. Participants performed selections in a Fitts' Law task. Our findings reveal a significant effect of vehicle motion on interaction accuracy and duration across the tested combinations of Interaction Method x Road Type x Curve Type. We found a significant impact of movement on throughput, error rate, and perceived workload. Finally, we propose future research considerations and recommendations on interaction methods during vehicle movement. △ Less

Submitted 23 February, 2025; originally announced February 2025.

Comments: to be published in CHI '25, April 26-May 1, 2025, Yokohama, Japan

Blending the Worlds: World-Fixed Visual Appearances in Automotive Augmented Reality

Authors: Robin Connor Schramm, Markus Sasalovici, Jann Philipp Freiwald, Michael Otto, Melissa Reinelt, Ulrich Schwanecke

Abstract: With the transition to fully autonomous vehicles, non-driving related tasks (NDRTs) become increasingly important, allowing passengers to use their driving time more efficiently. In-car Augmented Reality (AR) gives the possibility to engage in NDRTs while also allowing passengers to engage with their surroundings, for example, by displaying world-fixed points of interest (POIs). This can lead to n… ▽ More With the transition to fully autonomous vehicles, non-driving related tasks (NDRTs) become increasingly important, allowing passengers to use their driving time more efficiently. In-car Augmented Reality (AR) gives the possibility to engage in NDRTs while also allowing passengers to engage with their surroundings, for example, by displaying world-fixed points of interest (POIs). This can lead to new discoveries, provide information about the environment, and improve locational awareness. To explore the optimal visualization of POIs using in-car AR, we conducted a field study (N = 38) examining six parameters: positioning, scaling, rotation, render distance, information density, and appearance. We also asked for intention of use, preferred seat positions and preferred automation level for the AR function in a post-study questionnaire. Our findings reveal user preferences and general acceptance of the AR functionality. Based on these results, we derived UX-guidelines for the visual appearance and behavior of location-based POIs in in-car AR. △ Less

Submitted 12 February, 2025; originally announced February 2025.

Comments: 16 pages, 8 figures, to be published in CHI '25, April 26-May 1, 2025, Yokohama, Japan

Augmented Journeys: Interactive Points of Interest for In-Car Augmented Reality

Authors: Robin Connor Schramm, Ginevra Fedrizzi, Markus Sasalovici, Jann Philipp Freiwald, Ulrich Schwanecke

Abstract: As passengers spend more time in vehicles, the demand for non-driving related tasks (NDRTs) increases. In-car Augmented Reality (AR) has the potential to enhance passenger experiences by enabling interaction with the environment through NDRTs using world-fixed Points of Interest (POIs). However, the effectiveness of existing interaction techniques and visualization methods for in-car AR remains un… ▽ More As passengers spend more time in vehicles, the demand for non-driving related tasks (NDRTs) increases. In-car Augmented Reality (AR) has the potential to enhance passenger experiences by enabling interaction with the environment through NDRTs using world-fixed Points of Interest (POIs). However, the effectiveness of existing interaction techniques and visualization methods for in-car AR remains unclear. Based on a survey (N=110) and a pre-study (N=10), we developed an interactive in-car AR system using a video see-through head-mounted display to engage with POIs via eye-gaze and pinch. Users could explore passed and upcoming POIs using three visualization techniques: List, Timeline, and Minimap. We evaluated the system's feasibility in a field study (N=21). Our findings indicate general acceptance of the system, with the List visualization being the preferred method for exploring POIs. Additionally, the study highlights limitations of current AR hardware, particularly the impact of vehicle movement on 3D interaction. △ Less

Submitted 12 February, 2025; originally announced February 2025.

Comments: 15 pages, 10 figures, to be published in CHI '25, April 26-May 1, 2025, Yokohama, Japan

Moving Avatars and Agents in Social Extended Reality Environments

Authors: Jann Philipp Freiwald, Susanne Schmidt, Bernhard E. Riecke, Frank Steinicke

Abstract: Natural interaction between multiple users within a shared virtual environment (VE) relies on each other's awareness of the current position of the interaction partners. This, however, cannot be warranted when users employ noncontinuous locomotion techniques, such as teleportation, which may cause confusion among bystanders. In this paper, we pursue two approaches to create a pleasant experience f… ▽ More Natural interaction between multiple users within a shared virtual environment (VE) relies on each other's awareness of the current position of the interaction partners. This, however, cannot be warranted when users employ noncontinuous locomotion techniques, such as teleportation, which may cause confusion among bystanders. In this paper, we pursue two approaches to create a pleasant experience for both the moving user and the bystanders observing that movement. First, we will introduce a Smart Avatar system that delivers continuous full-body human representations for noncontinuous locomotion in shared virtual reality (VR) spaces. Smart Avatars imitate their assigned user's real-world movements when close-by and autonomously navigate to their user when the distance between them exceeds a certain threshold, i.e., after the user teleports. As part of the Smart Avatar system, we implemented four avatar transition techniques and compared them to conventional avatar locomotion in a user study, revealing significant positive effects on the observer's spatial awareness, as well as pragmatic and hedonic quality scores. Second, we introduce the concept of Stuttered Locomotion, which can be applied to any continuous locomotion method. By converting a continuous movement into short-interval teleport steps, we provide the merits of non-continuous locomotion for the moving user while observers can easily keep track of their path. Thus, while the experience for observers is similarly positive as with continuous motion, a user study confirmed that Stuttered Locomotion can significantly reduce the occurrence of cybersickness symptoms for the moving user, making it an attractive choice for shared VEs. We will discuss the potential of Smart Avatars and Stuttered Locomotion for shared VR experiences, both when applied individually and in combination. △ Less

Submitted 26 June, 2023; originally announced June 2023.

Journal ref: ACM TOG 41(6), 2022

Federated Learning in ASR: Not as Easy as You Think

Authors: Wentao Yu, Jan Freiwald, Sören Tewes, Fabien Huennemeyer, Dorothea Kolossa

Abstract: With the growing availability of smart devices and cloud services, personal speech assistance systems are increasingly used on a daily basis. Most devices redirect the voice recordings to a central server, which uses them for upgrading the recognizer model. This leads to major privacy concerns, since private data could be misused by the server or third parties. Federated learning is a decentralize… ▽ More With the growing availability of smart devices and cloud services, personal speech assistance systems are increasingly used on a daily basis. Most devices redirect the voice recordings to a central server, which uses them for upgrading the recognizer model. This leads to major privacy concerns, since private data could be misused by the server or third parties. Federated learning is a decentralized optimization strategy that has been proposed to address such concerns. Utilizing this approach, private data is used for on-device training. Afterwards, updated model parameters are sent to the server to improve the global model, which is redistributed to the clients. In this work, we implement federated learning for speech recognition in a hybrid and an end-to-end model. We discuss the outcomes of these systems, which both show great similarities and only small improvements, pointing to a need for a deeper understanding of federated learning for speech recognition. △ Less

Submitted 30 September, 2021; originally announced September 2021.

Journal ref: ITG Conference on Speech Communication, 2021

Data compression for the First G-APD Cherenkov Telescope

Authors: M. L. Ahnen, M. Balbo, M. Bergmann, A. Biland, T. Bretz, J. Buß, D. Dorner, S. Einecke, J. Freiwald, C. Hempfling, D. Hildebrand, G. Hughes, W. Lustermann, E. Lyard, K. Mannheim, K. Meier, S. Mueller, D. Neise, A. Neronov, A. -K. Overkemping, A. Paravac, F. Pauss, W. Rhode, T. Steinbring, F. Temme , et al. (5 additional authors not shown)

Abstract: The First Geiger-mode Avalanche photodiode (G-APD) Cherenkov Telescope (FACT) has been operating on the Canary island of La Palma since October 2011. Operations were automated so that the system can be operated remotely. Manual interaction is required only when the observation schedule is modified due to weather conditions or in case of unexpected events such as a mechanical failure. Automatic ope… ▽ More The First Geiger-mode Avalanche photodiode (G-APD) Cherenkov Telescope (FACT) has been operating on the Canary island of La Palma since October 2011. Operations were automated so that the system can be operated remotely. Manual interaction is required only when the observation schedule is modified due to weather conditions or in case of unexpected events such as a mechanical failure. Automatic operations enabled high data taking efficiency, which resulted in up to two terabytes of FITS files being recorded nightly and transferred from La Palma to the FACT archive at ISDC in Switzerland. Since long term storage of hundreds of terabytes of observations data is costly, data compression is mandatory. This paper discusses the design choices that were made to increase the compression ratio and speed of writing of the data with respect to existing compression algorithms. Following a more detailed motivation, the FACT compression algorithm along with the associated I/O layer is discussed. Eventually, the performances of the algorithm is compared to other approaches. △ Less

Submitted 19 June, 2015; originally announced June 2015.

Comments: 17 pages, accepted to Astronomy and Computing special issue on astronomical file formats

FACT - Monitoring Blazars at Very High Energies

Authors: D. Dorner, M. L. Ahnen, M. Bergmann, A. Biland, M. Balbo, T. Bretz, J. Buss, S. Einecke, J. Freiwald, C. Hempfling, D. Hildebrand, G. Hughes, W. Lustermann, K. Mannheim, K. Meier, S. Mueller, D. Neise, A. Neronov, A. -K. Overkemping, A. Paravac, F. Pauss, W. Rhode, T. Steinbring, F. Temme, J. Thaele , et al. (4 additional authors not shown)

Abstract: The First G-APD Cherenkov Telescope (FACT) was built on the Canary Island of La Palma in October 2011 as a proof of principle for silicon based photosensors in Cherenkov Astronomy. The scientific goal of the project is to study the variability of active galatic nuclei (AGN) at TeV energies. Observing a small sample of TeV blazars whenever possible, an unbiased data sample is collected. This allows… ▽ More The First G-APD Cherenkov Telescope (FACT) was built on the Canary Island of La Palma in October 2011 as a proof of principle for silicon based photosensors in Cherenkov Astronomy. The scientific goal of the project is to study the variability of active galatic nuclei (AGN) at TeV energies. Observing a small sample of TeV blazars whenever possible, an unbiased data sample is collected. This allows to study the variability of the selected objects on timescales from hours to years. Results from the first three years of monitoring will be presented. To provide quick flare alerts to the community and trigger multi-wavelength observations, a quick look analysis has been installed on-site providing results publicly online within the same night. In summer 2014, several flare alerts were issued. Results of the quick look analysis are summarized. △ Less

Submitted 9 February, 2015; originally announced February 2015.

Comments: 2014 Fermi Symposium proceedings - eConf C14102.1

FACT -- Operation of the First G-APD Cherenkov Telescope

Authors: T. Bretz, A. Biland, J. Buß, V. Commichau, L. Djambazov, D. Dorner, S. Einecke, D. Eisenacher, J. Freiwald, O. Grimm, H. von Gunten, C. Haller, C. Hempfling, D. Hildebrand, G. Hughes, U. Horisberger, M. L. Knoetig, T. Krähenbühl, W. Lustermann, E. Lyard, K. Mannheim, K. Meier, S. Mueller, D. Neise, A. -K. Overkemping , et al. (11 additional authors not shown)

Abstract: Since more than two years, the First G-APD Cherenkov Telescope (FACT) is operating successfully at the Canary Island of La Palma. Apart from its purpose to serve as a monitoring facility for the brightest TeV blazars, it was built as a major step to establish solid state photon counters as detectors in Cherenkov astronomy. The camera of the First G-APD Cherenkov Telesope comprises 1440 Geiger-mo… ▽ More Since more than two years, the First G-APD Cherenkov Telescope (FACT) is operating successfully at the Canary Island of La Palma. Apart from its purpose to serve as a monitoring facility for the brightest TeV blazars, it was built as a major step to establish solid state photon counters as detectors in Cherenkov astronomy. The camera of the First G-APD Cherenkov Telesope comprises 1440 Geiger-mode avalanche photo diodes (G-APD aka. MPPC or SiPM) for photon detection. Since properties as the gain of G-APDs depend on temperature and the applied voltage, a real-time feedback system has been developed and implemented. To correct for the change introduced by temperature, several sensors have been placed close to the photon detectors. Their read out is used to calculate a corresponding voltage offset. In addition to temperature changes, changing current introduces a voltage drop in the supporting resistor network. To correct changes in the voltage drop introduced by varying photon flux from the night-sky background, the current is measured and the voltage drop calculated. To check the stability of the G-APD properties, dark count spectra with high statistics have been taken under different environmental conditions and been evaluated. The maximum data rate delivered by the camera is about 240 MB/s. The recorded data, which can exceed 1 TB in a moonless night, is compressed in real-time with a proprietary loss-less algorithm. The performance is better than gzip by almost a factor of two in compression ratio and speed. In total, two to three CPU cores are needed for data taking. In parallel, a quick-look analysis of the recently recorded data is executed on a second machine. Its result is publicly available within a few minutes after the data were taken. [...] △ Less

Submitted 8 July, 2014; originally announced July 2014.

Comments: 19th IEEE Real-Time Conference, Nara, Japan (2014)

Calibration and performance of the photon sensor response of FACT -- The First G-APD Cherenkov telescope

Authors: A. Biland, T. Bretz, J. Buß, V. Commichau, L. Djambazov, D. Dorner, S. Einecke, D. Eisenacher, J. Freiwald, O. Grimm, H. von Gunten, C. Haller, C. Hempfling, D. Hildebrand, G. Hughes, U. Horisberger, M. L. Knoetig, T. Krähenbühl, W. Lustermann, E. Lyard, K. Mannheim, K. Meier, S. Mueller, D. Neise, A. -K. Overkemping , et al. (11 additional authors not shown)

Abstract: The First G-APD Cherenkov Telescope (FACT) is the first in-operation test of the performance of silicon photo detectors in Cherenkov Astronomy. For more than two years it is operated on La Palma, Canary Islands (Spain), for the purpose of long-term monitoring of astrophysical sources. For this, the performance of the photo detectors is crucial and therefore has been studied in great detail. Specia… ▽ More The First G-APD Cherenkov Telescope (FACT) is the first in-operation test of the performance of silicon photo detectors in Cherenkov Astronomy. For more than two years it is operated on La Palma, Canary Islands (Spain), for the purpose of long-term monitoring of astrophysical sources. For this, the performance of the photo detectors is crucial and therefore has been studied in great detail. Special care has been taken for their temperature and voltage dependence implementing a correction method to keep their properties stable. Several measurements have been carried out to monitor the performance. The measurements and their results are shown, demonstrating the stability of the gain below the percent level. The resulting stability of the whole system is discussed, nicely demonstrating that silicon photo detectors are perfectly suited for the usage in Cherenkov telescopes, especially for long-term monitoring purpose. △ Less

Submitted 30 July, 2014; v1 submitted 23 March, 2014; originally announced March 2014.

Journal ref: 2014 JINST 9 P10012