-
Lunar Subterra: a Self-Integrative Unit with an Automated Drilling System
Authors:
Anthony Sfeir,
Asya Petkova,
Sabine Chaaya,
Karina Chichova,
Marta Rossi,
Anna Vock,
Alessandro Mosut,
Akshayanivasini Ramasamy Saravanaraj,
Valentina Sumini,
Tommy Nilsson
Abstract:
As humans venture deeper into space, the need for a lunar settlement, housing the first group of settlers, grows steadily. By means of new technologies such as in situ resource utilisation (ISRU) as well as computational design, this goal can be implemented in present years. Providing the first arrivals with an immediate underground habitat safe from radiation and other environmental constraints i…
▽ More
As humans venture deeper into space, the need for a lunar settlement, housing the first group of settlers, grows steadily. By means of new technologies such as in situ resource utilisation (ISRU) as well as computational design, this goal can be implemented in present years. Providing the first arrivals with an immediate underground habitat safe from radiation and other environmental constraints is of crucial importance to initialise a prolonged mission on the Moon. The project's proposal revolves around the idea of establishing a base which provides an immediately habitable space with the possibility for future expansion. Advanced construction methods and sustainable practices lay the groundwork for a permanent human presence, predominantly based on ISRU. This paper outlines a two-phase initiative aimed at the foundation of the Lunar Subterra, followed by an extension of the habitat above ground. Following our collaboration with the PoliSpace Sparc Student Association group, a Virtual Reality (VR) reproduction of the proposed habitat enabled quick iterative testing of the habitable space with the use of a Meta Quest 2 headset. This not only allowed an evaluation of the environment and its impact on human residents but also eradicated the need for tangible models to conceptualise the idea, enabling rapid user-centred design and implementation in the future of space exploration.
△ Less
Submitted 22 October, 2024;
originally announced October 2024.
-
Towards a Reliable Offline Personal AI Assistant for Long Duration Spaceflight
Authors:
Oliver Bensch,
Leonie Bensch,
Tommy Nilsson,
Florian Saling,
Wafa M. Sadri,
Carsten Hartmann,
Tobias Hecking,
J. Nathan Kutz
Abstract:
As humanity prepares for new missions to the Moon and Mars, astronauts will need to operate with greater autonomy, given the communication delays that make real-time support from Earth difficult. For instance, messages between Mars and Earth can take up to 24 minutes, making quick responses impossible. This limitation poses a challenge for astronauts who must rely on in-situ tools to access the la…
▽ More
As humanity prepares for new missions to the Moon and Mars, astronauts will need to operate with greater autonomy, given the communication delays that make real-time support from Earth difficult. For instance, messages between Mars and Earth can take up to 24 minutes, making quick responses impossible. This limitation poses a challenge for astronauts who must rely on in-situ tools to access the large volume of data from spacecraft sensors, rovers, and satellites, data that is often fragmented and difficult to use. To bridge this gap, systems like the Mars Exploration Telemetry-Driven Information System (METIS) are being developed. METIS is an AI assistant designed to handle routine tasks, monitor spacecraft systems, and detect anomalies, all while reducing the reliance on mission control. Current Generative Pretrained Transformer (GPT) Models, while powerful, struggle in safety-critical environments. They can generate plausible but incorrect responses, a phenomenon known as "hallucination," which could endanger astronauts. To overcome these limitations, this paper proposes enhancing systems like METIS by integrating GPTs, Retrieval-Augmented Generation (RAG), Knowledge Graphs (KGs), and Augmented Reality (AR). The idea is to allow astronauts to interact with their data more intuitively, using natural language queries and visualizing real-time information through AR. KGs will be used to easily access live telemetry and multimodal data, ensuring that astronauts have the right information at the right time. By combining AI, KGs, and AR, this new system will empower astronauts to work more autonomously, safely, and efficiently during future space missions.
△ Less
Submitted 21 October, 2024;
originally announced October 2024.
-
Testing and validation of innovative eXtended Reality technologies for astronaut training in a partial-gravity parabolic flight campaign
Authors:
Florian Saling,
Andrea Emanuele Maria Casini,
Andreas Treuer,
Martial Costantini,
Leonie Bensch,
Tommy Nilsson,
Lionel Ferra
Abstract:
The use of eXtended Reality (XR) technologies in the space domain has increased significantly over the past few years as it can offer many advantages when simulating complex and challenging environments. Space agencies are currently using these disruptive tools to train astronauts for Extravehicular Activities (EVAs), to test equipment and procedures, and to assess spacecraft and hardware designs.…
▽ More
The use of eXtended Reality (XR) technologies in the space domain has increased significantly over the past few years as it can offer many advantages when simulating complex and challenging environments. Space agencies are currently using these disruptive tools to train astronauts for Extravehicular Activities (EVAs), to test equipment and procedures, and to assess spacecraft and hardware designs. With the Moon being the current focus of the next generation of space exploration missions, simulating its harsh environment is one of the key areas where XR can be applied, particularly for astronaut training. Peculiar lunar lighting conditions in combination with reduced gravity levels will highly impact human locomotion especially for movements such as walking, jumping, and running. In order to execute operations on the lunar surface and to safely live on the Moon for an extended period of time, innovative training methodologies and tools such as XR are becoming paramount to perform pre-mission validation and certification. This research work presents the findings of the experiments aimed at exploring the integration of XR technology and parabolic flight activities for astronaut training. In addition, the study aims to consolidate these findings into a set of guidelines that can assist future researchers who wish to incorporate XR technology into lunar training and preparation activities, including the use of such XR tools during long duration missions.
△ Less
Submitted 18 October, 2024;
originally announced October 2024.
-
AI Assistants for Spaceflight Procedures: Combining Generative Pre-Trained Transformer and Retrieval-Augmented Generation on Knowledge Graphs With Augmented Reality Cues
Authors:
Oliver Bensch,
Leonie Bensch,
Tommy Nilsson,
Florian Saling,
Bernd Bewer,
Sophie Jentzsch,
Tobias Hecking,
J. Nathan Kutz
Abstract:
This paper describes the capabilities and potential of the intelligent personal assistant (IPA) CORE (Checklist Organizer for Research and Exploration), designed to support astronauts during procedures onboard the International Space Station (ISS), the Lunar Gateway station, and beyond. We reflect on the importance of a reliable and flexible assistant capable of offline operation and highlight the…
▽ More
This paper describes the capabilities and potential of the intelligent personal assistant (IPA) CORE (Checklist Organizer for Research and Exploration), designed to support astronauts during procedures onboard the International Space Station (ISS), the Lunar Gateway station, and beyond. We reflect on the importance of a reliable and flexible assistant capable of offline operation and highlight the usefulness of audiovisual interaction using augmented reality elements to intuitively display checklist information. We argue that current approaches to the design of IPAs in space operations fall short of meeting these criteria. Therefore, we propose CORE as an assistant that combines Knowledge Graphs (KGs), Retrieval-Augmented Generation (RAG) for a Generative Pre-Trained Transformer (GPT), and Augmented Reality (AR) elements to ensure an intuitive understanding of procedure steps, reliability, offline availability, and flexibility in terms of response style and procedure updates.
△ Less
Submitted 21 September, 2024;
originally announced September 2024.
-
Applied User Research in Virtual Reality: Tools, Methods, and Challenges
Authors:
Leonie Bensch,
Andrea Casini,
Aidan Cowley,
Florian Dufresne,
Enrico Guerra,
Paul de Medeiros,
Tommy Nilsson,
Flavie Rometsch,
Andreas Treuer,
Anna Vock
Abstract:
This chapter explores the practice of conducting user research studies and design assessments in virtual reality (VR). An overview of key VR hardware and software tools is provided, including game engines, such as Unity and Unreal Engine. Qualitative and quantitative research methods, along with their various synergies with VR, are likewise discussed, and some of the challenges associated with VR,…
▽ More
This chapter explores the practice of conducting user research studies and design assessments in virtual reality (VR). An overview of key VR hardware and software tools is provided, including game engines, such as Unity and Unreal Engine. Qualitative and quantitative research methods, along with their various synergies with VR, are likewise discussed, and some of the challenges associated with VR, such as limited sensory stimulation, are reflected upon. VR is proving particularly useful in the context of space systems development, where its utilisation offers a cost-effective and secure method for simulating extraterrestrial environments, allowing for rapid prototyping and evaluation of innovative concepts under representative operational conditions. To illustrate this, we present a case study detailing the application of VR to aid aerospace engineers testing their ideas with end-users and stakeholders during early design stages of the European Space Agency's (ESA) prospective Argonaut lunar lander. This case study demonstrates the effectiveness of VR simulations in gathering important feedback concerning the operability of the Argonaut lander in poor lighting conditions as well as surfacing relevant ergonomics considerations and constraints. The chapter concludes by discussing the strengths and weaknesses associated with VR-based user studies and proposes future research directions, emphasising the necessity for novel VR interfaces to overcome existing technical limitations.
△ Less
Submitted 23 February, 2024;
originally announced February 2024.
-
Touching the Moon: Leveraging Passive Haptics, Embodiment and Presence for Operational Assessments in Virtual Reality
Authors:
Florian Dufresne,
Tommy Nilsson,
Geoffrey Gorisse,
Enrico Guerra,
André Zenner,
Olivier Christmann,
Leonie Bensch,
Nikolai Anton Callus,
Aidan Cowley
Abstract:
Space agencies are in the process of drawing up carefully thought-out Concepts of Operations (ConOps) for future human missions on the Moon. These are typically assessed and validated through costly and logistically demanding analogue field studies. While interactive simulations in Virtual Reality (VR) offer a comparatively cost-effective alternative, they have faced criticism for lacking the fide…
▽ More
Space agencies are in the process of drawing up carefully thought-out Concepts of Operations (ConOps) for future human missions on the Moon. These are typically assessed and validated through costly and logistically demanding analogue field studies. While interactive simulations in Virtual Reality (VR) offer a comparatively cost-effective alternative, they have faced criticism for lacking the fidelity of real-world deployments. This paper explores the applicability of passive haptic interfaces in bridging the gap between simulated and real-world ConOps assessments. Leveraging passive haptic props (equipment mockup and astronaut gloves), we virtually recreated the Apollo 12 mission procedure and assessed it with experienced astronauts and other space experts. Quantitative and qualitative findings indicate that haptics increased presence and embodiment, thus improving perceived simulation fidelity and validity of user reflections. We conclude by discussing the potential role of passive haptic modalities in facilitating early-stage ConOps assessments for human endeavours on the Moon and beyond.
△ Less
Submitted 23 February, 2024;
originally announced February 2024.
-
Designing for Human Operations on the Moon: Challenges and Opportunities of Navigational HUD Interfaces
Authors:
Leonie Bensch,
Tommy Nilsson,
Jan Wulkop,
Paul de Medeiros,
Nicolas Daniel Herzberger,
Michael Preutenborbeck,
Andreas Gerndt,
Frank Flemisch,
Florian Dufresne,
Georgia Albuquerque,
Aidan Cowley
Abstract:
Future crewed missions to the Moon will face significant environmental and operational challenges, posing risks to the safety and performance of astronauts navigating its inhospitable surface. Whilst head-up displays (HUDs) have proven effective in providing intuitive navigational support on Earth, the design of novel human-spaceflight solutions typically relies on costly and time-consuming analog…
▽ More
Future crewed missions to the Moon will face significant environmental and operational challenges, posing risks to the safety and performance of astronauts navigating its inhospitable surface. Whilst head-up displays (HUDs) have proven effective in providing intuitive navigational support on Earth, the design of novel human-spaceflight solutions typically relies on costly and time-consuming analogue deployments, leaving the potential use of lunar HUDs largely under-explored. This paper explores an alternative approach by simulating navigational HUD concepts in a high-fidelity Virtual Reality (VR) representation of the lunar environment. In evaluating these concepts with astronauts and other aerospace experts (n=25), our mixed methods study demonstrates the efficacy of simulated analogues in facilitating rapid design assessments of early-stage HUD solutions. We illustrate this by elaborating key design challenges and guidelines for future lunar HUDs. In reflecting on the limitations of our approach, we propose directions for future design exploration of human-machine interfaces for the Moon.
△ Less
Submitted 23 February, 2024;
originally announced February 2024.
-
Well-being in isolation: Exploring artistic immersive virtual environments in a simulated lunar habitat to alleviate asthenia symptoms
Authors:
Grzegorz Pochwatko,
Wieslaw Kopec,
Justyna Swidrak,
Anna Jaskulska,
Kinga H. Skorupska,
Barbara Karpowicz,
Rafał Masłyk,
Maciej Grzeszczuk,
Steven Barnes,
Paulina Borkiewicz,
Paweł Kobyliński,
Michał Pabiś-Orzeszyna,
Robert Balas,
Jagoda Lazarek,
Florian Dufresne,
Leonie Bensch,
Tommy Nilsson
Abstract:
Revived interest in lunar and planetary exploration is heralding a new era for human spaceflight, characterized by frequent strain on astronaut's mental well-being, which stems from increased exposure to isolated, confined, and extreme (ICE) conditions. Whilst Immersive Virtual Reality (IVR) has been employed to facilitate self-help interventions to mitigate challenges caused by isolated environme…
▽ More
Revived interest in lunar and planetary exploration is heralding a new era for human spaceflight, characterized by frequent strain on astronaut's mental well-being, which stems from increased exposure to isolated, confined, and extreme (ICE) conditions. Whilst Immersive Virtual Reality (IVR) has been employed to facilitate self-help interventions to mitigate challenges caused by isolated environments in several domains, its applicability in support of future space expeditions remains largely unexplored. To address this limitation, we administered the use of distinct IVR environments to crew members (n=5) partaking in a simulated lunar habitat study. Utilizing a Bayesian approach to scrutinize small group data, we discovered a significant relationship between IVR usage and a reduction in perceived stress-related symptoms, particularly those associated with asthenia (syndrome often linked to chronic fatigue and weakness; a condition characterized by feelings of energy depletion or exhaustion that can be amplified in ICE conditions). The reductions were most prominent with the use of interactive virtual environments. The 'Aesthetic Realities' - virtual environments conceived as art exhibits - received exceptional praise from our participants. These environments mark a fascinating convergence of art and science, holding promise to mitigate effects related to isolation in spaceflight training and beyond.
△ Less
Submitted 15 November, 2023;
originally announced November 2023.
-
Augmented Reality in Service of Human Operations on the Moon: Insights from a Virtual Testbed
Authors:
Leonie Becker,
Tommy Nilsson,
Paul Topf Aguiar de Medeiros,
Flavie Rometsch
Abstract:
Future astronauts living and working on the Moon will face extreme environmental conditions impeding their operational safety and performance. While it has been suggested that Augmented Reality (AR) Head-Up Displays (HUDs) could potentially help mitigate some of these adversities, the applicability of AR in the unique lunar context remains underexplored. To address this limitation, we have produce…
▽ More
Future astronauts living and working on the Moon will face extreme environmental conditions impeding their operational safety and performance. While it has been suggested that Augmented Reality (AR) Head-Up Displays (HUDs) could potentially help mitigate some of these adversities, the applicability of AR in the unique lunar context remains underexplored. To address this limitation, we have produced an accurate representation of the lunar setting in virtual reality (VR) which then formed our testbed for the exploration of prospective operational scenarios with aerospace experts. Herein we present findings based on qualitative reflections made by the first 6 study participants. AR was found instrumental in several use cases, including the support of navigation and risk awareness. Major design challenges were likewise identified, including the importance of redundancy and contextual appropriateness. Drawing on these findings, we conclude by outlining directions for future research aimed at developing AR-based assistive solutions tailored to the lunar setting.
△ Less
Submitted 19 March, 2023;
originally announced March 2023.
-
Using Virtual Reality to Shape Humanity's Return to the Moon: Key Takeaways from a Design Study
Authors:
Tommy Nilsson,
Flavie Rometsch,
Leonie Becker,
Florian Dufresne,
Paul de Medeiros,
Enrico Guerra,
Andrea E. M. Casini,
Anna Vock,
Florian Gaeremynck,
Aidan Cowley
Abstract:
Revived interest in lunar exploration is heralding a new generation of design solutions in support of human operations on the Moon. While space system design has traditionally been guided by prototype deployments in analogue studies, the resource-intensive nature of this approach has largely precluded application of proficient user-centered design (UCD) methods from human-computer interaction (HCI…
▽ More
Revived interest in lunar exploration is heralding a new generation of design solutions in support of human operations on the Moon. While space system design has traditionally been guided by prototype deployments in analogue studies, the resource-intensive nature of this approach has largely precluded application of proficient user-centered design (UCD) methods from human-computer interaction (HCI). This paper explores possible use of Virtual Reality (VR) to simulate analogue studies in lab settings and thereby bring to bear UCD in this otherwise engineering-dominated field. Drawing on the ongoing development of the European Large Logistics Lander, we have recreated a prospective lunar operational scenario in VR and evaluated it with a group of astronauts and space experts (n=20). Our qualitative findings demonstrate the efficacy of VR in facilitating UCD, enabling efficient contextual inquiries and improving project team coordination. We conclude by proposing future directions to further exploit VR in lunar systems design.
△ Less
Submitted 1 March, 2023;
originally announced March 2023.
-
Telerobotic Mars Mission for Lava Tube Exploration and Examination of Life
Authors:
Hanjo Schnellbaecher,
Florian Dufresne,
Tommy Nilsson,
Leonie Becker,
Oliver Bensch,
Enrico Guerra,
Wafa Sadri,
Vanessa Neumann
Abstract:
The general profile and overarching goal of this proposed mission is to pioneer potentially highly beneficial (even vital) and cost-effective techniques for the future human colonization of Mars. Adopting radically new and disruptive solutions untested in the Martian context, our approach is one of high risk and high reward. The real possibility of such a solution failing has prompted us to base o…
▽ More
The general profile and overarching goal of this proposed mission is to pioneer potentially highly beneficial (even vital) and cost-effective techniques for the future human colonization of Mars. Adopting radically new and disruptive solutions untested in the Martian context, our approach is one of high risk and high reward. The real possibility of such a solution failing has prompted us to base our mission architecture around a rover carrying a set of 6 distinct experimental payloads, each capable of operating independently on the others, thus substantially increasing the chances of the mission yielding some valuable findings. At the same time, we sought to exploit available synergies by assembling a combination of payloads that would together form a coherent experimental ecosystem, with each payload providing potential value to the others. Apart from providing such a testbed for evaluation of novel technological solutions, another aim of our proposed mission is to help generate scientific know-how enhancing our understanding of the Red Planet. To this end, our mission takes aim at the Nili-Fossae region, rich in natural resources (and carbonates in particular), past water repositories and signs of volcanic activity. With our proposed experimental payloads, we intend to explore existing lava-tubes, search for signs of past life and assess their potentially valuable geological features for future base building. We will evaluate biomatter in the form of plants and fungi as possible food and base-building materials respectively. Finally, we seek to explore a variety of novel power generation techniques using the Martian atmosphere and gravity. As detailed throughout the remainder of this chapter, this assemblage of experimental payloads, then, constitutes the backbone of our proposed telerobotic mission to Mars.
△ Less
Submitted 31 January, 2023;
originally announced February 2023.
-
Categorisation of future applications for Augmented Reality in human lunar exploration
Authors:
Paul Topf Aguiar de Medeiros,
Paul Njayou,
Flavie Rometsch,
Tommy Nilsson,
Leonie Becker,
Aidan Cowley
Abstract:
The European Space Agency (ESA) has a clear mission to go forward to the Moon in preparation of human presence on Mars. One of the technologies looked at to increase safety and efficiency of astronauts in this context is Augmented Reality (AR). This technology allows digital visual information to be overlaid onto the user's environment through some type of display or projector. In recent years sep…
▽ More
The European Space Agency (ESA) has a clear mission to go forward to the Moon in preparation of human presence on Mars. One of the technologies looked at to increase safety and efficiency of astronauts in this context is Augmented Reality (AR). This technology allows digital visual information to be overlaid onto the user's environment through some type of display or projector. In recent years separate studies have been conducted to test the potential value of AR for astronauts by implementing a few functionalities on an AR display followed by testing in terrestrial analogue environments. One of the groups contributing to these investigations is Spaceship EAC (SSEAC). SSEAC is a group of interns and trainees at the European Astronaut Centre (EAC) focusing on emerging technologies for human space exploration. This paper presents an outcome of SSEAC's activities related to AR for lunar extravehicular activities (EVAs), in which an approach similar to design thinking was used to explore, identify, and structure the opportunities offered by this technology. The resulting categorization of AR use cases can be used to identify new functionalities to test through prototyping and usability tests and can also be used to relate individual studies to each other to gain insight into the overall potential value AR has to offer to human lunar exploration. The approach adopted in this paper is based on the Fuzzy Front End (FFE) model from the innovation management domain. Utilising a user-driven instead of technology-driven method resulted in findings that are relevant irrespective of the hardware and software implementation. Instead, the outcome is an overview of use cases in which some type of AR system could provide value by contributing to increased astronaut safety, efficiency and/or efficacy.
△ Less
Submitted 19 November, 2022;
originally announced January 2023.
-
Electroencephalography (EEG), electromyography (EMG) and eye-tracking for astronaut training and space exploration
Authors:
Leonie Becker,
Tommy Nilsson,
Aidan Cowley
Abstract:
The ongoing push to send humans back to the Moon and to Mars is giving rise to a wide range of novel technical solutions in support of prospective astronaut expeditions. Against this backdrop, the European Space Agency (ESA) has recently launched an investigation into unobtrusive interface technologies as a potential answer to such challenges. Three particular technologies have shown promise in th…
▽ More
The ongoing push to send humans back to the Moon and to Mars is giving rise to a wide range of novel technical solutions in support of prospective astronaut expeditions. Against this backdrop, the European Space Agency (ESA) has recently launched an investigation into unobtrusive interface technologies as a potential answer to such challenges. Three particular technologies have shown promise in this regard: EEG-based brain-computer interfaces (BCI) provide a non-invasive method of utilizing recorded electrical activity of a user's brain, electromyography (EMG) enables monitoring of electrical signals generated by the user's muscle contractions, and finally, eye tracking enables, for instance, the tracking of user's gaze direction via camera recordings to convey commands. Beyond simply improving the usability of prospective technical solutions, our findings indicate that EMG, EEG, and eye-tracking could also serve to monitor and assess a variety of cognitive states, including attention, cognitive load, and mental fatigue of the user, while EMG could furthermore also be utilized to monitor the physical state of the astronaut. In this paper, we elaborate on the key strengths and challenges of these three enabling technologies, and in light of ESA's latest findings, we reflect on their applicability in the context of human space flight. Furthermore, a timeline of technological readiness is provided. In so doing, this paper feeds into the growing discourse on emerging technology and its role in paving the way for a human return to the Moon and expeditions beyond the Earth's orbit.
△ Less
Submitted 27 September, 2022;
originally announced December 2022.
-
Holistic Outpost Design for Lunar Lava Tubes
Authors:
Anna Vock,
Tommy Nilsson
Abstract:
As the space industry continues its rapid development, humanity is poised to expand beyond Low Earth Orbit (LEO), seeking to establish permanent presence on the Moon and beyond. While space travel has traditionally been the domain of a small number of highly specialized professionals, a new era of human exploration, involving non-space actors and stakeholders, is now becoming a reality. In spite o…
▽ More
As the space industry continues its rapid development, humanity is poised to expand beyond Low Earth Orbit (LEO), seeking to establish permanent presence on the Moon and beyond. While space travel has traditionally been the domain of a small number of highly specialized professionals, a new era of human exploration, involving non-space actors and stakeholders, is now becoming a reality. In spite of this development, most space habitats are still designed for a narrow target group. This paper seeks to address this deficit by rethinking the established design approaches, typically limited to tackling engineering and challenges of human space exploration (such as radiation or hypogravity), by instead adopting an interdisciplinary "big picture" perspective encompassing social, psychological and cultural aspects of future space habitats. By elaborating and reflecting on our concept, this paper seeks to demonstrate the importance of a trans-disciplinary approach to designing thriving sustainable colonies beyond LEO. We demonstrate the potentially key role of design as mediator in advancing macro-strategies promoting thriving existence and sustainable growth. With this approach we tackle big-picture questions about humanity's future and prospects amongst the stars.
△ Less
Submitted 19 October, 2022;
originally announced November 2022.
-
Using Virtual Reality to Design and Evaluate a Lunar Lander: The EL3 Case Study
Authors:
Tommy Nilsson,
Flavie Rometsch,
Andrea E. M. Casini,
Enrico Guerra,
Leonie Becker,
Andreas Treuer,
Paul de Medeiros,
Hanjo Schnellbaecher,
Anna Vock,
Aidan Cowley
Abstract:
The European Large Logistics Lander (EL3) is being designed to carry out cargo delivery missions in support of future lunar ground crews. The capacity of virtual reality (VR) to visualize and interactively simulate the unique lunar environment makes it a potentially powerful design tool during the early development stages of such solutions. Based on input from the EL3 development team, we have pro…
▽ More
The European Large Logistics Lander (EL3) is being designed to carry out cargo delivery missions in support of future lunar ground crews. The capacity of virtual reality (VR) to visualize and interactively simulate the unique lunar environment makes it a potentially powerful design tool during the early development stages of such solutions. Based on input from the EL3 development team, we have produced a VR-based operational scenario featuring a hypothetical configuration of the lander. Relying on HCI research methods, we have subsequently evaluated this scenario with relevant experts (n=10). Qualitative findings from this initial pilot study have demonstrated the usefulness of VR as a design tool in this context, but likewise surfaced a number of limitations in the form of potentially impaired validity and generalizability. We conclude by outlining our future research plan and reflect on the potential use of physical stimuli to improve the validity of VR-based simulations in forthcoming design activities.
△ Less
Submitted 25 March, 2022;
originally announced March 2022.
-
Visions, Values, and Videos: Revisiting Envisionings in Service of UbiComp Design for the Home
Authors:
Tommy Nilsson,
Joel E. Fischer,
Andy Crabtree,
Murray Goulden,
Jocelyn Spence,
Enrico Costanza
Abstract:
UbiComp has been envisioned to bring about a future dominated by calm computing technologies making our everyday lives ever more convenient. Yet the same vision has also attracted criticism for encouraging a solitary and passive lifestyle. The aim of this paper is to explore and elaborate these tensions further by examining the human values surrounding future domestic UbiComp solutions. Drawing on…
▽ More
UbiComp has been envisioned to bring about a future dominated by calm computing technologies making our everyday lives ever more convenient. Yet the same vision has also attracted criticism for encouraging a solitary and passive lifestyle. The aim of this paper is to explore and elaborate these tensions further by examining the human values surrounding future domestic UbiComp solutions. Drawing on envisioning and contravisioning, we probe members of the public (N=28) through the presentation and focus group discussion of two contrasting animated video scenarios, where one is inspired by "calm" and the other by "engaging" visions of future UbiComp technology. By analysing the reasoning of our participants, we identify and elaborate a number of relevant values involved in balancing the two perspectives. In conclusion, we articulate practically applicable takeaways in the form of a set of key design questions and challenges.
△ Less
Submitted 20 May, 2020; v1 submitted 16 May, 2020;
originally announced May 2020.
-
Immersive virtual worlds: Multi-sensory virtual environments for health and safety training
Authors:
Glyn Lawson,
Emily Shaw,
Tessa Roper,
Tommy Nilsson,
Laura Bajorunaite,
Ayesha Batool
Abstract:
Virtual environments (VEs) offer potential benefits to health and safety training: exposure to dangerous (virtual) environments; the opportunity for experiential learning; and a high level of control over the training, in that aspects can be repeated or reviewed based on the trainee's performance. However, VEs are typically presented as audiovisual (AV) systems, whereas engagement of other senses…
▽ More
Virtual environments (VEs) offer potential benefits to health and safety training: exposure to dangerous (virtual) environments; the opportunity for experiential learning; and a high level of control over the training, in that aspects can be repeated or reviewed based on the trainee's performance. However, VEs are typically presented as audiovisual (AV) systems, whereas engagement of other senses could increase the immersion in the virtual experience. Moreover, other senses play a key role in certain health and safety contexts, for example the feel of heat and smell in a fire or smell in a fuel leak. A multisensory (MS) VE was developed, which provided simulated heat and smell in accordance with events in a virtual world. As users approached a virtual fire, they felt heat from three 2 kW heaters and smelled smoke from a scent diffuser. Behaviours in the MS VE demonstrated higher validity than those in a comparable AV VE, which ratings and verbatim responses indicated was down to a greater belief that participants were in a real fire. However, a study of the effectiveness of the MS VE as a training tool demonstrated that it did not offer benefits over AV as measured by a written knowledge test and subjective ratings of engagement, attitude towards health and safety and desire to repeat. However, the study found further evidence for the use of AV VEs in health and safety training, particularly as the subjective ratings were generally better than for PowerPoint based training. Despite the lack of evidence for MS simulation on traditional measures of training, the different attitudes and experiences of users suggest that it may have value as a system for changing trainees' attitudes towards their personal safety and awareness. This view was supported by feedback from industrial partners.
△ Less
Submitted 1 October, 2019;
originally announced October 2019.
-
Breaching the Future: Understanding Human Challenges of Autonomous Systems for the Home
Authors:
Tommy Nilsson,
Andy Crabtree,
Joel Fischer,
Boriana Koleva
Abstract:
The domestic environment is a key area for the design and deployment of autonomous systems. Yet research indicates their adoption is already being hampered by a variety of critical issues including trust, privacy and security. This paper explores how potential users relate to the concept of autonomous systems in the home and elaborates further points of friction. It makes two contributions. One me…
▽ More
The domestic environment is a key area for the design and deployment of autonomous systems. Yet research indicates their adoption is already being hampered by a variety of critical issues including trust, privacy and security. This paper explores how potential users relate to the concept of autonomous systems in the home and elaborates further points of friction. It makes two contributions. One methodological, focusing on the use of provocative utopian and dystopian scenarios of future autonomous systems in the home. These are used to drive an innovative workshop-based approach to breaching experiments, which surfaces the usually tacit and unspoken background expectancies implicated in the organisation of everyday life that have a powerful impact on the acceptability of future and emerging technologies. The other contribution is substantive, produced through participants efforts to repair the incongruity or "reality disjuncture" created by utopian and dystopian visions, and highlights the need to build social as well as computational accountability into autonomous systems, and to enable coordination and control.
△ Less
Submitted 4 March, 2019;
originally announced March 2019.
-
The Heat is On: Exploring User Behaviour in a Multisensory Virtual Environment for Fire Evacuation
Authors:
Emily Shaw,
Tessa Roper,
Tommy Nilsson,
Glyn Lawson,
Sue V. G. Cobb,
Daniel Miller
Abstract:
Understanding validity of user behaviour in Virtual Environments (VEs) is critical as they are increasingly being used for serious Health and Safety applications such as predicting human behaviour and training in hazardous situations. This paper presents a comparative study exploring user behaviour in VE-based fire evacuation and investigates whether this is affected by the addition of thermal and…
▽ More
Understanding validity of user behaviour in Virtual Environments (VEs) is critical as they are increasingly being used for serious Health and Safety applications such as predicting human behaviour and training in hazardous situations. This paper presents a comparative study exploring user behaviour in VE-based fire evacuation and investigates whether this is affected by the addition of thermal and olfactory simulation. Participants (N=43) were exposed to a virtual fire in an office building. Quantitative and qualitative analyses of participant attitudes and behaviours found deviations from those we would expect in real life (e.g. pre-evacuation actions), but also valid behaviours like fire avoidance. Potentially important differences were found between multisensory and audiovisual-only conditions (e.g. perceived urgency). We conclude VEs have significant potential in safety-related applications, and that multimodality may afford additional uses in this context, but the identified limitations of behavioural validity must be carefully considered to avoid misapplication of the technology.
△ Less
Submitted 12 February, 2019;
originally announced February 2019.
-
I Probe, Therefore I Am: Designing a Virtual Journalist with Human Emotions
Authors:
Kevin K. Bowden,
Tommy Nilsson,
Christine P. Spencer,
Kubra Cengiz,
Alexandru Ghitulescu,
Jelte B. van Waterschoot
Abstract:
By utilizing different communication channels, such as verbal language, gestures or facial expressions, virtually embodied interactive humans hold a unique potential to bridge the gap between human-computer interaction and actual interhuman communication. The use of virtual humans is consequently becoming increasingly popular in a wide range of areas where such a natural communication might be ben…
▽ More
By utilizing different communication channels, such as verbal language, gestures or facial expressions, virtually embodied interactive humans hold a unique potential to bridge the gap between human-computer interaction and actual interhuman communication. The use of virtual humans is consequently becoming increasingly popular in a wide range of areas where such a natural communication might be beneficial, including entertainment, education, mental health research and beyond. Behind this development lies a series of technological advances in a multitude of disciplines, most notably natural language processing, computer vision, and speech synthesis. In this paper we discuss a Virtual Human Journalist, a project employing a number of novel solutions from these disciplines with the goal to demonstrate their viability by producing a humanoid conversational agent capable of naturally eliciting and reacting to information from a human user. A set of qualitative and quantitative evaluation sessions demonstrated the technical feasibility of the system whilst uncovering a number of deficits in its capacity to engage users in a way that would be perceived as natural and emotionally engaging. We argue that naturalness should not always be seen as a desirable goal and suggest that deliberately suppressing the naturalness of virtual human interactions, such as by altering its personality cues, might in some cases yield more desirable results.
△ Less
Submitted 18 May, 2017;
originally announced May 2017.
-
Smart Spaces: Challenges and Opportunities of BLE-Centered Mobile Systems for Public Environments
Authors:
Tommy Nilsson
Abstract:
The application of mobile computing is currently altering patterns of our behavior to a greater degree than perhaps any other invention. In combination with the introduction of BLE (Bluetooth Low Energy) and similar technologies enabling context-awareness, designers are today finding themselves empowered to build experiences and facilitate interactions with our physical surroundings in ways not po…
▽ More
The application of mobile computing is currently altering patterns of our behavior to a greater degree than perhaps any other invention. In combination with the introduction of BLE (Bluetooth Low Energy) and similar technologies enabling context-awareness, designers are today finding themselves empowered to build experiences and facilitate interactions with our physical surroundings in ways not possible before. The aim of this thesis is to present a research project, currently underway at the University of Cambridge, which is dealing with implementation of a BLE system into a museum environment. By assessing the technology, describing the design decisions as well as presenting a qualitative evaluation, this paper seeks to provide insight into some of the challenges and possible solutions connected to the process of developing ubiquitous BLE computing systems for public spaces. The project outcome revealed the potential use of BLE to engage whole new groups of audiences as well as made me argue in favor of a more seamful approach to the design of these systems.
△ Less
Submitted 25 March, 2017;
originally announced March 2017.
-
Exploring the Pathways of Adaptation an Avatar 3D Animation Procedures and Virtual Reality Arenas in Research of Human Courtship Behaviour and Sexual Reactivity in Psychological Research
Authors:
Jakub Binter,
Kateřina Klapilová,
Tereza Zikánová,
Tommy Nilsson,
Klára Bártová,
Lucie Krejcová,
Renata Androvicová,
Jitka Lindová,
Denisa Prušová,
Timothy Wells,
Daniel Riha
Abstract:
There are many reasons for utilising 3D animation and virtual reality in sexuality research. Apart from providing a mean with which to (re)experience certain situations there are four main advantages: a) bespoke animated stimuli can be created and customized, which is especially important when researching paraphilia and sexual preferences, b) stimulus production is less expensive and easier to pro…
▽ More
There are many reasons for utilising 3D animation and virtual reality in sexuality research. Apart from providing a mean with which to (re)experience certain situations there are four main advantages: a) bespoke animated stimuli can be created and customized, which is especially important when researching paraphilia and sexual preferences, b) stimulus production is less expensive and easier to produce compared to real world stimuli, c) virtual reality allows us to capture data such as physiological reasons to stimuli, that we would not be able to otherwise (without resorting to self-report measures which are especially problematic in this research domain), d) ethical, legal, and health and safety issues are less complex since neither physical nor psychological harm is caused to animated characters allowing for the safe presentation of stimuli involving vulnerable targets. The animation sub-group has been exploring so far several production quality levels and various animation procedures in a number of available software. The aim is to develop static as well as dynamic, interactive sexual stimuli for sexual diagnostic and therapeutic purposes. We are aware of number of ethical issues related to the use of virtual reality in proposed research are analysed in this chapter.
△ Less
Submitted 6 November, 2016;
originally announced November 2016.
-
Ghosts! A Location-Based Bluetooth LE Mobile Game for Museum Exploration
Authors:
Tommy Nilsson,
Alan Blackwell,
Carl Hogsden,
David Scruton
Abstract:
BLE (Bluetooth Low Energy) is a new wireless communication technology that, thanks to reduced power consumption, promises to facilitate communication between computing devices and help us harness their power in environments and contexts previously untouched by information technology. Museums and other facilities housing various cultural content are a particularly interesting area of application. T…
▽ More
BLE (Bluetooth Low Energy) is a new wireless communication technology that, thanks to reduced power consumption, promises to facilitate communication between computing devices and help us harness their power in environments and contexts previously untouched by information technology. Museums and other facilities housing various cultural content are a particularly interesting area of application. The University of Cambridge Museums consortium has put considerable effort into researching the potential uses of emerging technologies such as BLE to unlock new experiences enriching the way we engage with cultural information. As a part of this research initiative, our ambition has been to examine the challenges and opportunities introduced by the introduction of a BLE-centred system into the museum context. We present an assessment of the potential offered by this technology and of the design approaches that might yield the best results when developing BLE-centred experiences for museum environments. A pivotal part of our project consisted of designing, developing and evaluating a prototype mobile location-based BLE-centred game. A number of technical problems, such as unstable and fluctuating signal strength, were encountered throughout the project lifecycle. Instead of attempting to eliminate such problems, we argued in favour of embracing them and turning them into a cornerstone of the gameplay. Our study suggested that this alternative seamful design approach yields particularly good results when deploying the technology in public environments. The project outcome also demonstrated the potential of BLE-centred solutions to reach out and engage new demographics, especially children, extending their interest in museum visits.
△ Less
Submitted 19 July, 2016;
originally announced July 2016.
-
Applying Seamful Design in Location-based Mobile Museum Applications
Authors:
Tommy Nilsson,
Carl Hogsden,
Charith Perera,
Saeed Aghaee,
David Scruton,
Andreas Lund,
Alan F. Blackwell
Abstract:
The application of mobile computing is currently altering patterns of our behavior to a greater degree than perhaps any other invention. In combination with the introduction of power efficient wireless communication technologies, such as Bluetooth Low Energy (BLE), designers are today increasingly empowered to shape the way we interact with our physical surroundings and thus build entirely new exp…
▽ More
The application of mobile computing is currently altering patterns of our behavior to a greater degree than perhaps any other invention. In combination with the introduction of power efficient wireless communication technologies, such as Bluetooth Low Energy (BLE), designers are today increasingly empowered to shape the way we interact with our physical surroundings and thus build entirely new experiences. However, our evaluations of BLE and its abilities to facilitate mobile location-based experiences in public environments revealed a number of potential problems. Most notably, the position and orientation of the user in combination with various environmental factors, such as crowds of people traversing the space, were found to cause major fluctuations of the received BLE signal strength. These issues are rendering a seamless functioning of any location-based application practically impossible. Instead of achieving seamlessness by eliminating these technical issues, we thus choose to advocate the use of a seamful approach, i.e. to reveal and exploit these problems and turn them into a part of the actual experience. In order to demonstrate the viability of this approach, we designed, implemented and evaluated the Ghost Detector - an educational location-based museum game for children. By presenting a qualitative evaluation of this game and by motivating our design decisions, this paper provides insight into some of the challenges and possible solutions connected to the process of developing location-based BLE-enabled experiences for public cultural spaces.
△ Less
Submitted 8 June, 2016; v1 submitted 18 May, 2016;
originally announced May 2016.
