Breaking the mould of Social Mixed Reality - State-of-the-Art and Glossary
Authors:
Marta Bieńkiewicz,
Julia Ayache,
Panayiotis Charalambous,
Cristina Becchio,
Marco Corragio,
Bertram Taetz,
Francesco De Lellis,
Antonio Grotta,
Anna Server,
Daniel Rammer,
Richard Kulpa,
Franck Multon,
Azucena Garcia-Palacios,
Jessica Sutherland,
Kathleen Bryson,
Stéphane Donikian,
Didier Stricker,
Benoît Bardy
Abstract:
This article explores a critical gap in Mixed Reality (MR) technology: while advances have been made, MR still struggles to authentically replicate human embodiment and socio-motor interaction. For MR to enable truly meaningful social experiences, it needs to incorporate multi-modal data streams and multi-agent interaction capabilities. To address this challenge, we present a comprehensive glossar…
▽ More
This article explores a critical gap in Mixed Reality (MR) technology: while advances have been made, MR still struggles to authentically replicate human embodiment and socio-motor interaction. For MR to enable truly meaningful social experiences, it needs to incorporate multi-modal data streams and multi-agent interaction capabilities. To address this challenge, we present a comprehensive glossary covering key topics such as Virtual Characters and Autonomisation, Responsible AI, Ethics by Design, and the Scientific Challenges of Social MR within Neuroscience, Embodiment, and Technology. Our aim is to drive the transformative evolution of MR technologies that prioritize human-centric innovation, fostering richer digital connections. We advocate for MR systems that enhance social interaction and collaboration between humans and virtual autonomous agents, ensuring inclusivity, ethical design and psychological safety in the process.
△ Less
Submitted 1 August, 2025; v1 submitted 31 July, 2025;
originally announced July 2025.
Bridging the gap between emotion and joint action
Authors:
M. M. N. Bieńkiewicz,
A. Smykovskyi,
T. Olugbade,
S. Janaqi,
A. Camurri,
N. Bianchi-Berthouze,
M. Björkman,
B. G. Bardy
Abstract:
Our daily human life is filled with a myriad of joint action moments, be it children playing, adults working together (i.e., team sports), or strangers navigating through a crowd. Joint action brings individuals (and embodiment of their emotions) together, in space and in time. Yet little is known about how individual emotions propagate through embodied presence in a group, and how joint action ch…
▽ More
Our daily human life is filled with a myriad of joint action moments, be it children playing, adults working together (i.e., team sports), or strangers navigating through a crowd. Joint action brings individuals (and embodiment of their emotions) together, in space and in time. Yet little is known about how individual emotions propagate through embodied presence in a group, and how joint action changes individual emotion. In fact, the multi-agent component is largely missing from neuroscience-based approaches to emotion, and reversely joint action research has not found a way yet to include emotion as one of the key parameters to model socio-motor interaction. In this review, we first identify the gap and then stockpile evidence showing strong entanglement between emotion and acting together from various branches of sciences. We propose an integrative approach to bridge the gap, highlight five research avenues to do so in behavioral neuroscience and digital sciences, and address some of the key challenges in the area faced by modern societies.
△ Less
Submitted 13 August, 2021;
originally announced August 2021.
