Skip to main content

Showing 1–50 of 133 results for author: André, E

.
  1. arXiv:2506.08805  [pdf, ps, other

    cs.HC cs.RO

    Communicating Through Avatars in Industry 5.0: A Focus Group Study on Human-Robot Collaboration

    Authors: Stina Klein, Pooja Prajod, Katharina Weitz, Matteo Lavit Nicora, Dimitra Tsovaltzi, Elisabeth André

    Abstract: The integration of collaborative robots (cobots) in industrial settings raises concerns about worker well-being, particularly due to reduced social interactions. Avatars - designed to facilitate worker interactions and engagement - are promising solutions to enhance the human-robot collaboration (HRC) experience. However, real-world perspectives on avatar-supported HRC remain unexplored. To addres… ▽ More

    Submitted 10 June, 2025; originally announced June 2025.

    Comments: Accepted LBW at CHIWORK 2025

  2. arXiv:2505.17223  [pdf, ps, other

    cs.CV

    REACT 2025: the Third Multiple Appropriate Facial Reaction Generation Challenge

    Authors: Siyang Song, Micol Spitale, Xiangyu Kong, Hengde Zhu, Cheng Luo, Cristina Palmero, German Barquero, Sergio Escalera, Michel Valstar, Mohamed Daoudi, Tobias Baur, Fabien Ringeval, Andrew Howes, Elisabeth Andre, Hatice Gunes

    Abstract: In dyadic interactions, a broad spectrum of human facial reactions might be appropriate for responding to each human speaker behaviour. Following the successful organisation of the REACT 2023 and REACT 2024 challenges, we are proposing the REACT 2025 challenge encouraging the development and benchmarking of Machine Learning (ML) models that can be used to generate multiple appropriate, diverse, re… ▽ More

    Submitted 22 May, 2025; originally announced May 2025.

    MSC Class: 68T40

  3. arXiv:2505.03423  [pdf, other

    cs.HC

    AI-Based Feedback in Counselling Competence Training of Prospective Teachers

    Authors: Tobias Hallmen, Kathrin Gietl, Karoline Hillesheim, Moritz Bauermann, Annemarie Friedrich, Elisabeth André

    Abstract: This study explores the use of AI-based feedback to enhance the counselling competence of prospective teachers. An iterative block seminar was designed, incorporating theoretical foundations, practical applications, and AI tools for analysing verbal, paraverbal, and nonverbal communication. The seminar included recorded simulated teacher-parent conversations, followed by AI-based feedback and qual… ▽ More

    Submitted 6 May, 2025; originally announced May 2025.

  4. arXiv:2504.11460  [pdf, other

    cs.CV cs.AI cs.CL

    Semantic Matters: Multimodal Features for Affective Analysis

    Authors: Tobias Hallmen, Robin-Nico Kampa, Fabian Deuser, Norbert Oswald, Elisabeth André

    Abstract: In this study, we present our methodology for two tasks: the Emotional Mimicry Intensity (EMI) Estimation Challenge and the Behavioural Ambivalence/Hesitancy (BAH) Recognition Challenge, both conducted as part of the 8th Workshop and Competition on Affective & Behavior Analysis in-the-wild. We utilize a Wav2Vec 2.0 model pre-trained on a large podcast dataset to extract various audio features, cap… ▽ More

    Submitted 18 April, 2025; v1 submitted 16 March, 2025; originally announced April 2025.

  5. arXiv:2501.09645  [pdf, other

    cs.AI cs.CL cs.HC

    CarMem: Enhancing Long-Term Memory in LLM Voice Assistants through Category-Bounding

    Authors: Johannes Kirmayr, Lukas Stappen, Phillip Schneider, Florian Matthes, Elisabeth André

    Abstract: In today's assistant landscape, personalisation enhances interactions, fosters long-term relationships, and deepens engagement. However, many systems struggle with retaining user preferences, leading to repetitive user requests and disengagement. Furthermore, the unregulated and opaque extraction of user preferences in industry applications raises significant concerns about privacy and trust, espe… ▽ More

    Submitted 16 January, 2025; originally announced January 2025.

    Comments: Accepted for presentation at the International Conference on Computational Linguistics (COLING 2025)

  6. Tuning Trains Speed in Railway Scheduling

    Authors: Étienne André

    Abstract: Railway scheduling consists in ensuring that a set of trains evolve in a shared rail network without collisions, while meeting schedule constraints. This problem is notoriously difficult, even more in the case of uncertain or even unknown train speeds. We propose here a modeling and verification approach for railway scheduling in the presence of uncertain speeds, encoded here as uncertain segment… ▽ More

    Submitted 5 December, 2024; originally announced December 2024.

    Comments: This is the author version of the manuscript of the same name published in the proceedings of the 25th International Conference on Formal Engineering Methods (ICFEM 2024)

    Journal ref: Springer LNCS volume 15394, pages 37-50, 2024

  7. arXiv:2412.04162  [pdf, other

    math.AT cs.CG

    Estimating the persistent homology of $\mathbb{R}^n$-valued functions using function-geometric multifiltrations

    Authors: Ethan André, Jingyi Li, Steve Oudot

    Abstract: Given an unknown $\mathbb{R}^n$-valued function $f$ on a metric space $X$, can we approximate the persistent homology of $f$ from a finite sampling of $X$ with known pairwise distances and function values? This question has been answered in the case $n=1$, assuming $f$ is Lipschitz continuous and $X$ is a sufficiently regular geodesic metric space, and using filtered geometric complexes with fixed… ▽ More

    Submitted 5 December, 2024; originally announced December 2024.

    Comments: 18 pages

    MSC Class: 55N31 ACM Class: I.3.5

  8. arXiv:2411.11520  [pdf, other

    cs.AI cs.CY cs.LG

    A Pre-Trained Graph-Based Model for Adaptive Sequencing of Educational Documents

    Authors: Jean Vassoyan, Anan Schütt, Jill-Jênn Vie, Arun-Balajiee Lekshmi-Narayanan, Elisabeth André, Nicolas Vayatis

    Abstract: Massive Open Online Courses (MOOCs) have greatly contributed to making education more accessible. However, many MOOCs maintain a rigid, one-size-fits-all structure that fails to address the diverse needs and backgrounds of individual learners. Learning path personalization aims to address this limitation, by tailoring sequences of educational content to optimize individual student learning outcome… ▽ More

    Submitted 18 November, 2024; originally announced November 2024.

    Comments: NeurIPS 2024 Workshop on Large Foundation Models for Educational Assessment (FM-Assess), Dec 2024, Vancouver, Canada

  9. Exploring the Impact of Non-Verbal Virtual Agent Behavior on User Engagement in Argumentative Dialogues

    Authors: Annalena Bea Aicher, Yuki Matsuda, Keichii Yasumoto, Wolfgang Minker, Elisabeth André, Stefan Ultes

    Abstract: Engaging in discussions that involve diverse perspectives and exchanging arguments on a controversial issue is a natural way for humans to form opinions. In this process, the way arguments are presented plays a crucial role in determining how engaged users are, whether the interaction takes place solely among humans or within human-agent teams. This is of great importance as user engagement plays… ▽ More

    Submitted 17 November, 2024; originally announced November 2024.

    Comments: 9 pages, accepted to International Conference on Human-Agent Interaction (HAI '24), November 24--27, 2024, Swansea, United Kingdom

    ACM Class: H.1.2; H.5.2

  10. arXiv:2410.04198  [pdf, other

    eess.AS eess.SP

    DJ Mix Transcription with Multi-Pass Non-Negative Matrix Factorization

    Authors: Étienne Paul André, Dominique Fourer, Diemo Schwarz

    Abstract: DJ mix transcription is a crucial step towards DJ mix reverse engineering, which estimates the set of parameters and audio effects applied to a set of existing tracks to produce a performative DJ mix. We introduce a new approach based on a multi-pass NMF algorithm where the dictionary matrix corresponds to a set of spectrogram slices of the source tracks present in the mix. The multi-pass strate… ▽ More

    Submitted 5 October, 2024; originally announced October 2024.

    Comments: Submitted to ICASSP 2025

  11. arXiv:2410.01659  [pdf, ps, other

    cs.FL

    Execution-time opacity problems in one-clock parametric timed automata

    Authors: Étienne André, Johan Arcile, Engel Lefaucheux

    Abstract: Parametric timed automata (PTAs) extend the concept of timed automata, by allowing timing delays not only specified by concrete values but also by parameters, allowing the analysis of systems with uncertainty regarding timing behaviors. The full execution-time opacity is defined as the problem in which an attacker must never be able to deduce whether some private location was visited, by only obse… ▽ More

    Submitted 2 October, 2024; originally announced October 2024.

    Comments: This is the author (and extended) version of the manuscript of the same name published in the proceedings of the 44th IARCS Annual Conference on Foundations of Software Technology and Theoretical Computer Science (FSTTCS 2024)

  12. arXiv:2409.13726  [pdf, other

    cs.CL cs.AI cs.HC cs.LG

    Multilingual Dyadic Interaction Corpus NoXi+J: Toward Understanding Asian-European Non-verbal Cultural Characteristics and their Influences on Engagement

    Authors: Marius Funk, Shogo Okada, Elisabeth André

    Abstract: Non-verbal behavior is a central challenge in understanding the dynamics of a conversation and the affective states between interlocutors arising from the interaction. Although psychological research has demonstrated that non-verbal behaviors vary across cultures, limited computational analysis has been conducted to clarify these differences and assess their impact on engagement recognition. To ga… ▽ More

    Submitted 9 September, 2024; originally announced September 2024.

    Comments: 8 pages. 6 figures. International Conference on Multimodal Interaction, November 4-8, 2024, San Jose, Costa Rica

  13. arXiv:2409.12968  [pdf, other

    cs.HC cs.AI

    MITHOS: Interactive Mixed Reality Training to Support Professional Socio-Emotional Interactions at Schools

    Authors: Lara Chehayeb, Chirag Bhuvaneshwara, Manuel Anglet, Bernhard Hilpert, Ann-Kristin Meyer, Dimitra Tsovaltzi, Patrick Gebhard, Antje Biermann, Sinah Auchtor, Nils Lauinger, Julia Knopf, Andreas Kaiser, Fabian Kersting, Gregor Mehlmann, Florian Lingenfelser, Elisabeth André

    Abstract: Teachers in challenging conflict situations often experience shame and self-blame, which relate to the feeling of incompetence but may externalise as anger. Sensing mixed signals fails the contingency rule for developing affect regulation and may result in confusion for students about their own emotions and hinder their emotion regulation. Therefore, being able to constructively regulate emotions… ▽ More

    Submitted 2 September, 2024; originally announced September 2024.

  14. Execution-time opacity control for timed automata

    Authors: Étienne André, Marie Duflot, Laetitia Laversa, Engel Lefaucheux

    Abstract: Timing leaks in timed automata (TA) can occur whenever an attacker is able to deduce a secret by observing some timed behavior. In execution-time opacity, the attacker aims at deducing whether a private location was visited, by observing only the execution time. It can be decided whether a TA is opaque in this setting. In this work, we tackle control, and show that we are able to decide whether a… ▽ More

    Submitted 5 December, 2024; v1 submitted 16 September, 2024; originally announced September 2024.

    Comments: This is the author (and extended) version of the manuscript of the same name published in the proceedings of the 22nd International Conference on Software Engineering and Formal Methods (SEFM 2024)

    Journal ref: Springer LNCS volume 15280, pages 347-365, 2024

  15. MultiMediate'24: Multi-Domain Engagement Estimation

    Authors: Philipp Müller, Michal Balazia, Tobias Baur, Michael Dietz, Alexander Heimerl, Anna Penzkofer, Dominik Schiller, François Brémond, Jan Alexandersson, Elisabeth André, Andreas Bulling

    Abstract: Estimating the momentary level of participant's engagement is an important prerequisite for assistive systems that support human interactions. Previous work has addressed this task in within-domain evaluation scenarios, i.e. training and testing on the same dataset. This is in contrast to real-life scenarios where domain shifts between training and testing data frequently occur. With MultiMediate'… ▽ More

    Submitted 29 August, 2024; originally announced August 2024.

    Comments: arXiv admin note: text overlap with arXiv:2308.08256

  16. arXiv:2408.12240  [pdf, other

    cs.LO cs.CR cs.FL

    The Bright Side of Timed Opacity

    Authors: Étienne André, Sarah Dépernet, Engel Lefaucheux

    Abstract: In 2009, Franck Cassez showed that the timed opacity problem, where an attacker can observe some actions with their timestamps and attempts to deduce information, is undecidable for timed automata (TAs). Moreover, he showed that the undecidability holds even for subclasses such as event-recording automata. In this article, we consider the same definition of opacity for several other subclasses of… ▽ More

    Submitted 27 September, 2024; v1 submitted 22 August, 2024; originally announced August 2024.

    Comments: This is the author (and extended) version of the manuscript of the same name published in the proceedings of the 25th International Conference on Formal Engineering Methods (ICFEM 2024)

  17. arXiv:2408.12170  [pdf, other

    cs.HC cs.SD eess.AS

    VoiceX: A Text-To-Speech Framework for Custom Voices

    Authors: Silvan Mertes, Daksitha Withanage Don, Otto Grothe, Johanna Kuch, Ruben Schlagowski, Elisabeth André

    Abstract: Modern TTS systems are capable of creating highly realistic and natural-sounding speech. Despite these developments, the process of customizing TTS voices remains a complex task, mostly requiring the expertise of specialists within the field. One reason for this is the utilization of deep learning models, which are characterized by their expansive, non-interpretable parameter spaces, restricting t… ▽ More

    Submitted 22 August, 2024; originally announced August 2024.

  18. arXiv:2408.05190  [pdf, other

    cs.FL

    Parameterized Verification of Timed Networks with Clock Invariants

    Authors: Étienne André, Swen Jacobs, Shyam Lal Karra, Ocan Sankur

    Abstract: We consider parameterized verification problems for networks of timed automata (TAs) that communicate via disjunctive guards or lossy broadcast. To this end, we first consider disjunctive timed networks (DTNs), i.e., networks of TAs that communicate via location guards that enable a transition only if there is another process in a certain location. We solve for the first time the general case with… ▽ More

    Submitted 9 August, 2024; originally announced August 2024.

    Comments: 31 pages, 7 figures

    ACM Class: D.2.4; F.1.2

  19. arXiv:2408.04420  [pdf, other

    cs.CL

    Recognizing Emotion Regulation Strategies from Human Behavior with Large Language Models

    Authors: Philipp Müller, Alexander Heimerl, Sayed Muddashir Hossain, Lea Siegel, Jan Alexandersson, Patrick Gebhard, Elisabeth André, Tanja Schneeberger

    Abstract: Human emotions are often not expressed directly, but regulated according to internal processes and social display rules. For affective computing systems, an understanding of how users regulate their emotions can be highly useful, for example to provide feedback in job interview training, or in psychotherapeutic scenarios. However, at present no method to automatically classify different emotion re… ▽ More

    Submitted 8 August, 2024; originally announced August 2024.

    Comments: Accepted to ACII'24

  20. arXiv:2407.21321  [pdf, ps, other

    cs.FL eess.SY

    Hyper parametric timed CTL

    Authors: Masaki Waga, Étienne André

    Abstract: Hyperproperties enable simultaneous reasoning about multiple execution traces of a system and are useful to reason about non-interference, opacity, robustness, fairness, observational determinism, etc. We introduce hyper parametric timed computation tree logic (HyperPTCTL), extending hyperlogics with timing reasoning and, notably, parameters to express unknown values. We mainly consider its nest-f… ▽ More

    Submitted 31 July, 2024; originally announced July 2024.

    Comments: Accepted to EMSOFT 2024

  21. arXiv:2407.17215  [pdf, other

    cs.SE cs.LO

    Formalizing UML State Machines for Automated Verification -- A Survey

    Authors: Étienne André, Shuang Liu, Yang Liu, Christine Choppy, Jun Sun, Jin Song Dong

    Abstract: The Unified Modeling Language (UML) is a standard for modeling dynamic systems. UML behavioral state machines are used for modeling the dynamic behavior of object-oriented designs. The UML specification, maintained by the Object Management Group (OMG), is documented in natural language (in contrast to formal language). The inherent ambiguity of natural languages may introduce inconsistencies in th… ▽ More

    Submitted 24 July, 2024; originally announced July 2024.

    Comments: This is the author version of the manuscript of the same name published in ACM Computing Surveys

    Journal ref: ACM Computing Surveys, Volume 55, Issue 13s, Article No.: 277, Pages 1-47, 2023

  22. MoULDyS: Monitoring of Autonomous Systems in the Presence of Uncertainties

    Authors: Bineet Ghosh, Étienne André

    Abstract: We introduce MoULDyS, that implements efficient offline and online monitoring algorithms of black-box cyber-physical systems w.r.t. safety properties. MoULDyS takes as input an uncertain log (with noisy and missing samples), as well as a bounding model in the form of an uncertain linear system; this latter model plays the role of an over-approximation so as to reduce the number of false alarms. Mo… ▽ More

    Submitted 24 July, 2024; originally announced July 2024.

    Comments: This is the author version of the manuscript of the same name published in Science of Computer Programming

    Journal ref: Science of Computer Programming, Volume 230, 2023

  23. arXiv:2407.13408  [pdf, other

    cs.HC cs.AI

    DISCOVER: A Data-driven Interactive System for Comprehensive Observation, Visualization, and ExploRation of Human Behaviour

    Authors: Dominik Schiller, Tobias Hallmen, Daksitha Withanage Don, Elisabeth André, Tobias Baur

    Abstract: Understanding human behavior is a fundamental goal of social sciences, yet its analysis presents significant challenges. Conventional methodologies employed for the study of behavior, characterized by labor-intensive data collection processes and intricate analyses, frequently hinder comprehensive exploration due to their time and resource demands. In response to these challenges, computational mo… ▽ More

    Submitted 18 July, 2024; originally announced July 2024.

    ACM Class: J.4

  24. Tidal Disruption of Stars by Supermassive Black Holes and Naked Singularities with Scalar Hair

    Authors: Eduardo Andre, Alexander Tsirulev

    Abstract: In this paper we study tidal forces near strongly gravitating objects at the centers of galaxies. In our approach, dark matter surrounding the centers of galaxies is modeled by a nonlinear scalar field. We focus on static, asymptotically flat, spherically symmetric black holes and naked singularities supported by a real self-gravitating scalar field minimally coupled to gravity. We consider the in… ▽ More

    Submitted 16 July, 2024; originally announced July 2024.

    Comments: 14 pages, 6 figures

    MSC Class: 83C57; 85A15

    Journal ref: Physics of Atomic Nuclei, Vol. 87 (2024)

  25. arXiv:2406.12035  [pdf, other

    cs.HC cs.AI

    Socially Interactive Agents for Robotic Neurorehabilitation Training: Conceptualization and Proof-of-concept Study

    Authors: Rhythm Arora, Pooja Prajod, Matteo Lavit Nicora, Daniele Panzeri, Giovanni Tauro, Rocco Vertechy, Matteo Malosio, Elisabeth André, Patrick Gebhard

    Abstract: Individuals with diverse motor abilities often benefit from intensive and specialized rehabilitation therapies aimed at enhancing their functional recovery. Nevertheless, the challenge lies in the restricted availability of neurorehabilitation professionals, hindering the effective delivery of the necessary level of care. Robotic devices hold great potential in reducing the dependence on medical p… ▽ More

    Submitted 17 June, 2024; originally announced June 2024.

  26. arXiv:2406.11808  [pdf, other

    cs.CV

    Faces of Experimental Pain: Transferability of Deep Learned Heat Pain Features to Electrical Pain

    Authors: Pooja Prajod, Dominik Schiller, Daksitha Withanage Don, Elisabeth André

    Abstract: The limited size of pain datasets are a challenge in developing robust deep learning models for pain recognition. Transfer learning approaches are often employed in these scenarios. In this study, we investigate whether deep learned feature representation for one type of experimentally induced pain can be transferred to another. Participating in the AI4Pain challenge, our goal is to classify three… ▽ More

    Submitted 17 June, 2024; originally announced June 2024.

  27. arXiv:2405.09563  [pdf, other

    eess.SP cs.AI cs.LG

    Stressor Type Matters! -- Exploring Factors Influencing Cross-Dataset Generalizability of Physiological Stress Detection

    Authors: Pooja Prajod, Bhargavi Mahesh, Elisabeth André

    Abstract: Automatic stress detection using heart rate variability (HRV) features has gained significant traction as it utilizes unobtrusive wearable sensors measuring signals like electrocardiogram (ECG) or blood volume pulse (BVP). However, detecting stress through such physiological signals presents a considerable challenge owing to the variations in recorded signals influenced by factors, such as perceiv… ▽ More

    Submitted 6 May, 2024; originally announced May 2024.

  28. arXiv:2405.05295  [pdf, other

    cs.CV cs.AI cs.LG

    Relevant Irrelevance: Generating Alterfactual Explanations for Image Classifiers

    Authors: Silvan Mertes, Tobias Huber, Christina Karle, Katharina Weitz, Ruben Schlagowski, Cristina Conati, Elisabeth André

    Abstract: In this paper, we demonstrate the feasibility of alterfactual explanations for black box image classifiers. Traditional explanation mechanisms from the field of Counterfactual Thinking are a widely-used paradigm for Explainable Artificial Intelligence (XAI), as they follow a natural way of reasoning that humans are familiar with. However, most common approaches from this field are based on communi… ▽ More

    Submitted 8 May, 2024; originally announced May 2024.

    Comments: Accepted at IJCAI 2024. arXiv admin note: text overlap with arXiv:2207.09374

  29. Temporal Logic Formalisation of ISO 34502 Critical Scenarios: Modular Construction with the RSS Safety Distance

    Authors: Jesse Reimann, Nico Mansion, James Haydon, Benjamin Bray, Agnishom Chattopadhyay, Sota Sato, Masaki Waga, Étienne André, Ichiro Hasuo, Naoki Ueda, Yosuke Yokoyama

    Abstract: As the development of autonomous vehicles progresses, efficient safety assurance methods become increasingly necessary. Safety assurance methods such as monitoring and scenario-based testing call for formalisation of driving scenarios. In this paper, we develop a temporal-logic formalisation of an important class of critical scenarios in the ISO standard 34502. We use signal temporal logic (STL) a… ▽ More

    Submitted 27 March, 2024; originally announced March 2024.

    Comments: 12 pages, 4 figures, 5 tables. Accepted to SAC 2024

  30. arXiv:2403.11879  [pdf, other

    cs.SD cs.AI eess.AS

    Unimodal Multi-Task Fusion for Emotional Mimicry Intensity Prediction

    Authors: Tobias Hallmen, Fabian Deuser, Norbert Oswald, Elisabeth André

    Abstract: In this research, we introduce a novel methodology for assessing Emotional Mimicry Intensity (EMI) as part of the 6th Workshop and Competition on Affective Behavior Analysis in-the-wild. Our methodology utilises the Wav2Vec 2.0 architecture, which has been pre-trained on an extensive podcast dataset, to capture a wide array of audio features that include both linguistic and paralinguistic componen… ▽ More

    Submitted 16 June, 2024; v1 submitted 18 March, 2024; originally announced March 2024.

    Journal ref: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024, pp. 4657-4665

  31. Expiring opacity problems in parametric timed automata

    Authors: Étienne André, Engel Lefaucheux, Dylan Marinho

    Abstract: Information leakage can have dramatic consequences on the security of real-time systems. Timing leaks occur when an attacker is able to infer private behavior depending on timing information. In this work, we propose a definition of expiring timed opacity w.r.t. execution time, where a system is opaque whenever the attacker is unable to deduce the reachability of some private state solely based on… ▽ More

    Submitted 12 March, 2024; originally announced March 2024.

    Comments: This is the author (and slightly modified) version of the manuscript of the same name published in the proceedings of the 27th International Conference on Engineering of Complex Computer Systems (ICECCS 2023). This work is partially supported by the ANR-NRF French-Singaporean research program ProMiS (ANR-19-CE25-0015 / 2019 ANR NRF 0092) and the ANR research program BisoUS (ANR-22-CE48-0012)

    Journal ref: Proceedings of the 27th International Conference on Engineering of Complex Computer Systems (ICECCS 2023), pages 89-98

  32. arXiv:2402.15195  [pdf, other

    cs.HC cs.AI cs.LG

    The AffectToolbox: Affect Analysis for Everyone

    Authors: Silvan Mertes, Dominik Schiller, Michael Dietz, Elisabeth André, Florian Lingenfelser

    Abstract: In the field of affective computing, where research continually advances at a rapid pace, the demand for user-friendly tools has become increasingly apparent. In this paper, we present the AffectToolbox, a novel software system that aims to support researchers in developing affect-sensitive studies and prototypes. The proposed system addresses the challenges posed by existing frameworks, which oft… ▽ More

    Submitted 23 February, 2024; originally announced February 2024.

  33. ReNeLiB: Real-time Neural Listening Behavior Generation for Socially Interactive Agents

    Authors: Daksitha Withanage Don, Philipp Müller, Fabrizio Nunnari, Elisabeth André, Patrick Gebhard

    Abstract: Flexible and natural nonverbal reactions to human behavior remain a challenge for socially interactive agents (SIAs) that are predominantly animated using hand-crafted rules. While recently proposed machine learning based approaches to conversational behavior generation are a promising way to address this challenge, they have not yet been employed in SIAs. The primary reason for this is the lack o… ▽ More

    Submitted 12 February, 2024; originally announced February 2024.

    Comments: 8 pages, 11 figures, ICMI conference, project page https://daksitha.github.io/ReNeLib/

  34. Giving Robots a Voice: Human-in-the-Loop Voice Creation and open-ended Labeling

    Authors: Pol van Rijn, Silvan Mertes, Kathrin Janowski, Katharina Weitz, Nori Jacoby, Elisabeth André

    Abstract: Speech is a natural interface for humans to interact with robots. Yet, aligning a robot's voice to its appearance is challenging due to the rich vocabulary of both modalities. Previous research has explored a few labels to describe robots and tested them on a limited number of robots and existing voices. Here, we develop a robot-voice creation tool followed by large-scale behavioral human experime… ▽ More

    Submitted 7 February, 2024; originally announced February 2024.

    Comments: Accepted to CHI 2024, May 11 to 16, 2024, Honolulu, HI, USA

  35. Exploring the Dynamics between Cobot's Production Rhythm, Locus of Control and Emotional State in a Collaborative Assembly Scenario

    Authors: Marta Mondellini, Matteo Lavit Nicora, Pooja Prajod, Elisabeth André, Rocco Vertechy, Alessandro Antonietti, Matteo Malosio

    Abstract: In industrial scenarios, there is widespread use of collaborative robots (cobots), and growing interest is directed at evaluating and measuring the impact of some characteristics of the cobot on the human factor. In the present pilot study, the effect that the production rhythm (C1 - Slow, C2 - Fast, C3 - Adapted to the participant's pace) of a cobot has on the Experiential Locus of Control (ELoC)… ▽ More

    Submitted 27 June, 2024; v1 submitted 1 February, 2024; originally announced February 2024.

    Comments: Accepted to 4th IEEE International Conference on Human-Machine Systems

  36. arXiv:2401.05166  [pdf, other

    cs.CV

    REACT 2024: the Second Multiple Appropriate Facial Reaction Generation Challenge

    Authors: Siyang Song, Micol Spitale, Cheng Luo, Cristina Palmero, German Barquero, Hengde Zhu, Sergio Escalera, Michel Valstar, Tobias Baur, Fabien Ringeval, Elisabeth Andre, Hatice Gunes

    Abstract: In dyadic interactions, humans communicate their intentions and state of mind using verbal and non-verbal cues, where multiple different facial reactions might be appropriate in response to a specific speaker behaviour. Then, how to develop a machine learning (ML) model that can automatically generate multiple appropriate, diverse, realistic and synchronised human facial reactions from an previous… ▽ More

    Submitted 10 January, 2024; originally announced January 2024.

    MSC Class: 68T40

  37. arXiv:2312.06643  [pdf, other

    cs.RO cs.AI cs.CV cs.HC

    Gaze Detection and Analysis for Initiating Joint Activity in Industrial Human-Robot Collaboration

    Authors: Pooja Prajod, Matteo Lavit Nicora, Marta Mondellini, Giovanni Tauro, Rocco Vertechy, Matteo Malosio, Elisabeth André

    Abstract: Collaborative robots (cobots) are widely used in industrial applications, yet extensive research is still needed to enhance human-robot collaborations and operator experience. A potential approach to improve the collaboration experience involves adapting cobot behavior based on natural cues from the operator. Inspired by the literature on human-human interactions, we conducted a wizard-of-oz study… ▽ More

    Submitted 1 February, 2024; v1 submitted 11 December, 2023; originally announced December 2023.

    Comments: First draft for a paper submitted to Frontiers in Robotics and AI

  38. Does Difficulty even Matter? Investigating Difficulty Adjustment and Practice Behavior in an Open-Ended Learning Task

    Authors: Anan Schütt, Tobias Huber, Jauwairia Nasir, Cristina Conati, Elisabeth André

    Abstract: Difficulty adjustment in practice exercises has been shown to be beneficial for learning. However, previous research has mostly investigated close-ended tasks, which do not offer the students multiple ways to reach a valid solution. Contrary to this, in order to learn in an open-ended learning task, students need to effectively explore the solution space as there are multiple ways to reach a solut… ▽ More

    Submitted 3 November, 2023; originally announced November 2023.

  39. arXiv:2310.20392  [pdf, other

    cs.LO cs.CR cs.SE

    Configuring Timing Parameters to Ensure Execution-Time Opacity in Timed Automata

    Authors: Étienne André, Engel Lefaucheux, Didier Lime, Dylan Marinho, Jun Sun

    Abstract: Timing information leakage occurs whenever an attacker successfully deduces confidential internal information by observing some timed information such as events with timestamps. Timed automata are an extension of finite-state automata with a set of clocks evolving linearly and that can be tested or reset, making this formalism able to reason on systems involving concurrency and timing constraints.… ▽ More

    Submitted 31 October, 2023; originally announced October 2023.

    Comments: In Proceedings TiCSA 2023, arXiv:2310.18720. This invited paper mainly summarizes results on opacity from two recent works published in ToSEM (2022) and at ICECCS 2023, providing unified notations and concept names for the sake of consistency. In addition, we prove a few original results absent from these works

    ACM Class: F.1.1; F.4.1; D.4.6

    Journal ref: EPTCS 392, 2023, pp. 1-26

  40. arXiv:2310.09109  [pdf, other

    cs.LO

    Dense Integer-Complete Synthesis for Bounded Parametric Timed Automata

    Authors: Étienne André, Didier Lime, Olivier H. Roux

    Abstract: Ensuring the correctness of critical real-time systems, involving concurrent behaviors and timing requirements, is crucial. Timed automata extend finite-state automata with clocks, compared in guards and invariants with integer constants. Parametric timed automata (PTAs) extend timed automata with timing parameters. Parameter synthesis aims at computing dense sets of valuations for the timing para… ▽ More

    Submitted 27 September, 2024; v1 submitted 13 October, 2023; originally announced October 2023.

    Comments: This is an extended version of the paper by the same authors published in the proceedings of the 9th International Workshop on Reachability Problems (RP 2015)

  41. arXiv:2308.09061  [pdf, other

    cs.HC cs.AI

    Fostering User Engagement in the Critical Reflection of Arguments

    Authors: Klaus Weber, Annalena Aicher, Wolfang Minker, Stefan Ultes, Elisabeth André

    Abstract: A natural way to resolve different points of view and form opinions is through exchanging arguments and knowledge. Facing the vast amount of available information on the internet, people tend to focus on information consistent with their beliefs. Especially when the issue is controversial, information is often selected that does not challenge one's beliefs. To support a fair and unbiased opinion-b… ▽ More

    Submitted 17 August, 2023; originally announced August 2023.

    Comments: 16 pages, 5 figures

  42. MultiMediate'23: Engagement Estimation and Bodily Behaviour Recognition in Social Interactions

    Authors: Philipp Müller, Michal Balazia, Tobias Baur, Michael Dietz, Alexander Heimerl, Dominik Schiller, Mohammed Guermal, Dominike Thomas, François Brémond, Jan Alexandersson, Elisabeth André, Andreas Bulling

    Abstract: Automatic analysis of human behaviour is a fundamental prerequisite for the creation of machines that can effectively interact with- and support humans in social interactions. In MultiMediate'23, we address two key human social behaviour analysis tasks for the first time in a controlled challenge: engagement estimation and bodily behaviour recognition in social interactions. This paper describes t… ▽ More

    Submitted 16 August, 2023; originally announced August 2023.

    Comments: ACM MultiMedia'23

  43. arXiv:2306.06583  [pdf, other

    cs.CV

    REACT2023: the first Multi-modal Multiple Appropriate Facial Reaction Generation Challenge

    Authors: Siyang Song, Micol Spitale, Cheng Luo, German Barquero, Cristina Palmero, Sergio Escalera, Michel Valstar, Tobias Baur, Fabien Ringeval, Elisabeth Andre, Hatice Gunes

    Abstract: The Multi-modal Multiple Appropriate Facial Reaction Generation Challenge (REACT2023) is the first competition event focused on evaluating multimedia processing and machine learning techniques for generating human-appropriate facial reactions in various dyadic interaction scenarios, with all participants competing strictly under the same conditions. The goal of the challenge is to provide the firs… ▽ More

    Submitted 11 June, 2023; originally announced June 2023.

    MSC Class: 68T40

  44. arXiv:2305.08660  [pdf

    eess.IV cs.CV

    Towards Automated COVID-19 Presence and Severity Classification

    Authors: Dominik Müller, Niklas Schröter, Silvan Mertes, Fabio Hellmann, Miriam Elia, Wolfgang Reif, Bernhard Bauer, Elisabeth André, Frank Kramer

    Abstract: COVID-19 presence classification and severity prediction via (3D) thorax computed tomography scans have become important tasks in recent times. Especially for capacity planning of intensive care units, predicting the future severity of a COVID-19 patient is crucial. The presented approach follows state-of-theart techniques to aid medical professionals in these situations. It comprises an ensemble… ▽ More

    Submitted 15 May, 2023; originally announced May 2023.

  45. Parameterized Verification of Disjunctive Timed Networks

    Authors: Étienne André, Paul Eichler, Swen Jacobs, Shyam Lal Karra

    Abstract: We introduce new techniques for the parameterized verification of disjunctive timed networks (DTNs), i.e., networks of timed automata (TAs) that communicate via location guards that enable a transition only if there is another process in a given location. This computational model has been considered in the literature before, example applications are gossiping clock synchronization protocols or pla… ▽ More

    Submitted 2 January, 2024; v1 submitted 12 May, 2023; originally announced May 2023.

    Comments: 21 pages, 6 figures

    ACM Class: D.2.4; F.1.2

    Journal ref: VMCAI 2024

  46. arXiv:2305.02143  [pdf, other

    cs.CV cs.MM

    GANonymization: A GAN-based Face Anonymization Framework for Preserving Emotional Expressions

    Authors: Fabio Hellmann, Silvan Mertes, Mohamed Benouis, Alexander Hustinx, Tzung-Chien Hsieh, Cristina Conati, Peter Krawitz, Elisabeth André

    Abstract: In recent years, the increasing availability of personal data has raised concerns regarding privacy and security. One of the critical processes to address these concerns is data anonymization, which aims to protect individual privacy and prevent the release of sensitive information. This research focuses on the importance of face anonymization. Therefore, we introduce GANonymization, a novel face… ▽ More

    Submitted 14 November, 2023; v1 submitted 3 May, 2023; originally announced May 2023.

    Comments: 26 pages, 11 figures, 6 tables, ACM Transactions on Multimedia Computing, Communications, and Applications

  47. arXiv:2303.17619  [pdf, other

    cs.HC cs.AI cs.CV cs.RO

    Gaze-based Attention Recognition for Human-Robot Collaboration

    Authors: Pooja Prajod, Matteo Lavit Nicora, Matteo Malosio, Elisabeth André

    Abstract: Attention (and distraction) recognition is a key factor in improving human-robot collaboration. We present an assembly scenario where a human operator and a cobot collaborate equally to piece together a gearbox. The setup provides multiple opportunities for the cobot to adapt its behavior depending on the operator's attention, which can improve the collaboration experience and reduce psychological… ▽ More

    Submitted 30 March, 2023; originally announced March 2023.

    Comments: Accepted to PETRA 2023

  48. arXiv:2303.07742  [pdf, other

    cs.LG cs.HC eess.SP

    ForDigitStress: A multi-modal stress dataset employing a digital job interview scenario

    Authors: Alexander Heimerl, Pooja Prajod, Silvan Mertes, Tobias Baur, Matthias Kraus, Ailin Liu, Helen Risack, Nicolas Rohleder, Elisabeth André, Linda Becker

    Abstract: We present a multi-modal stress dataset that uses digital job interviews to induce stress. The dataset provides multi-modal data of 40 participants including audio, video (motion capturing, facial recognition, eye tracking) as well as physiological information (photoplethysmography, electrodermal activity). In addition to that, the dataset contains time-continuous annotations for stress and occurr… ▽ More

    Submitted 14 March, 2023; originally announced March 2023.

  49. arXiv:2302.12689  [pdf, other

    cs.LG cs.AI

    GANterfactual-RL: Understanding Reinforcement Learning Agents' Strategies through Visual Counterfactual Explanations

    Authors: Tobias Huber, Maximilian Demmler, Silvan Mertes, Matthew L. Olson, Elisabeth André

    Abstract: Counterfactual explanations are a common tool to explain artificial intelligence models. For Reinforcement Learning (RL) agents, they answer "Why not?" or "What if?" questions by illustrating what minimal change to a state is needed such that an agent chooses a different action. Generating counterfactual explanations for RL agents with visual input is especially challenging because of their large… ▽ More

    Submitted 24 February, 2023; originally announced February 2023.

  50. arXiv:2302.01614  [pdf, other

    cs.CL

    Around the world in 60 words: A generative vocabulary test for online research

    Authors: Pol van Rijn, Yue Sun, Harin Lee, Raja Marjieh, Ilia Sucholutsky, Francesca Lanzarini, Elisabeth André, Nori Jacoby

    Abstract: Conducting experiments with diverse participants in their native languages can uncover insights into culture, cognition, and language that may not be revealed otherwise. However, conducting these experiments online makes it difficult to validate self-reported language proficiency. Furthermore, existing proficiency tests are small and cover only a few languages. We present an automated pipeline to… ▽ More

    Submitted 3 February, 2023; originally announced February 2023.