Human-Computer Interaction

Authors and titles for July 2024

[1] arXiv:2407.00305 [pdf, html, other]

Title: Student-AI Interaction: A Case Study of CS1 students

Matin Amoozadeh, Daye Nam, Daniel Prol, Ali Alfageeh, James Prather, Michael Hilton, Sruti Srinivasa Ragavan, Mohammad Amin Alipour

Comments: Koli Calling 2024

Subjects: Human-Computer Interaction (cs.HC)

[2] arXiv:2407.00981 [pdf, html, other]

Title: VisEval: A Benchmark for Data Visualization in the Era of Large Language Models

Nan Chen, Yuge Zhang, Jiahang Xu, Kan Ren, Yuqing Yang

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[3] arXiv:2407.01077 [pdf, html, other]

Title: Impact of Social Relationships on Peer Assessment in E-Learning

Francisco Sousa, Tomás Alves, Sandra Gama, Joaquim Jorge, Daniel Gonçalves

Comments: 24 pages, 5 figures, 4 tables. Learning Environ Res (2024)

Journal-ref: Studying how social relationships affect peer assessment in an E-learning environment, Learning Environments Research, 2024/06/17

Subjects: Human-Computer Interaction (cs.HC)

[4] arXiv:2407.01161 [pdf, html, other]

Title: GazeNoter: Co-Piloted AR Note-Taking via Gaze Selection of LLM Suggestions to Match Users' Intentions

Hsin-Ruey Tsai, Shih-Kang Chiu, Bryan Wang

Comments: 22 pages, 19 figures

Subjects: Human-Computer Interaction (cs.HC)

[5] arXiv:2407.01488 [pdf, html, other]

Title: LEXI: Large Language Models Experimentation Interface

Guy Laban, Tomer Laban, Hatice Gunes

Comments: For associated Github repository, see this https URL

Subjects: Human-Computer Interaction (cs.HC)

[6] arXiv:2407.01558 [pdf, html, other]

Title: Visual Grounding Methods for Efficient Interaction with Desktop Graphical User Interfaces

El Hassane Ettifouri, Jessica López Espejel, Laura Minkova, Tassnim Dardouri, Walid Dahhane

Comments: Preprint submitted to Engineering Applications of Artificial Intelligence journal

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)

[7] arXiv:2407.01585 [pdf, html, other]

Title: DrugWatch: A Comprehensive Multi-Source Data Visualisation Platform for Drug Safety Information

Artem Bobrov, Domantas Saltenis, Zhaoyue Sun, Gabriele Pergola, Yulan He

Comments: 10 pages, 14 figures, accepted by ACL 2024 Demo Track

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

[8] arXiv:2407.01752 [pdf, html, other]

Title: Predicting Trust Dynamics with Dynamic SEM in Human-AI Cooperation

Sota Kaneko, Seiji Yamada

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)

[9] arXiv:2407.01767 [pdf, html, other]

Title: Assessing Photorealism of Rendered Objects in Real-World Images: A Transparent and Reproducible User Study

Sven Kluge, Oliver Staadt

Subjects: Human-Computer Interaction (cs.HC); Graphics (cs.GR)

[10] arXiv:2407.01824 [pdf, html, other]

Title: Empathic Grounding: Explorations using Multimodal Interaction and Large Language Models with Conversational Agents

Mehdi Arjmand, Farnaz Nouraei, Ian Steenstra, Timothy Bickmore

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Robotics (cs.RO)

[11] arXiv:2407.01893 [pdf, html, other]

Title: CausalPrism: A Visual Analytics Approach for Subgroup-based Causal Heterogeneity Exploration

Jiehui Zhou, Xumeng Wang, Kam-Kwai Wong, Wei Zhang, Xingyu Liu, Juntian Zhang, Minfeng Zhu, Wei Chen

Comments: 12 pages, 7 figures

Subjects: Human-Computer Interaction (cs.HC)

[12] arXiv:2407.02012 [pdf, html, other]

Title: A Study on Activity Visualization for Smart Watches

Zhouxuan Xia, Yu Liu, Fabiola Polidoro

Comments: 2 pages, 3 figures, 2023 IEEE 16th Pacific Visualization Symposium (PacificVis)

Subjects: Human-Computer Interaction (cs.HC); Graphics (cs.GR)

[13] arXiv:2407.02065 [pdf, html, other]

Title: Fuzzy synthetic method for evaluating explanations in recommender systems

Jinfeng Zhong, Elsa Negre

Subjects: Human-Computer Interaction (cs.HC)

[14] arXiv:2407.02129 [pdf, html, other]

Title: ReliaAvatar: A Robust Real-Time Avatar Animator with Integrated Motion Prediction

Bo Qian, Zhenhuan Wei, Jiashuo Li, Xing Wei

Subjects: Human-Computer Interaction (cs.HC)

[15] arXiv:2407.02269 [pdf, html, other]

Title: IFTT-PIN: A Self-Calibrating PIN-Entry Method

Kathryn McConkey, Talha Enes Ayranci, Mohamed Khamis, Jonathan Grizou

Comments: arXiv admin note: text overlap with arXiv:2205.09534

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[16] arXiv:2407.02305 [pdf, other]

Title: The Equality Maturity Model: an actionable tool to advance gender balance in leadership and participation roles

Paloma Díaz, Paula Alexandra Silva, Katja Tuma

Comments: 10 pages, 2 figures

Subjects: Human-Computer Interaction (cs.HC)

[17] arXiv:2407.02381 [pdf, html, other]

Title: What Should Be Considered to Support well-being with AI: Considerations Based on Responsible Research and Innovation

Yuri Nakao

Subjects: Human-Computer Interaction (cs.HC)

[18] arXiv:2407.02579 [pdf, html, other]

Title: What do we study when studying politics and democracy? A semantic analysis of how politics and democracy are treated in SIGCHI conference papers

Matti Nelimarkka, Ville Vuorenmaa

Subjects: Human-Computer Interaction (cs.HC)

[19] arXiv:2407.02606 [pdf, html, other]

Title: An AI-Based System Utilizing IoT-Enabled Ambient Sensors and LLMs for Complex Activity Tracking

Yuan Sun, Jorge Ortiz

Subjects: Human-Computer Interaction (cs.HC)

[20] arXiv:2407.02611 [pdf, html, other]

Title: Co-Designing Unstructured Text Data Visualization Systems

Beck Langstone, Fateme Rajabiyazdi

Subjects: Human-Computer Interaction (cs.HC)

[21] arXiv:2407.02614 [pdf, html, other]

Title: AcuVR: Enhancing Acupuncture Training Workflow with Virtual Reality

Menghe Zhang, Chen Chen, Matin Yarmand, Anish Rajeshkumar, Nadir Weibel

Comments: 10 pages

Subjects: Human-Computer Interaction (cs.HC)

[22] arXiv:2407.02632 [pdf, html, other]

Title: STL: Still Tricky Logic (for System Validation, Even When Showing Your Work)

Isabelle Hurley, Rohan Paleja, Ashley Suh, Jaime D. Peña, Ho Chit Siu

Subjects: Human-Computer Interaction (cs.HC); Formal Languages and Automata Theory (cs.FL)

[23] arXiv:2407.02651 [pdf, html, other]

Title: Improving Steering and Verification in AI-Assisted Data Analysis with Interactive Task Decomposition

Majeed Kazemitabaar, Jack Williams, Ian Drosos, Tovi Grossman, Austin Henley, Carina Negreanu, Advait Sarkar

Comments: Published at UIST 2024; 19 pages, 9 figures, and 2 tables

Journal-ref: Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology (UIST 2024)

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)

[24] arXiv:2407.02697 [pdf, html, other]

Title: Design and Development of PainBit: a Portable Device for Supporting Patients with Chronic Pain to Log their Pain

Arsh Saleem, Beck Langstone, Alicia Ouskine, Fateme Rajabiyazdi

Subjects: Human-Computer Interaction (cs.HC)

[25] arXiv:2407.02710 [pdf, html, other]

Title: WARNING This Contains Misinformation: The Effect of Cognitive Factors, Beliefs, and Personality on Misinformation Warning Tag Attitudes

Robert Kaufman, Aaron Broukhim, Michael Haupt

Comments: 22 pages, 6 figures

Subjects: Human-Computer Interaction (cs.HC); Social and Information Networks (cs.SI)

[26] arXiv:2407.02798 [pdf, html, other]

Title: Game-Based Discovery: Harnessing Mini-Games within Primary Games for Scientific Data Collection and Problem Solving

Abhishek Phadke, Mamta Yadav, Stanislav Ustymenko

Comments: 6 pages, 4 figures

Subjects: Human-Computer Interaction (cs.HC); Multimedia (cs.MM)

[27] arXiv:2407.02810 [pdf, other]

Title: Understanding the Prevalence of Caste: A Critical Discourse Analysis of Caste-based Marginalization on X

Nayana Kirasur, Shagun Jhaver

Comments: 35 pages, 11 figures, 1 table

Subjects: Human-Computer Interaction (cs.HC)

[28] arXiv:2407.02885 [pdf, html, other]

Title: CogErgLLM: Exploring Large Language Model Systems Design Perspective Using Cognitive Ergonomics

Azmine Toushik Wasi, Mst Rafia Islam

Comments: 10 Page, 3 Figures. Accepted in: (i) ICML'24: LLMs & Cognition Workshop (Non-archival; OpenReview: this https URL) (ii) EMNLP'24 : NLP for Science Workshop (Archival; ACL Anthology: this https URL)

Journal-ref: Proceedings of the 1st Workshop on NLP for Science (NLP4Science), EMNLP 2024

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Computers and Society (cs.CY); Social and Information Networks (cs.SI)

[29] arXiv:2407.02896 [pdf, html, other]

Title: Predicting and Understanding Turn-Taking Behavior in Open-Ended Group Activities in Virtual Reality

Portia Wang, Eugy Han, Anna C.M. Queiroz, Cyan DeVeaux, Jeremy N. Bailenson

Journal-ref: Proceedings of the ACM on Human-Computer Interaction (2025)

Subjects: Human-Computer Interaction (cs.HC); Computers and Society (cs.CY)

[30] arXiv:2407.02903 [pdf, html, other]

Title: "It's like a rubber duck that talks back": Understanding Generative AI-Assisted Data Analysis Workflows through a Participatory Prompting Study

Ian Drosos, Advait Sarkar, Xiaotong Xu, Carina Negreanu, Sean Rintel, Lev Tankelevitch

Comments: Ian Drosos, Advait Sarkar, Xiaotong Xu, Carina Negreanu, Sean Rintel, and Lev Tankelevitch. 2024. "It's like a rubber duck that talks back": Understanding Generative AI-Assisted Data Analysis Workflows through a Participatory Prompting Study. In Proceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work (CHIWORK 2024)

Journal-ref: Proceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work (CHIWORK 2024)

Subjects: Human-Computer Interaction (cs.HC)

[31] arXiv:2407.02981 [pdf, html, other]

Title: Project Beyond: An Escape Room Game in Virtual Reality to Teach Building Energy Simulations

Georg Arbesser-Rastburg, Saeed Safikhani, Matej Gustin, Christina Hopfe, Gerald Schweiger, Johanna Pirker

Comments: 8 pages, 9 figures, to be published in the the conference proceedings of IEEE Conference on Games 2024

Subjects: Human-Computer Interaction (cs.HC)

[32] arXiv:2407.03045 [pdf, html, other]

Title: JailbreakHunter: A Visual Analytics Approach for Jailbreak Prompts Discovery from Large-Scale Human-LLM Conversational Datasets

Zhihua Jin, Shiyi Liu, Haotian Li, Xun Zhao, Huamin Qu

Comments: 18 pages, 9 figures

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Machine Learning (cs.LG)

[33] arXiv:2407.03063 [pdf, html, other]

Title: ScreenTK: Seamless Detection of Time-Killing Moments Using Continuous Mobile Screen Text and On-Device LLMs

Le Fang, Shiquan Zhang, Hong Jia, Jorge Goncalves, Vassilis Kostakos

Subjects: Human-Computer Interaction (cs.HC)

[34] arXiv:2407.03107 [pdf, other]

Title: Design of a UE5-based digital twin platform

Shaoqiu Lyu, Muzhi Wang, Sunrui Zhang, Shengzhi Wang

Subjects: Human-Computer Interaction (cs.HC); Graphics (cs.GR); Multimedia (cs.MM)

[35] arXiv:2407.03177 [pdf, html, other]

Title: A Spatial-Spectral and Temporal Dual Prototype Network for Motor Imagery Brain-Computer Interface

Can Han, Chen Liu, Yaqi Wang, Crystal Cai, Jun Wang, Dahong Qian

Subjects: Human-Computer Interaction (cs.HC); Signal Processing (eess.SP)

[36] arXiv:2407.03298 [pdf, html, other]

Title: Eyes on the Game: Deciphering Implicit Human Signals to Infer Human Proficiency, Trust, and Intent

Nikhil Hulle, Stéphane Aroca-Ouellette, Anthony J. Ries, Jake Brawer, Katharina von der Wense, Alessandro Roncone

Comments: 7 pages, 5 figures, To be published in The 33rd IEEE International Conference on Robot and Human Interactive Communication, IEEE RO-MAN 2024

Subjects: Human-Computer Interaction (cs.HC)

[37] arXiv:2407.03477 [pdf, html, other]

Title: Whose Knowledge is Valued?: Epistemic Injustice in CSCW Applications

Leah Hope Ajmani, Jasmine C Foriest, Jordan Taylor, Kyle Pittman, Sarah Gilbert, Michael Ann Devito

Subjects: Human-Computer Interaction (cs.HC)

[38] arXiv:2407.03479 [pdf, html, other]

Title: Human-Centered Design Recommendations for LLM-as-a-Judge

Qian Pan, Zahra Ashktorab, Michael Desmond, Martin Santillan Cooper, James Johnson, Rahul Nair, Elizabeth Daly, Werner Geyer

Comments: 14 pages, 6 figures, Accepted for publication in ACL 2024 Workshop HuCLLM

Subjects: Human-Computer Interaction (cs.HC)

[39] arXiv:2407.03644 [pdf, html, other]

Title: On-Device Training Empowered Transfer Learning For Human Activity Recognition

Pixi Kang, Julian Moosmann, Sizhen Bian, Michele Magno

Subjects: Human-Computer Interaction (cs.HC)

[40] arXiv:2407.03735 [pdf, other]

Title: Navigating Ethics and Power Dynamics through Participant-Designer Journey Mapping

Leonor Tejo, Paula Alexandra Silva

Comments: 9 pages, 6 figures

Subjects: Human-Computer Interaction (cs.HC)

[41] arXiv:2407.03808 [pdf, html, other]

Title: Designing Value-Centered Consent Interfaces: A Mixed-Methods Approach to Support Patient Values in Data-Sharing Decisions

David Leimstädtner, Peter Sörries, Claudia Müller-Birn

Comments: 30 pages

Subjects: Human-Computer Interaction (cs.HC)

[42] arXiv:2407.03865 [pdf, html, other]

Title: Reliability Criteria for News Websites

Hendrik Heuer, Elena Leah Glassman

Comments: Published by ACM Transactions on Computer-Human Interaction, presented at CHI 2024

Journal-ref: ACM Trans. Comput.-Hum. Interact. 31, 2, Article 21 (April 2024), 33 pages

Subjects: Human-Computer Interaction (cs.HC)

[43] arXiv:2407.04070 [pdf, html, other]

Title: Behavioural gap assessment of human-vehicle interaction in real and virtual reality-based scenarios in autonomous driving

Sergio. Martín Serrano, Rubén Izquierdo, Iván García Daza, Miguel Ángel Sotelo, D. Fernández Llorca

Comments: Paper submitted to International Journal of Human Computer Interaction

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)

[44] arXiv:2407.04352 [pdf, html, other]

Title: UpStory: the Uppsala Storytelling dataset

Marc Fraile, Natalia Calvo-Barajas, Anastasia Sophia Apeiron, Giovanna Varni, Joakim Lindblad, Nataša Sladoje, Ginevra Castellano

Subjects: Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

[45] arXiv:2407.04418 [pdf, html, other]

Title: Enabling On-Device LLMs Personalization with Smartphone Sensing

Shiquan Zhang, Ying Ma, Le Fang, Hong Jia, Simon D'Alfonso, Vassilis Kostakos

Comments: 5 pages, 3 figures, conference demo paper

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[46] arXiv:2407.04610 [pdf, other]

Title: Gamification of Motor Imagery Brain-Computer Interface Training Protocols: a systematic review

Fred Atilla, Marie Postma, Maryam Alimardani

Subjects: Human-Computer Interaction (cs.HC)

[47] arXiv:2407.04892 [pdf, other]

Title: Diversity, Representation, and Accessibility Concerns in Game Development

Nooshin Darvishinia (1), Todd Goodson (1) ((1) Kansas State University, USA)

Comments: 23 pages, 2 figures

Subjects: Human-Computer Interaction (cs.HC)

[48] arXiv:2407.04915 [pdf, html, other]

Title: Safe Generative Chats in a WhatsApp Intelligent Tutoring System

Zachary Levonian, Owen Henkel

Comments: EDM 2024 LLM Workshop

Subjects: Human-Computer Interaction (cs.HC)

[49] arXiv:2407.05003 [pdf, html, other]

Title: DCitizens Roles Unveiled: SIG Navigating Identities in Digital Civics and the Spectrum of Societal Impact

Anna R. L. Carter, Kyle Montague, Reem Talhouk, Shaun Lawson, Hugo Nicolau, Ana Cristina Pires, Markus Rohde, Alessio Del Bue, Tiffany Knearem

Subjects: Human-Computer Interaction (cs.HC)

[50] arXiv:2407.05016 [pdf, html, other]

Title: Envisioning Collaborative Futures: Advancing the Frontiers of Embedded Research

Anna R. L. Carter, Kyle Montague, Reem Talhouk, Ana O. Henriques, Hugo Nicolau, Tiffany Knearem, Ceylan Besevli, Firaz Peer, Clara Crivellaro, Sarah Rüller

Subjects: Human-Computer Interaction (cs.HC)

[51] arXiv:2407.05032 [pdf, html, other]

Title: And this is where we fu***d up! Lessons learned from Participatory Design in Digital Civic Initiatives

Clara Rosa Cardoso, Sarah Rüller, Ana O Henriques, Anna R L Carter, Markus Rohde

Subjects: Human-Computer Interaction (cs.HC)

[52] arXiv:2407.05079 [pdf, html, other]

Title: Form Forge: Latent Space Exploration of Architectural Forms via Explicit Latent Variable Manipulation

Kevin Dunnell, Andy Lippman

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)

[53] arXiv:2407.05203 [pdf, html, other]

Title: Toward a Unified Metadata Schema for Ecological Momentary Assessment with Voice-First Virtual Assistants

Chen Chen, Khalil Mrini, Kemeberly Charles, Ella T. Lifset, Michael Hogarth, Alison A. Moore, Nadir Weibel, Emilia Farcas

Comments: 6 pages, In Proceedings of the 3rd Conference on Conversational User Interfaces (CUI '21). Association for Computing Machinery, New York, NY, USA, Article 31, 1-6

Subjects: Human-Computer Interaction (cs.HC)

[54] arXiv:2407.05427 [pdf, html, other]

Title: MelodyVis: Visual Analytics for Melodic Patterns in Sheet Music

Matthias Miller, Daniel Fürst, Maximilian T. Fischer, Hanna Hauptmann, Daniel Keim, Mennatallah El-Assady

Comments: 9+2 pages, 9 figures, preprint, originally submitted to IEEE VIS 23, revision

Subjects: Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR)

[55] arXiv:2407.05446 [pdf, html, other]

Title: Towards Perceived Security, Perceived Privacy, and the Universal Design of E-Payment Applications

Urvashi Kishnani, Isabella Cardenas, Jailene Castillo, Rosalyn Conry, Lukas Rodwin, Rika Ruiz, Matthew Walther, Sanchari Das

Subjects: Human-Computer Interaction (cs.HC); Cryptography and Security (cs.CR)

[56] arXiv:2407.05450 [pdf, html, other]

Title: Understanding Professional Needs to Create Privacy-Preserving and Secure Emergent Digital Artworks

Kathryn Lichlyter, Urvashi Kishnani, Kate Hollenbach, Sanchari Das

Subjects: Human-Computer Interaction (cs.HC)

[57] arXiv:2407.05504 [pdf, other]

Title: Multimedia and Immersive Training Materials Influence Impressions of Learning But Not Learning Outcomes

Benjamin A. Clegg, Alex Karduna, Ethan Holen, Jason Garcia, Matthew G. Rhodes, Francisco R. Ortega

Comments: published and presented in I/ITSEC 2022

Subjects: Human-Computer Interaction (cs.HC)

[58] arXiv:2407.05550 [pdf, html, other]

Title: MEEG and AT-DGNN: Improving EEG Emotion Recognition with Music Introducing and Graph-based Learning

Minghao Xiao, Zhengxi Zhu, Kang Xie, Bin Jiang

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)

[59] arXiv:2407.05584 [pdf, html, other]

Title: Exploring Real-Time Music-to-Image Systems for Creative Inspiration in Music Creation

Meng Yang, Maria Teresa Llano, Jon McCormack

Comments: 8 pages, 7 figures. Accepted by 15th International Conference on Computational Creativity, ICCC 24

Subjects: Human-Computer Interaction (cs.HC)

[60] arXiv:2407.05655 [pdf, other]

Title: Constrained Online Recursive Source Separation Framework for Real-time Electrophysiological Signal Processing

Yao Li, Haowen Zhao, Yunfei Liu, Xu Zhang

Subjects: Human-Computer Interaction (cs.HC)

[61] arXiv:2407.05803 [pdf, other]

Title: Multimodal Machine Learning for Automated Assessment of Attention-Related Processes during Learning

Babette Bühler

Comments: Doctoral thesis

Subjects: Human-Computer Interaction (cs.HC)

[62] arXiv:2407.05833 [pdf, html, other]

Title: See-Through Face Display: Enabling Gaze Communication for Any Face$\unicode{x2013}$Human or AI

Kazuya Izumi, Ryosuke Hyakuta, Ippei Suzuki, Yoichi Ochiai

Subjects: Human-Computer Interaction (cs.HC)

[63] arXiv:2407.05874 [pdf, html, other]

Title: Investigating Trading Mechanisms as a Driver for User Experience in Racing Games

Georg Arbesser-Rastburg, Thomas Olip, Johanna Pirker

Comments: 4 pages, 2 figures, to be published in the the conference proceedings of IEEE Conference on Games 2024

Subjects: Human-Computer Interaction (cs.HC)

[64] arXiv:2407.05977 [pdf, html, other]

Title: Exploring Human-LLM Conversations: Mental Models and the Originator of Toxicity

Johannes Schneider, Arianna Casanova Flores, Anne-Catherine Kranz

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)

[65] arXiv:2407.06123 [pdf, html, other]

Title: Investigating User Perceptions of Collaborative Agenda Setting in Virtual Health Counseling Session

Mina Fallah, Farnaz Nouraei, Hye Sun Yun, Timothy Bickmore

Subjects: Human-Computer Interaction (cs.HC)

[66] arXiv:2407.06125 [pdf, html, other]

Title: Depression Detection and Analysis using Large Language Models on Textual and Audio-Visual Modalities

Chayan Tank, Sarthak Pol, Vinayak Katoch, Shaina Mehta, Avinash Anand, Rajiv Ratn Shah

Comments: 12 pages, 9 figures, 9 tables

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)

[67] arXiv:2407.06345 [pdf, html, other]

Title: SocialEyes: Scaling mobile eye-tracking to multi-person social settings

Shreshth Saxena, Areez Visram, Neil Lobo, Zahid Mirza, Mehak Rafi Khan, Biranugan Pirabaharan, Alexander Nguyen, Lauren K. Fink

Comments: Please refer to the supplementary video illustrating the proposed approach in this paper here: this https URL

Journal-ref: In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI '25), Association for Computing Machinery, New York, NY, USA, Article 751, 1--19

Subjects: Human-Computer Interaction (cs.HC); Computational Engineering, Finance, and Science (cs.CE); Computers and Society (cs.CY); Emerging Technologies (cs.ET)

[68] arXiv:2407.06404 [pdf, html, other]

Title: Design-Specific Transformations in Visualization

Eugene Wu, Remco Chang

Subjects: Human-Computer Interaction (cs.HC)

[69] arXiv:2407.06436 [pdf, other]

Title: Simplifying Integration of Custom Controllers in Exergames

Hassan Ali Khan, Muhammad Asbar Javed, Amnah Khan

Subjects: Human-Computer Interaction (cs.HC)

[70] arXiv:2407.06441 [pdf, html, other]

Title: A Study of Digital Appliances Accessibility for People with Visual Disabilities

Hyunjin An, Hyundoug Kim, Seungwoo Hong, Youngsun Shin

Comments: 10 pages, 3 figures

Subjects: Human-Computer Interaction (cs.HC)

[71] arXiv:2407.06498 [pdf, html, other]

Title: Enhancing spatial auditory attention decoding with neuroscience-inspired prototype training

Zelin Qiu, Jianjun Gu, Dingding Yao, Junfeng Li

Subjects: Human-Computer Interaction (cs.HC)

[72] arXiv:2407.06505 [pdf, other]

Title: Not all explicit cues help communicate: Pedestrians' perceptions, fixations, and decisions toward automated vehicles with varied appearance

Wei Lyu, Yaqin Cao, Yi Ding, Jingyu Li, Kai Tian, Hui Zhang

Comments: 37 pages, 13 figures, 4 tables

Subjects: Human-Computer Interaction (cs.HC)

[73] arXiv:2407.06798 [pdf, html, other]

Title: It Cannot Be Right If It Was Written by AI: On Lawyers' Preferences of Documents Perceived as Authored by an LLM vs a Human

Jakub Harasta, Tereza Novotná, Jaromir Savelka

Comments: 40 pages, 12 figures. Accepted for publication with Artificial Intelligence and Law (Springer Nature)

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)

[74] arXiv:2407.06846 [pdf, html, other]

Title: SilverCycling: Exploring the Impact of Bike-Based Locomotion on Spatial Orientation for Older Adults in VR

Qiongyan Chen, Zhiqing Wu, Yucheng Liu, Lei Han, Zisu Li, Ge Lin Kan, Mingming Fan

Comments: 19 pages, 6 figures

Subjects: Human-Computer Interaction (cs.HC)

[75] arXiv:2407.06901 [pdf, html, other]

Title: RespEar: Earable-Based Robust Respiratory Rate Monitoring

Yang Liu, Kayla-Jade Butkow, Jake Stuchbury-Wass, Adam Pullin, Dong Ma, Cecilia Mascolo

Subjects: Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[76] arXiv:2407.06967 [pdf, html, other]

Title: INTERACT: An authoring tool that facilitates the creation of human centric interaction with 3d objects in virtual reality

Rama Krishnan Gopal Ramasamy Thandapani, Benjamin Capel, Antoine Lasnier, Ioannis Chatzigiannakis

Subjects: Human-Computer Interaction (cs.HC)

[77] arXiv:2407.07015 [pdf, html, other]

Title: A Framework for Multimodal Medical Image Interaction

Laura Schütz, Sasan Matinfar, Gideon Schafroth, Navid Navab, Merle Fairhurst, Arthur Wagner, Benedikt Wiestler, Ulrich Eck, Nassir Navab

Comments: Accepted for publication in IEEE TVCG; presentation at IEEE ISMAR 2024

Subjects: Human-Computer Interaction (cs.HC); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[78] arXiv:2407.07196 [pdf, html, other]

Title: Large Language Models for Wearable Sensor-Based Human Activity Recognition, Health Monitoring, and Behavioral Modeling: A Survey of Early Trends, Datasets, and Challenges

Emilio Ferrara

Journal-ref: Sensors, 2024

Subjects: Human-Computer Interaction (cs.HC)

[79] arXiv:2407.07367 [pdf, html, other]

Title: An Evaluation of Immersive Infographics for News Reporting: Quantifying the Effect of Mobile AR Concrete Scales Infographics on Volume Understanding

Mariane Giambastiani, Jorge Wagner, Carla M. Dal Sasso Freitas, Luciana Nedel

Subjects: Human-Computer Interaction (cs.HC)

[80] arXiv:2407.07393 [pdf, html, other]

Title: CHOP: Integrating ChatGPT into EFL Oral Presentation Practice

Jungyoub Cha, Jieun Han, Haneul Yoo, Alice Oh

Subjects: Human-Computer Interaction (cs.HC)

[81] arXiv:2407.07653 [pdf, html, other]

Title: AffectGPT: Dataset and Framework for Explainable Multimodal Emotion Recognition

Zheng Lian, Haiyang Sun, Licai Sun, Jiangyan Yi, Bin Liu, Jianhua Tao

Subjects: Human-Computer Interaction (cs.HC)

[82] arXiv:2407.07672 [pdf, html, other]

Title: StoryDiffusion: How to Support UX Storyboarding With Generative-AI

Zhaohui Liang, Xiaoyu Zhang, Kevin Ma, Zhao Liu, Xipei Ren, Kosa Goucher-Lambert, Can Liu

Subjects: Human-Computer Interaction (cs.HC)

[83] arXiv:2407.07683 [pdf, html, other]

Title: The Language of Weather: Social Media Reactions to Weather Accounting for Climatic and Linguistic Baselines

James C. Young, Rudy Arthur, Hywel T.P. Williams

Comments: 12 pages, 5 figures

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[84] arXiv:2407.07698 [pdf, other]

Title: The V-Lab VR Educational Application Framework

Vasilis Zafeiropoulos, George Anastassakis, Theophanis Orphanoudakis, Dimitris Kalles, Anastasios Fanariotis, Vassilis Fotopoulos

Comments: 7 pages, 3 figures, Proceedings of the 25th International Conference on Mobile Human-Computer Interaction (MobileHCI '23)

Journal-ref: MobileHCI '23 Companion: Proceedings of the 25th International Conference on Mobile Human-Computer Interaction (2023)

Subjects: Human-Computer Interaction (cs.HC)

[85] arXiv:2407.07732 [pdf, other]

Title: Text2VP: Generative AI for Visual Programming and Parametric Modeling

Guangxi Feng, Wei Yan

Comments: Demonstration Video: this https URL

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)

[86] arXiv:2407.07786 [pdf, html, other]

Title: The Human Factor in AI Red Teaming: Perspectives from Social and Collaborative Computing

Alice Qian Zhang, Ryland Shaw, Jacy Reese Anthis, Ashlee Milton, Emily Tseng, Jina Suh, Lama Ahmad, Ram Shankar Siva Kumar, Julian Posada, Benjamin Shestakofsky, Sarah T. Roberts, Mary L. Gray

Comments: Updated with camera-ready version

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)

[87] arXiv:2407.08011 [pdf, html, other]

Title: Stretch your reach: Studying Self-Avatar and Controller Misalignment in Virtual Reality Interaction

Jose Luis Ponton, Reza Keshavarz, Alejandro Beacco, Nuria Pelechano

Comments: Presented in CHI'24

Subjects: Human-Computer Interaction (cs.HC); Graphics (cs.GR)

[88] arXiv:2407.08067 [pdf, html, other]

Title: On LLM Wizards: Identifying Large Language Models' Behaviors for Wizard of Oz Experiments

Jingchao Fang, Nikos Arechiga, Keiichi Namaoshi, Nayeli Bravo, Candice Hogan, David A. Shamma

Comments: To be published in ACM IVA 2024

Journal-ref: ACM International Conference on Intelligent Virtual Agents (IVA 2024), September 16-19, 2024, Glasgow, United Kingdom. ACM, New York, NY, USA

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)

[89] arXiv:2407.08095 [pdf, html, other]

Title: Virtual Agents for Alcohol Use Counseling: Exploring LLM-Powered Motivational Interviewing

Ian Steenstra, Farnaz Nouraei, Mehdi Arjmand, Timothy W. Bickmore

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[90] arXiv:2407.08143 [pdf, html, other]

Title: CommSense: A Wearable Sensing Computational Framework for Evaluating Patient-Clinician Interactions

Zhiyuan Wang, Nusayer Hassan, Virginia LeBaron, Tabor E. Flickinger, David Ling, James Edwards, Congyu Wu, Mehdi Boukhechba, Laura E. Barnes

Comments: 30 pages, accepted by ACM CSCW 2024, to appear in PACM HCI

Subjects: Human-Computer Interaction (cs.HC)

[91] arXiv:2407.08174 [pdf, html, other]

Title: An Adaptively Weighted Averaging Method for Regional Time Series Extraction of fMRI-based Brain Decoding

Jianfei Zhu, Baichun Wei, Jiaru Tian, Feng Jiang, Chunzhi Yi

Comments: 17 pages, 4 figures

Subjects: Human-Computer Interaction (cs.HC); Neurons and Cognition (q-bio.NC)

[92] arXiv:2407.08240 [pdf, html, other]

Title: Leveraging LLMs to Predict Affective States via Smartphone Sensor Features

Tianyi Zhang, Songyan Teng, Hong Jia, Simon D'Alfonso

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)

[93] arXiv:2407.08287 [pdf, html, other]

Title: Towards a Quality Approach to Hierarchical Color Maps

Tobias Mertz (1), Jörn Kohlhammer (1 and 2) ((1) Fraunhofer IGD, (2) TU Darmstadt)

Journal-ref: 2024 IEEE Visualization and Visual Analytics (VIS), St. Pete Beach, FL, USA, 2024, pp. 221-225

Subjects: Human-Computer Interaction (cs.HC)

[94] arXiv:2407.08474 [pdf, html, other]

Title: DIDUP: Dynamic Iterative Development for UI Prototyping

Jenny Ma, Karthik Sreedhar, Vivian Liu, Sitong Wang, Pedro Alejandro Perez, Lydia B. Chilton

Comments: 5 pages, 3 figures

Subjects: Human-Computer Interaction (cs.HC); Software Engineering (cs.SE)

[95] arXiv:2407.08501 [pdf, html, other]

Title: SelfIE: Self-Initiated Explorable Instructions Towards Enhanced User Experience

Hyeongcheol Kim, Katherine Fennedy, Georgia Zhang, Can Liu, Shengdong Zhao

Subjects: Human-Computer Interaction (cs.HC)

[96] arXiv:2407.08740 [pdf, html, other]

Title: Reimagining AI: Exploring Speculative Design Workshops for Supporting BIPOC Youth Critical AI Literacies

Sadhbh Kenny, Alissa N. Antle

Comments: This paper has been peer-reviewed and presented at the CHI 2024 Workshop on Child-centred AI Design, May 11, 2024, Honolulu, HI, USA

Subjects: Human-Computer Interaction (cs.HC)

[97] arXiv:2407.08741 [pdf, other]

Title: A digital twin based approach to smart lighting design

Elham Mohammadrezaei, Alexander Giovannelli, Logan Lane, Denis Gracanin

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)

[98] arXiv:2407.08850 [pdf, html, other]

Title: UICrit: Enhancing Automated Design Evaluation with a UICritique Dataset

Peitong Duan, Chin-yi Chen, Gang Li, Bjoern Hartmann, Yang Li

Comments: Accepted to ACM UIST 2024

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)

[99] arXiv:2407.08853 [pdf, html, other]

Title: GPT-4 is judged more human than humans in displaced and inverted Turing tests

Ishika Rathi, Sydney Taylor, Benjamin K. Bergen, Cameron R. Jones

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[100] arXiv:2407.08882 [pdf, html, other]

Title: Emerging Practices for Large Multimodal Model (LMM) Assistance for People with Visual Impairments: Implications for Design

Jingyi Xie, Rui Yu, He Zhang, Sooyeon Lee, Syed Masum Billah, John M. Carroll

Subjects: Human-Computer Interaction (cs.HC)