Audio and Speech Processing

Authors and titles for May 2025

[151] arXiv:2505.23515 [pdf, html, other]

Title: DeepFilterGAN: A Full-band Real-time Speech Enhancement System with GAN-based Stochastic Regeneration

Sanberk Serbest, Tijana Stojkovic, Milos Cernak, Andrew Harper

Comments: Accepted to Interspeech 2025

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Signal Processing (eess.SP)

[152] arXiv:2505.23962 [pdf, html, other]

Title: Can Emotion Fool Anti-spoofing?

Aurosweta Mahapatra, Ismail Rasim Ulgen, Abinay Reddy Naini, Carlos Busso, Berrak Sisman

Comments: Accepted to Interspeech 2025

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[153] arXiv:2505.24111 [pdf, html, other]

Title: Fine-tune Before Structured Pruning: Towards Compact and Accurate Self-Supervised Models for Speaker Diarization

Jiangyu Han, Federico Landini, Johan Rohdin, Anna Silnova, Mireia Diez, Jan Cernocky, Lukas Burget

Comments: Accepted by INTERSPEECH 2025

Subjects: Audio and Speech Processing (eess.AS)

[154] arXiv:2505.24224 [pdf, html, other]

Title: MOPSA: Mixture of Prompt-Experts Based Speaker Adaptation for Elderly Speech Recognition

Chengxi Deng, Xurong Xie, Shujie Hu, Mengzhe Geng, Yicong Jiang, Jiankun Zhao, Jiajun Deng, Guinan Li, Youjun Chen, Huimeng Wang, Haoning Xu, Mingyu Cui, Xunying Liu

Comments: Accepted by Interspeech 2025

Subjects: Audio and Speech Processing (eess.AS)

[155] arXiv:2505.24248 [pdf, other]

Title: Probing the Robustness Properties of Neural Speech Codecs

Wei-Cheng Tseng, David Harwath

Comments: Interspeech 2025

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[156] arXiv:2505.24304 [pdf, html, other]

Title: A Perception-Based L2 Speech Intelligibility Indicator: Leveraging a Rater's Shadowing and Sequence-to-sequence Voice Conversion

Haopeng Geng, Daisuke Saito, Nobuaki Minematsu

Comments: Accepted by Interspeech 2025

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[157] arXiv:2505.24336 [pdf, html, other]

Title: When Humans Growl and Birds Speak: High-Fidelity Voice Conversion from Human to Animal and Designed Sounds

Minsu Kang, Seolhee Lee, Choonghyeon Lee, Namhyun Cho

Comments: INTERSPEECH 2025 accepted

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)

[158] arXiv:2505.24496 [pdf, html, other]

Title: Speech Token Prediction via Compressed-to-fine Language Modeling for Speech Generation

Wenrui Liu, Qian Chen, Wen Wang, Yafeng Chen, Jin Xu, Zhifang Guo, Guanrou Yang, Weiqin Li, Xiaoda Yang, Tao Jin, Minghui Fang, Jialong Zuo, Bai Jionghao, Zemin Liu

Subjects: Audio and Speech Processing (eess.AS)

[159] arXiv:2505.24545 [pdf, other]

Title: Pretraining Multi-Speaker Identification for Neural Speaker Diarization

Shota Horiguchi, Atsushi Ando, Marc Delcroix, Naohiro Tawara

Comments: Accepted to Interspeech 2025

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[160] arXiv:2505.24571 [pdf, html, other]

Title: Identifying Primary Stress Across Related Languages and Dialects with Transformer-based Speech Encoder Models

Nikola Ljubešić, Ivan Porupski, Peter Rupnik

Comments: Accepted to InterSpeech2025

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[161] arXiv:2505.24576 [pdf, html, other]

Title: A Composite Predictive-Generative Approach to Monaural Universal Speech Enhancement

Jie Zhang, Haoyin Yan, Xiaofei Li

Comments: Accepted by IEEE Transactions on Audio, Speech and Language Processing

Subjects: Audio and Speech Processing (eess.AS)

[162] arXiv:2505.24736 [pdf, html, other]

Title: "Dyadosyncrasy", Idiosyncrasy and Demographic Factors in Turn-Taking

Julio Cesar Cavalcanti, Gabriel Skantze

Comments: Accepted to Interspeech 2025

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[163] arXiv:2505.00059 (cross-list from cs.CL) [pdf, html, other]

Title: BERSting at the Screams: A Benchmark for Distanced, Emotional and Shouted Speech Recognition

Paige Tuttösí, Mantaj Dhillon, Luna Sang, Shane Eastwood, Poorvi Bhatia, Quang Minh Dinh, Avni Kapoor, Yewon Jin, Angelica Lim

Comments: Accepted to Computer Speech and Language, Special issue: Multi-Speaker, Multi-Microphone, and Multi-Modal Distant Speech Recognition. Project Webpage and Data access : this https URL

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[164] arXiv:2505.00579 (cross-list from cs.SD) [pdf, html, other]

Title: Voice Cloning: Comprehensive Survey

Hussam Azzuni, Abdulmotaleb El Saddik

Comments: 26 pages, 7 figures

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[165] arXiv:2505.00750 (cross-list from cs.SD) [pdf, other]

Title: GVPT -- A software for guided visual pitch tracking

Hyunjin Cho, Farhad Tabasi, Jeremy D. Greenlee, Rahul Singh

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[166] arXiv:2505.00839 (cross-list from cs.SD) [pdf, html, other]

Title: SMSAT: A Multimodal Acoustic Dataset and Deep Contrastive Learning Framework for Affective and Physiological Modeling of Spiritual Meditation

Ahmad Suleman, Yazeed Alkhrijah, Misha Urooj Khan, Hareem Khan, Muhammad Abdullah Husnain Ali Faiz, Mohamad A. Alawad, Zeeshan Kaleem, Guan Gui

Subjects: Sound (cs.SD); Social and Information Networks (cs.SI); Audio and Speech Processing (eess.AS)

[167] arXiv:2505.01237 (cross-list from cs.MM) [pdf, html, other]

Title: CAV-MAE Sync: Improving Contrastive Audio-Visual Mask Autoencoders via Fine-Grained Alignment

Edson Araujo, Andrew Rouditchenko, Yuan Gong, Saurabhchand Bhati, Samuel Thomas, Brian Kingsbury, Leonid Karlinsky, Rogerio Feris, James R. Glass, Hilde Kuehne

Comments: To be published at CVPR 2025, code available at this https URL

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[168] arXiv:2505.01263 (cross-list from cs.MM) [pdf, html, other]

Title: FlowDubber: Movie Dubbing with LLM-based Semantic-aware Learning and Flow Matching based Voice Enhancing

Gaoxiang Cong, Liang Li, Jiadong Pan, Zhedong Zhang, Amin Beheshti, Anton van den Hengel, Yuankai Qi, Qingming Huang

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[169] arXiv:2505.01369 (cross-list from cs.SD) [pdf, html, other]

Title: Binamix -- A Python Library for Generating Binaural Audio Datasets

Dan Barry, Davoud Shariat Panah, Alessandro Ragano, Jan Skoglund, Andrew Hines

Comments: Accepted to the 158th Audio Engineering Society Convention, 2025

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[170] arXiv:2505.01880 (cross-list from cs.SD) [pdf, html, other]

Title: Weakly-supervised Audio Temporal Forgery Localization via Progressive Audio-language Co-learning Network

Junyan Wu, Wenbo Xu, Wei Lu, Xiangyang Luo, Rui Yang, Shize Guo

Comments: 9pages, 5figures. This paper has been accepted for IJCAI2025

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[171] arXiv:2505.02180 (cross-list from cs.SD) [pdf, html, other]

Title: MaskClip: Detachable Clip-on Piezoelectric Sensing of Mask Surface Vibrations for Real-time Noise-Robust Speech Input

Hirotaka Hiraki, Jun Rekimoto

Comments: Augmented Humans 2025

Subjects: Sound (cs.SD); Hardware Architecture (cs.AR); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[172] arXiv:2505.02518 (cross-list from cs.CL) [pdf, html, other]

Title: Bemba Speech Translation: Exploring a Low-Resource African Language

Muhammad Hazim Al Farouq, Aman Kassahun Wassie, Yasmin Moslem

Comments: IWSLT 2025

Journal-ref: Proceedings of the 22nd International Conference on Spoken Language Translation (IWSLT 2025)

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[173] arXiv:2505.02615 (cross-list from cs.CL) [pdf, html, other]

Title: Automatic Proficiency Assessment in L2 English Learners

Armita Mohammadi, Alessandro Lameiras Koerich, Laureano Moro-Velazquez, Patrick Cardinal

Comments: 6 pages

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[174] arXiv:2505.02625 (cross-list from cs.CL) [pdf, html, other]

Title: LLaMA-Omni2: LLM-based Real-time Spoken Chatbot with Autoregressive Streaming Speech Synthesis

Qingkai Fang, Yan Zhou, Shoutao Guo, Shaolei Zhang, Yang Feng

Comments: Preprint. Project: this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[175] arXiv:2505.02692 (cross-list from cs.CL) [pdf, other]

Title: fastabx: A library for efficient computation of ABX discriminability

Maxime Poli, Emmanuel Chemla, Emmanuel Dupoux

Comments: 8 pages, 6 figures

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[176] arXiv:2505.03054 (cross-list from cs.AI) [pdf, html, other]

Title: BLAB: Brutally Long Audio Bench

Orevaoghene Ahia, Martijn Bartelds, Kabir Ahuja, Hila Gonen, Valentin Hofmann, Siddhant Arora, Shuyue Stella Li, Vishal Puttagunta, Mofetoluwa Adeyemi, Charishma Buchireddy, Ben Walls, Noah Bennett, Shinji Watanabe, Noah A. Smith, Yulia Tsvetkov, Sachin Kumar

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[177] arXiv:2505.03073 (cross-list from cs.HC) [pdf, html, other]

Title: Coupling the Heart to Musical Machines

Eric Easthope

Subjects: Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[178] arXiv:2505.03186 (cross-list from cs.SD) [pdf, html, other]

Title: CoGenAV: Versatile Audio-Visual Representation Learning via Contrastive-Generative Synchronization

Detao Bai, Zhiheng Ma, Xihan Wei, Liefeng Bo

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[179] arXiv:2505.03193 (cross-list from cs.SD) [pdf, other]

Title: A study on audio synchronous steganography detection and distributed guide inference model based on sliding spectral features and intelligent inference drive

Wei Meng

Comments: This paper proposes a novel framework for detecting steganographic content in short video audio streams using sliding spectral features and distributed inference models, combining STFT analysis, entropy-based synchronization, and deep learning-driven decoding strategies

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Audio and Speech Processing (eess.AS)

[180] arXiv:2505.03228 (cross-list from cs.SD) [pdf, html, other]

Title: MGFF-TDNN: A Multi-Granularity Feature Fusion TDNN Model with Depth-Wise Separable Module for Speaker Verification

Ya Li, Bin Zhou, Bo Hu

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[181] arXiv:2505.03244 (cross-list from cs.SD) [pdf, html, other]

Title: SonicRAG : High Fidelity Sound Effects Synthesis Based on Retrival Augmented Generation

Yu-Ren Guo, Wen-Kai Tai

Comments: 8 pages, 5 figures

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[182] arXiv:2505.03273 (cross-list from cs.SD) [pdf, html, other]

Title: SepALM: Audio Language Models Are Error Correctors for Robust Speech Separation

Zhaoxi Mu, Xinyu Yang, Gang Wang

Comments: Appears in IJCAI 2025

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[183] arXiv:2505.03314 (cross-list from cs.SD) [pdf, html, other]

Title: Mamba-Diffusion Model with Learnable Wavelet for Controllable Symbolic Music Generation

Jincheng Zhang, György Fazekas, Charalampos Saitis

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[184] arXiv:2505.03337 (cross-list from cs.SD) [pdf, other]

Title: The Inverse Drum Machine: Source Separation Through Joint Transcription and Analysis-by-Synthesis

Bernardo Torres (S2A, IDS), Geoffroy Peeters (S2A, IDS), Gael Richard (S2A, IDS)

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP); Machine Learning (stat.ML)

[185] arXiv:2505.03442 (cross-list from cs.SD) [pdf, html, other]

Title: Knowledge Distillation for Speech Denoising by Latent Representation Alignment with Cosine Distance

Diep Luong, Mikko Heikkinen, Konstantinos Drossos, Tuomas Virtanen

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[186] arXiv:2505.04066 (cross-list from cs.LG) [pdf, html, other]

Title: LLAMAPIE: Proactive In-Ear Conversation Assistants

Tuochao Chen, Nicholas Batchelder, Alisa Liu, Noah Smith, Shyamnath Gollakota

Comments: Published by ACL2025 (Findings)

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[187] arXiv:2505.04113 (cross-list from cs.SD) [pdf, other]

Title: Advancing Zero-shot Text-to-Speech Intelligibility across Diverse Domains via Preference Alignment

Xueyao Zhang, Yuancheng Wang, Chaoren Wang, Ziniu Li, Zhuo Chen, Zhizheng Wu

Comments: Accepted by ACL 2025

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[188] arXiv:2505.04203 (cross-list from cs.GR) [pdf, html, other]

Title: ELGAR: Expressive Cello Performance Motion Generation for Audio Rendition

Zhiping Qiu, Yitong Jin, Yuan Wang, Yi Shi, Chongwu Wang, Chao Tan, Xiaobing Li, Feng Yu, Tao Yu, Qionghai Dai

Journal-ref: SIGGRAPH 2025

Subjects: Graphics (cs.GR); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[189] arXiv:2505.04394 (cross-list from cs.CV) [pdf, html, other]

Title: SwinLip: An Efficient Visual Speech Encoder for Lip Reading Using Swin Transformer

Young-Hu Park, Rae-Hong Park, Hyung-Min Park

Journal-ref: Neurocomputing, Volume 639, 28 July 2025, 130289

Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[190] arXiv:2505.04451 (cross-list from cs.SD) [pdf, html, other]

Title: Automatic Music Transcription using Convolutional Neural Networks and Constant-Q transform

Yohannis Telila, Tommaso Cucinotta, Davide Bacciu

Comments: 6 pages

Journal-ref: 3rd National CINI Conference on Artificial Intelligence (Ital-IA 2023)

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[191] arXiv:2505.04457 (cross-list from cs.SD) [pdf, html, other]

Title: Miipher-2: A Universal Speech Restoration Model for Million-Hour Scale Data Restoration

Shigeki Karita, Yuma Koizumi, Heiga Zen, Haruko Ishikawa, Robin Scheibler, Michiel Bacchiani

Comments: Accepted to IEEE WASPAA2025

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[192] arXiv:2505.04621 (cross-list from cs.SD) [pdf, html, other]

Title: Score Distillation Sampling for Audio: Source Separation, Synthesis, and Beyond

Jessie Richter-Powell, Antonio Torralba, Jonathan Lorraine

Comments: See the project website at this https URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[193] arXiv:2505.04623 (cross-list from cs.CV) [pdf, html, other]

Title: EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning

Zhenghao Xing, Xiaowei Hu, Chi-Wing Fu, Wenhai Wang, Jifeng Dai, Pheng-Ann Heng

Subjects: Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[194] arXiv:2505.04728 (cross-list from cs.SD) [pdf, other]

Title: Data Standards in Audiology: A Mixed-Methods Exploration of Community Perspectives and Implementation Considerations

Charlotte Vercammen, Antje Heinrich, Christophe Lesimple, Alessia Paglialonga, Jan-Willem A. Wasmann, Mareike Buhl

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Medical Physics (physics.med-ph)

[195] arXiv:2505.04885 (cross-list from cs.SD) [pdf, html, other]

Title: A Multi-Agent AI Framework for Immersive Audiobook Production through Spatial Audio and Neural Narration

Shaja Arul Selvamani, Nia D'Souza Ganapathy

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Multiagent Systems (cs.MA); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[196] arXiv:2505.04996 (cross-list from cs.GR) [pdf, html, other]

Title: Inter-Diffusion Generation Model of Speakers and Listeners for Effective Communication

Jinhe Huang, Yongkang Cheng, Yuming Hang, Gaoge Han, Jinewei Li, Jing Zhang, Xingjian Gu

Comments: accepted by ICMR 2025

Subjects: Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[197] arXiv:2505.05055 (cross-list from cs.SD) [pdf, html, other]

Title: How to Infer Repeat Structures in MIDI Performances

Silvan Peter, Patricia Hu, Gerhard Widmer

Comments: 3 pages, 1 figure, 1 table, to be published in the Music Encoding Conference 2025

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[198] arXiv:2505.05077 (cross-list from cs.SD) [pdf, html, other]

Title: ReverbMiipher: Generative Speech Restoration meets Reverberation Characteristics Controllability

Wataru Nakata, Yuma Koizumi, Shigeki Karita, Robin Scheibler, Haruko Ishikawa, Adriana Guevara-Rukoz, Heiga Zen, Michiel Bacchiani

Comments: 5 pages, 5 figures

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[199] arXiv:2505.05078 (cross-list from cs.SD) [pdf, html, other]

Title: Pairing Real-Time Piano Transcription with Symbol-level Tracking for Precise and Robust Score Following

Silvan Peter, Patricia Hu, Gerhard Widmer

Comments: 5 pages, 3 tables, 2 pseudocodes, to be published at the Sound and Music Computing Conference 2025

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[200] arXiv:2505.05335 (cross-list from cs.SD) [pdf, html, other]

Title: FLAM: Frame-Wise Language-Audio Modeling

Yusong Wu, Christos Tsirigotis, Ke Chen, Cheng-Zhi Anna Huang, Aaron Courville, Oriol Nieto, Prem Seetharaman, Justin Salamon

Comments: Accepted at ICML 2025 V2: fixed small typo on eq. 15 and eq. 17

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)