Audio and Speech Processing

Authors and titles for May 2023

[101] arXiv:2305.15536 [pdf, other]

Title: RAND: Robustness Aware Norm Decay For Quantized Seq2seq Models

David Qiu, David Rim, Shaojin Ding, Oleg Rybakov, Yanzhang He

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)

[102] arXiv:2305.15567 [pdf, other]

Title: Generalized domain adaptation framework for parametric back-end in speaker recognition

Qiongqiong Wang, Koji Okabe, Kong Aik Lee, Takafumi Koshinaka

Subjects: Audio and Speech Processing (eess.AS)

[103] arXiv:2305.15749 [pdf, other]

Title: Multilingual Text-to-Speech Synthesis for Turkic Languages Using Transliteration

Rustem Yeshpanov, Saida Mussakhojayeva, Yerbolat Khassanov

Comments: 5 pages, 1 figure, 3 tables, accepted to Interspeech

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[104] arXiv:2305.15816 [pdf, other]

Title: DDDM-VC: Decoupled Denoising Diffusion Models with Disentangled Representation and Prior Mixup for Verified Robust Voice Conversion

Ha-Yeong Choi, Sang-Hoon Lee, Seong-Whan Lee

Comments: 23 pages, 10 figures, 17 tables, under review

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD); Signal Processing (eess.SP)

[105] arXiv:2305.15958 [pdf, other]

Title: Improving Scheduled Sampling for Neural Transducer-based ASR

Takafumi Moriya, Takanori Ashihara, Hiroshi Sato, Kohei Matsuura, Tomohiro Tanaka, Ryo Masumura

Comments: Accepted to ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS)

[106] arXiv:2305.15971 [pdf, other]

Title: Knowledge Distillation for Neural Transducer-based Target-Speaker ASR: Exploiting Parallel Mixture/Single-Talker Speech Data

Takafumi Moriya, Hiroshi Sato, Tsubasa Ochiai, Marc Delcroix, Takanori Ashihara, Kohei Matsuura, Tomohiro Tanaka, Ryo Masumura, Atsunori Ogawa, Taichi Asami

Comments: Accepted to Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS)

[107] arXiv:2305.16040 [pdf, other]

Title: The Power of Prosody and Prosody of Power: An Acoustic Analysis of Finnish Parliamentary Speech

Martti Vainio, Antti Suni, Juraj Šimko, Sofoklis Kakouros

Subjects: Audio and Speech Processing (eess.AS)

[108] arXiv:2305.16065 [pdf, other]

Title: ASR and Emotional Speech: A Word-Level Investigation of the Mutual Impact of Speech and Emotion Recognition

Yuanchao Li, Zeyu Zhao, Ondrej Klejch, Peter Bell, Catherine Lai

Comments: Accepted to INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[109] arXiv:2305.16076 [pdf, other]

Title: Transfer Learning for Personality Perception via Speech Emotion Recognition

Yuanchao Li, Peter Bell, Catherine Lai

Comments: Accepted to INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[110] arXiv:2305.16085 [pdf, other]

Title: Acoustic-to-Articulatory Speech Inversion Features for Mispronunciation Detection of /r/ in Child Speech Sound Disorders

Nina R Benway, Yashish M Siriwardena, Jonathan L Preston, Elaine Hitchcock, Tara McAllister, Carol Espy-Wilson

Comments: *denotes equal contribution. To appear in Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH 2023

Journal-ref: Proc. INTERSPEECH 2023, 4568-4572

Subjects: Audio and Speech Processing (eess.AS)

[111] arXiv:2305.16111 [pdf, other]

Title: Classifying Rhoticity of /r/ in Speech Sound Disorder using Age-and-Sex Normalized Formants

Nina R Benway, Jonathan L Preston, Asif Salekin, Yi Xiao, Harshit Sharma, Tara McAllister

Comments: To appear in Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH 2023

Journal-ref: Proc. INTERSPEECH 2023, 4563-4567

Subjects: Audio and Speech Processing (eess.AS)

[112] arXiv:2305.16286 [pdf, other]

Title: Weakly-Supervised Speech Pre-training: A Case Study on Target Speech Recognition

Wangyou Zhang, Yanmin Qian

Comments: Accepted by Interspeech; 5 pages, 1 figure, 3 tables

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[113] arXiv:2305.16608 [pdf, other]

Title: AudioDec: An Open-source Streaming High-fidelity Neural Audio Codec

Yi-Chiao Wu, Israel D. Gebru, Dejan Marković, Alexander Richard

Comments: 5 pages, 1 figure, 5 tables. Proc. ICASSP, 2023

Subjects: Audio and Speech Processing (eess.AS)

[114] arXiv:2305.16619 [pdf, other]

Title: 2-bit Conformer quantization for automatic speech recognition

Oleg Rybakov, Phoenix Meadowlark, Shaojin Ding, David Qiu, Jian Li, David Rim, Yanzhang He

Comments: submitted to Interspeech

Subjects: Audio and Speech Processing (eess.AS)

[115] arXiv:2305.16665 [pdf, other]

Title: ABC-KD: Attention-Based-Compression Knowledge Distillation for Deep Learning-Based Noise Suppression

Yixin Wan, Yuan Zhou, Xiulian Peng, Kai-Wei Chang, Yan Lu

Comments: This paper was accepted to Interspeech 2023 Main Conference

Journal-ref: Proceedings of INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[116] arXiv:2305.16690 [pdf, html, other]

Title: Learning Representation of Therapist Empathy in Counseling Conversation Using Siamese Hierarchical Attention Network

Dehua Tao, Tan Lee, Harold Chui, Sarah Luk

Comments: Accepted by INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS)

[117] arXiv:2305.16699 [pdf, other]

Title: Automatic Tuning of Loss Trade-offs without Hyper-parameter Search in End-to-End Zero-Shot Speech Synthesis

Seongyeon Park, Bohyung Kim, Tae-hyun Oh

Comments: Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[118] arXiv:2305.16753 [pdf, other]

Title: ElectrodeNet -- A Deep Learning Based Sound Coding Strategy for Cochlear Implants

Enoch Hsin-Ho Huang, Rong Chao, Yu Tsao, Chao-Min Wu

Comments: 12 pages and 7 figures. Preprint version; IEEE Transactions on Cognitive and Developmental Systems (accepted)

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Signal Processing (eess.SP)

[119] arXiv:2305.16862 [pdf, other]

Title: Neural modeling of magnetic tape recorders

Otto Mikkonen, Alec Wright, Eloi Moliner, Vesa Välimäki

Comments: Accepted to DAFx 2023. For accompanying web page, see this http URL

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[120] arXiv:2305.17394 [pdf, other]

Title: One-Step Knowledge Distillation and Fine-Tuning in Using Large Pre-Trained Self-Supervised Learning Models for Speaker Verification

Jungwoo Heo, Chan-yeong Lim, Ju-ho Kim, Hyun-seo Shin, Ha-Jin Yu

Comments: ISCA INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[121] arXiv:2305.17436 [pdf, other]

Title: Creating Personalized Synthetic Voices from Post-Glossectomy Speech with Guided Diffusion Models

Yusheng Tian, Guangyan Zhang, Tan Lee

Comments: submitted to INTERSPEECH 2023

Journal-ref: INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS)

[122] arXiv:2305.17719 [pdf, other]

Title: Adapting Language-Audio Models as Few-Shot Audio Learners

Jinhua Liang, Xubo Liu, Haohe Liu, Huy Phan, Emmanouil Benetos, Mark D. Plumbley, Wenwu Wang

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[123] arXiv:2305.17724 [pdf, other]

Title: Stochastic Pitch Prediction Improves the Diversity and Naturalness of Speech in Glow-TTS

Sewade Ogun, Vincent Colotte, Emmanuel Vincent

Comments: 5 pages with 3 figures, InterSpeech 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[124] arXiv:2305.17971 [pdf, other]

Title: Automatic Evaluation of Turn-taking Cues in Conversational Speech Synthesis

Erik Ekstedt, Siyang Wang, Éva Székely, Joakim Gustafson, Gabriel Skantze

Comments: Accepted at INTERSPEECH 2023, 5 pages, 2 figures, 4 tables

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[125] arXiv:2305.18074 [pdf, other]

Title: An Experimental Review of Speaker Diarization methods with application to Two-Speaker Conversational Telephone Speech recordings

Luca Serafini, Samuele Cornell, Giovanni Morrone, Enrico Zovato, Alessio Brutti, Stefano Squartini

Comments: 52 pages, 10 figures

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[126] arXiv:2305.18146 [pdf, other]

Title: A Hierarchical Context-aware Modeling Approach for Multi-aspect and Multi-granular Pronunciation Assessment

Fu-An Chao, Tien-Hong Lo, Tzu-I Wu, Yao-Ting Sung, Berlin Chen

Comments: Accepted to Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[127] arXiv:2305.18298 [pdf, other]

Title: Optimization design of a micro-perforated panel absorber with 8.6 octave bands

Xiaoming Wang, Chen Liang, Yulin Mei

Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP); Applied Physics (physics.app-ph); Classical Physics (physics.class-ph)

[128] arXiv:2305.18441 [pdf, other]

Title: DeCoR: Defy Knowledge Forgetting by Predicting Earlier Audio Codes

Xilin Jiang, Yinghao Aaron Li, Nima Mesgarani

Comments: INTERSPEECH 2023

Journal-ref: Proc. INTERSPEECH 2023, pp.2818--2822

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[129] arXiv:2305.18640 [pdf, other]

Title: Transforming the Embeddings: A Lightweight Technique for Speech Emotion Recognition Tasks

Orchid Chetia Phukan, Arun Balaji Buduru, Rajesh Sharma

Comments: Accepted to Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS)

[130] arXiv:2305.18739 [pdf, other]

Title: An empirical study on speech restoration guided by self supervised speech representation

Jaeuk Byun, Youna Ji, Soo Whan Chung, Soyeon Choe, Min Seok Choi

Comments: To be presented at ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS)

[131] arXiv:2305.18747 [pdf, other]

Title: Adapting Multi-Lingual ASR Models for Handling Multiple Talkers

Chenda Li, Yao Qian, Zhuo Chen, Naoyuki Kanda, Dongmei Wang, Takuya Yoshioka, Yanmin Qian, Michael Zeng

Comments: Accepted by Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[132] arXiv:2305.18753 [pdf, other]

Title: Dual Transformer Decoder based Features Fusion Network for Automated Audio Captioning

Jianyuan Sun, Xubo Liu, Xinhao Mei, Volkan Kılıç, Mark D. Plumbley, Wenwu Wang

Comments: INTERSPEECH 2023. arXiv admin note: substantial text overlap with arXiv:2210.05037

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[133] arXiv:2305.18802 [pdf, other]

Title: LibriTTS-R: A Restored Multi-Speaker Text-to-Speech Corpus

Yuma Koizumi, Heiga Zen, Shigeki Karita, Yifan Ding, Kohei Yatabe, Nobuyuki Morioka, Michiel Bacchiani, Yu Zhang, Wei Han, Ankur Bapna

Comments: Accepted to Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[134] arXiv:2305.18881 [pdf, other]

Title: MERLIon CCS Challenge: A English-Mandarin code-switching child-directed speech corpus for language identification and diarization

Victoria Y. H. Chua, Hexin Liu, Leibny Paola Garcia Perera, Fei Ting Woon, Jinyi Wong, Xiangyu Zhang, Sanjeev Khudanpur, Andy W. H. Khong, Justin Dauwels, Suzy J. Styles

Comments: Accepted by Interspeech 2023, 5 pages, 2 figures, 3 tables

Subjects: Audio and Speech Processing (eess.AS)

[135] arXiv:2305.18925 [pdf, other]

Title: Investigating model performance in language identification: beyond simple error statistics

Suzy J. Styles, Victoria Y. H. Chua, Fei Ting Woon, Hexin Liu, Leibny Paola Garcia Perera, Sanjeev Khudanpur, Andy W. H. Khong, Justin Dauwels

Comments: Accepted to Interspeech 2023, 5 pages, 5 figures

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[136] arXiv:2305.18975 [pdf, other]

Title: Voice Conversion With Just Nearest Neighbors

Matthew Baas, Benjamin van Niekerk, Herman Kamper

Comments: 5 page, 1 table, 2 figures. Accepted at Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[137] arXiv:2305.19011 [pdf, other]

Title: MiniSUPERB: Lightweight Benchmark for Self-supervised Speech Models

Yu-Hsiang Wang, Huang-Yu Chen, Kai-Wei Chang, Winston Hsu, Hung-yi Lee

Comments: Accepted to IEEE ASRU 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)

[138] arXiv:2305.19051 [pdf, other]

Title: Towards single integrated spoofing-aware speaker verification embeddings

Sung Hwan Mun, Hye-jin Shim, Hemlata Tak, Xin Wang, Xuechen Liu, Md Sahidullah, Myeonghun Jeong, Min Hyun Han, Massimiliano Todisco, Kong Aik Lee, Junichi Yamagishi, Nicholas Evans, Tomi Kinnunen, Nam Soo Kim, Jee-weon Jung

Comments: Accepted by INTERSPEECH 2023. Code and models are available in this https URL

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)

[139] arXiv:2305.19090 [pdf, other]

Title: Prospective Validation of Motor-Based Intervention with Automated Mispronunciation Detection of Rhotics in Residual Speech Sound Disorders

Nina R Benway, Jonathan L Preston

Comments: To appear in Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH 2023

Journal-ref: Proc. INTERSPEECH 2023, 4558-4562

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[140] arXiv:2305.19100 [pdf, other]

Title: Predicting Preferred Dialogue-to-Background Loudness Difference in Dialogue-Separated Audio

Luca Resti, Martin Strauss, Matteo Torcoli, Emanuël Habets, Bernd Edler

Comments: Paper accepted at the 15th International Conference on Quality of Multimedia Experience (QoMEX), 4 pages, 2 figures

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[141] arXiv:2305.19184 [pdf, other]

Title: Leveraging Semantic Information for Efficient Self-Supervised Emotion Recognition with Audio-Textual Distilled Models

Danilo de Oliveira, Navin Raj Prabhu, Timo Gerkmann

Comments: Accepted at Interspeech 2023

Journal-ref: Proc. Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[142] arXiv:2305.19255 [pdf, other]

Title: A Stutter Seldom Comes Alone -- Cross-Corpus Stuttering Detection as a Multi-label Problem

Sebastian P. Bayerl, Dominik Wagner, Ilja Baumann, Florian Hönig, Tobias Bocklet, Elmar Nöth, Korbinian Riedhammer

Comments: Accepted for presentation at Interspeech 2023. arXiv admin note: substantial text overlap with arXiv:2210.15982

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[143] arXiv:2305.19269 [pdf, other]

Title: Make-A-Voice: Unified Voice Synthesis With Discrete Representation

Rongjie Huang, Chunlei Zhang, Yongqi Wang, Dongchao Yang, Luping Liu, Zhenhui Ye, Ziyue Jiang, Chao Weng, Zhou Zhao, Dong Yu

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD)

[144] arXiv:2305.19396 [pdf, other]

Title: Resource-Efficient Fine-Tuning Strategies for Automatic MOS Prediction in Text-to-Speech for Low-Resource Languages

Phat Do, Matt Coler, Jelske Dijkstra, Esther Klabbers

Comments: Accepted at INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[145] arXiv:2305.19493 [pdf, other]

Title: MERLIon CCS Challenge Evaluation Plan

Leibny Paola Garcia Perera, Y.H. Victoria Chua, Hexin Liu, Fei Ting Woon, Andy W.H. Khong, Justin Dauwels, Sanjeev Khudanpur, Suzy J. Styles

Comments: Evaluation plan for Interspeech 2023 special session "MERLIon"

Subjects: Audio and Speech Processing (eess.AS)

[146] arXiv:2305.19539 [pdf, other]

Title: Few-shot Class-incremental Audio Classification Using Dynamically Expanded Classifier with Self-attention Modified Prototypes

Yanxiong Li, Wenchang Cao, Wei Xie, Jialong Li, Emmanouil Benetos

Comments: 13 pages, 8 figures, 12 tables. Accepted for publication in IEEE TMM

Subjects: Audio and Speech Processing (eess.AS)

[147] arXiv:2305.19541 [pdf, other]

Title: Few-Shot Speaker Identification Using Lightweight Prototypical Network with Feature Grouping and Interaction

Yanxiong Li, Hao Chen, Wenchang Cao, Qisheng Huang, Qianhua He

Comments: 12 pages, 4 figures, 12 tables. Accepted for publication in IEEE TMM

Subjects: Audio and Speech Processing (eess.AS)

[148] arXiv:2305.19610 [pdf, other]

Title: FN-SSL: Full-Band and Narrow-Band Fusion for Sound Source Localization

Yabo Wang, Bing Yang, Xiaofei Li

Subjects: Audio and Speech Processing (eess.AS)

[149] arXiv:2305.19972 [pdf, html, other]

Title: VILAS: Exploring the Effects of Vision and Language Context in Automatic Speech Recognition

Ziyi Ni, Minglun Han, Feilong Chen, Linghui Meng, Jing Shi, Pin Lv, Bo Xu

Comments: Accepted to ICASSP 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[150] arXiv:2305.00011 (cross-list from cs.SD) [pdf, html, other]

Title: Adversarial Representation Learning for Robust Privacy Preservation in Audio

Shayan Gharib, Minh Tran, Diep Luong, Konstantinos Drossos, Tuomas Virtanen

Comments: Published in IEEE Open Journal of Signal Processing

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[151] arXiv:2305.00104 (cross-list from cs.CV) [pdf, other]

Title: MMViT: Multiscale Multiview Vision Transformers

Yuchen Liu, Natasha Ong, Kaiyan Peng, Bo Xiong, Qifan Wang, Rui Hou, Madian Khabsa, Kaiyue Yang, David Liu, Donald S. Williamson, Hanchao Yu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS); Image and Video Processing (eess.IV)

[152] arXiv:2305.00170 (cross-list from cs.SD) [pdf, other]

Title: Enhancing multilingual speech recognition in air traffic control by sentence-level language identification

Peng Fan, Dongyue Guo, JianWei Zhang, Bo Yang, Yi Lin

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[153] arXiv:2305.00242 (cross-list from physics.med-ph) [pdf, other]

Title: Analysis of vocal breath sounds before and after administering Bronchodilator in Asthmatic patients

Shivani Yadav, Dipanjan Gope, Uma Maheswari K., Prasanta Kumar Ghosh

Subjects: Medical Physics (physics.med-ph); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[154] arXiv:2305.00302 (cross-list from cs.SD) [pdf, other]

Title: Environmental sound synthesis from vocal imitations and sound event labels

Yuki Okamoto, Keisuke Imoto, Shinnosuke Takamichi, Ryotaro Nagase, Takahiro Fukumori, Yoichi Yamashita

Comments: Submitted to ICASSP2024

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[155] arXiv:2305.00417 (cross-list from cs.SD) [pdf, other]

Title: Transformer-based Sequence Labeling for Audio Classification based on MFCCs

C. S. Sonali, Chinmayi B S, Ahana Balasubramanian

Comments: Error in the explanation as well inadequate results and conclusion

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[156] arXiv:2305.00426 (cross-list from cs.SD) [pdf, other]

Title: Transfer of knowledge among instruments in automatic music transcription

Michał Leś, Michał Woźniak

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[157] arXiv:2305.00725 (cross-list from cs.SD) [pdf, other]

Title: Emotions Beyond Words: Non-Speech Audio Emotion Recognition With Edge Computing

Ibrahim Malik, Siddique Latif, Sanaullah Manzoor, Muhammad Usama, Junaid Qadir, Raja Jurdak

Comments: Under review

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[158] arXiv:2305.00926 (cross-list from cs.CL) [pdf, other]

Title: Joint Modelling of Spoken Language Understanding Tasks with Integrated Dialog History

Siddhant Arora, Hayato Futami, Emiru Tsunoo, Brian Yan, Shinji Watanabe

Comments: Accepted at ICASSP 20223

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[159] arXiv:2305.00969 (cross-list from cs.SD) [pdf, html, other]

Title: CryCeleb: A Speaker Verification Dataset Based on Infant Cry Sounds

David Budaghyan, Charles C. Onu, Arsenii Gorin, Cem Subakan, Doina Precup

Comments: ICASSP 2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[160] arXiv:2305.01051 (cross-list from cs.SD) [pdf, other]

Title: LooPy: A Research-Friendly Mix Framework for Music Information Retrieval on Electronic Dance Music

Xinyu Li

Comments: Submitted to ACM MM 2023. arXiv admin note: substantial text overlap with arXiv:2201.05194

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[161] arXiv:2305.01170 (cross-list from cs.SD) [pdf, other]

Title: Contrastive Speech Mixup for Low-resource Keyword Spotting

Dianwen Ng, Ruixi Zhang, Jia Qi Yip, Chong Zhang, Yukun Ma, Trung Hieu Nguyen, Chongjia Ni, Eng Siong Chng, Bin Ma

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[162] arXiv:2305.01194 (cross-list from cs.CL) [pdf, other]

Title: The Pipeline System of ASR and NLU with MLM-based Data Augmentation toward STOP Low-resource Challenge

Hayato Futami, Jessica Huynh, Siddhant Arora, Shih-Lun Wu, Yosuke Kashiwagi, Yifan Peng, Brian Yan, Emiru Tsunoo, Shinji Watanabe

Comments: To appear at ICASSP2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[163] arXiv:2305.01241 (cross-list from cs.HC) [pdf, other]

Title: AQ-GT: a Temporally Aligned and Quantized GRU-Transformer for Co-Speech Gesture Synthesis

Hendric Voß, Stefan Kopp

Subjects: Human-Computer Interaction (cs.HC); Graphics (cs.GR); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[164] arXiv:2305.01319 (cross-list from cs.SD) [pdf, other]

Title: Long-Term Rhythmic Video Soundtracker

Jiashuo Yu, Yaohui Wang, Xinyuan Chen, Xiao Sun, Yu Qiao

Comments: ICML2023

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[165] arXiv:2305.01476 (cross-list from cs.SD) [pdf, other]

Title: Deep Learning Based Multimodal with Two-phase Training Strategy for Daily Life Video Classification

Lam Pham, Trang Le, Cam Le, Dat Ngo, Weissenfeld Axel, Alexander Schindler

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[166] arXiv:2305.01482 (cross-list from cs.SD) [pdf, other]

Title: Multitask learning in Audio Captioning: a sentence embedding regression loss acts as a regularizer

Etienne Labbé, Julien Pinquier, Thomas Pellegrini

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[167] arXiv:2305.01578 (cross-list from cs.SD) [pdf, other]

Title: Self-supervised learning for infant cry analysis

Arsenii Gorin, Cem Subakan, Sajjad Abdoli, Junhao Wang, Samantha Latremouille, Charles Onu

Comments: Accepted to IEEE ICASSP 2023 workshop Self-supervision in Audio, Speech and Beyond

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[168] arXiv:2305.01620 (cross-list from cs.CL) [pdf, other]

Title: A Study on the Integration of Pipeline and E2E SLU systems for Spoken Semantic Parsing toward STOP Quality Challenge

Siddhant Arora, Hayato Futami, Shih-Lun Wu, Jessica Huynh, Yifan Peng, Yosuke Kashiwagi, Emiru Tsunoo, Brian Yan, Shinji Watanabe

Comments: First Place in Track 1 of STOP Challenge, which is part of ICASSP Signal Processing Grand Challenge 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[169] arXiv:2305.01626 (cross-list from cs.CL) [pdf, html, other]

Title: Basic syntax from speech: Spontaneous concatenation in unsupervised deep neural networks

Gašper Beguš, Thomas Lu, Zili Wang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[170] arXiv:2305.01661 (cross-list from cs.SD) [pdf, html, other]

Title: Integrating spoken instructions into flight trajectory prediction to optimize automation in air traffic control

Dongyue Guo, Zheng Zhang, Bo Yang, Jianwei Zhang, Hongyu Yang, Yi Lin

Comments: This paper has been accepted in principle by Nature Communications

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[171] arXiv:2305.01836 (cross-list from cs.CV) [pdf, other]

Title: AV-SAM: Segment Anything Model Meets Audio-Visual Localization and Segmentation

Shentong Mo, Yapeng Tian

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[172] arXiv:2305.01864 (cross-list from cs.SD) [pdf, other]

Title: Unsupervised Improvement of Audio-Text Cross-Modal Representations

Zhepei Wang, Cem Subakan, Krishna Subramani, Junkai Wu, Tiago Tavares, Fabio Ayres, Paris Smaragdis

Comments: Accepted to WASPAA 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[173] arXiv:2305.01965 (cross-list from cs.CL) [pdf, other]

Title: Analysing the Impact of Audio Quality on the Use of Naturalistic Long-Form Recordings for Infant-Directed Speech Research

María Andrea Cruz Blandón, Alejandrina Cristia, Okko Räsänen

Comments: Accepted at the CogSci2023 conference

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[174] arXiv:2305.01980 (cross-list from cs.SD) [pdf, other]

Title: Diverse and Vivid Sound Generation from Text Descriptions

Guangwei Li, Xuenan Xu, Lingfeng Dai, Mengyue Wu, Kai Yu

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[175] arXiv:2305.02081 (cross-list from cs.CY) [pdf, other]

Title: Considerations for Ethical Speech Recognition Datasets

Orestis Papakyriakopoulos, Alice Xiang

Journal-ref: In Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining (WSDM '23), February 27-March 3, 2023, Singapore, Singapore. ACM, New York, NY, USA, 2 pages. https://doi.org/10.1145/3539597.3575793

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[176] arXiv:2305.02269 (cross-list from cs.SD) [pdf, other]

Title: M2-CTTS: End-to-End Multi-scale Multi-modal Conversational Text-to-Speech Synthesis

Jinlong Xue, Yayue Deng, Fengping Wang, Ya Li, Yingming Gao, Jianhua Tao, Jianqing Sun, Jiaen Liang

Comments: 5 pages, 1 figures, 2 tables. Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[177] arXiv:2305.02382 (cross-list from cs.SD) [pdf, other]

Title: Learning to Detect Novel and Fine-Grained Acoustic Sequences Using Pretrained Audio Representations

Vasudha Kowtha, Miquel Espi Marques, Jonathan Huang, Yichi Zhang, Carlos Avendano

Comments: IEEE ICASSP 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[178] arXiv:2305.02765 (cross-list from cs.SD) [pdf, other]

Title: HiFi-Codec: Group-residual Vector quantization for High Fidelity Audio Codec

Dongchao Yang, Songxiang Liu, Rongjie Huang, Jinchuan Tian, Chao Weng, Yuexian Zou

Comments: The second version of HiFi-Codec

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[179] arXiv:2305.02937 (cross-list from cs.CL) [pdf, other]

Title: End-to-end spoken language understanding using joint CTC loss and self-supervised, pretrained acoustic encoders

Jixuan Wang, Martin Radfar, Kai Wei, Clement Chung

Comments: ICASSP 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[180] arXiv:2305.03101 (cross-list from cs.CL) [pdf, other]

Title: Hybrid Transducer and Attention based Encoder-Decoder Modeling for Speech-to-Text Tasks

Yun Tang, Anna Y. Sun, Hirofumi Inaguma, Xinyue Chen, Ning Dong, Xutai Ma, Paden D. Tomasello, Juan Pino

Comments: ACL 2023 main conference

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[181] arXiv:2305.03391 (cross-list from cs.SD) [pdf, other]

Title: Compressing audio CNNs with graph centrality based filter pruning

James A King, Arshdeep Singh, Mark D. Plumbley

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[182] arXiv:2305.03530 (cross-list from cs.SD) [pdf, other]

Title: Exploring Softly Masked Language Modelling for Controllable Symbolic Music Generation

Nicolas Jonason, Bob L.T. Sturm

Comments: Version 1.1

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[183] arXiv:2305.03568 (cross-list from cs.SD) [pdf, html, other]

Title: A vector quantized masked autoencoder for audiovisual speech emotion recognition

Samir Sadok, Simon Leglaive, Renaud Séguier

Comments: 13 pages, 6 figures, this https URL

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[184] arXiv:2305.03582 (cross-list from cs.SD) [pdf, html, other]

Title: A multimodal dynamical variational autoencoder for audiovisual speech representation learning

Samir Sadok, Simon Leglaive, Laurent Girin, Xavier Alameda-Pineda, Renaud Séguier

Comments: 14 figures, this https URL

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[185] arXiv:2305.03625 (cross-list from cs.SD) [pdf, other]

Title: Physics-Based Acoustic Holograms

Antonio Stanziola, Ben T. Cox, Bradley E. Treeby, Michael D. Brown

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Applied Physics (physics.app-ph)

[186] arXiv:2305.03982 (cross-list from cs.SD) [pdf, other]

Title: Pitch Estimation by Denoising Preprocessor and Hybrid Estimation Model

Yu Cheng Hung, Ping Hung Chen, Jian Jiun Ding

Comments: From ICCE-Taiwan

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[187] arXiv:2305.04160 (cross-list from cs.CL) [pdf, other]

Title: X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages

Feilong Chen, Minglun Han, Haozhi Zhao, Qingyang Zhang, Jing Shi, Shuang Xu, Bo Xu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[188] arXiv:2305.04531 (cross-list from cs.SD) [pdf, other]

Title: A method for analyzing sampling jitter in audio equipment

Makoto Takeuchi, Haruo Saito

Comments: 15 pages, 12 figures

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Instrumentation and Detectors (physics.ins-det)

[189] arXiv:2305.04542 (cross-list from cs.CV) [pdf, other]

Title: Multi-Temporal Lip-Audio Memory for Visual Speech Recognition

Jeong Hun Yeo, Minsu Kim, Yong Man Ro

Comments: Presented at ICASSP 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[190] arXiv:2305.04572 (cross-list from cs.CL) [pdf, other]

Title: Putting Natural in Natural Language Processing

Grzegorz Chrupała

Comments: Findings of the ACL 2023

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[191] arXiv:2305.04810 (cross-list from cs.SD) [pdf, other]

Title: Synthesizing Cough Audio with GAN for COVID-19 Detection

Yahya Saleh

Comments: Bachelor's thesis

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Quantitative Methods (q-bio.QM)

[192] arXiv:2305.04905 (cross-list from cs.CL) [pdf, other]

Title: What Do Patients Say About Their Disease Symptoms? Deep Multilabel Text Classification With Human-in-the-Loop Curation for Automatic Labeling of Patient Self Reports of Problems

Lakshmi Arbatti, Abhishek Hosamath, Vikram Ramanarayanan, Ira Shoulson

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[193] arXiv:2305.05110 (cross-list from cs.LG) [pdf, other]

Title: Semi-Supervised Federated Learning for Keyword Spotting

Enmao Diao, Eric W. Tramel, Jie Ding, Tao Zhang

Subjects: Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[194] arXiv:2305.05139 (cross-list from cs.SD) [pdf, other]

Title: Temporal Convolution Network Based Onset Detection and Query by Humming System Design

Yu Cheng Hung, Jian-Jiun Ding

Comments: This paper has been withdrawn by the author due to a crucial definition of probability threshold and several grammer and vocabulary mistakes

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[195] arXiv:2305.05152 (cross-list from cs.SD) [pdf, other]

Title: Who is Speaking Actually? Robust and Versatile Speaker Traceability for Voice Conversion

Yanzhen Ren, Hongcheng Zhu, Liming Zhai, Zongkun Sun, Rubing Shen, Lina Wang

Comments: has been accepted by ACM MM 2023

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[196] arXiv:2305.05201 (cross-list from cs.CL) [pdf, other]

Title: Exploration of Language Dependency for Japanese Self-Supervised Speech Representation Models

Takanori Ashihara, Takafumi Moriya, Kohei Matsuura, Tomohiro Tanaka

Comments: Accepted at ICASSP 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[197] arXiv:2305.05203 (cross-list from cs.SD) [pdf, html, other]

Title: Joint Multi-scale Cross-lingual Speaking Style Transfer with Bidirectional Attention Mechanism for Automatic Dubbing

Jingbei Li, Sipan Li, Ping Chen, Luwen Zhang, Yi Meng, Zhiyong Wu, Helen Meng, Qiao Tian, Yuping Wang, Yuxuan Wang

Comments: TASLP

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[198] arXiv:2305.05271 (cross-list from cs.CL) [pdf, other]

Title: Robust Acoustic and Semantic Contextual Biasing in Neural Transducers for Speech Recognition

Xuandi Fu, Kanthashree Mysore Sathyendra, Ankur Gandhe, Jing Liu, Grant P. Strimel, Ross McGowan, Athanasios Mouchtaris

Comments: Accepted at ICASSP 2023

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[199] arXiv:2305.05401 (cross-list from cs.SD) [pdf, other]

Title: Learn to Sing by Listening: Building Controllable Virtual Singer by Unsupervised Learning from Voice Recordings

Wei Xue, Yiwen Wang, Qifeng Liu, Yike Guo

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[200] arXiv:2305.05591 (cross-list from cs.SD) [pdf, other]

Title: AudioSlots: A slot-centric generative model for audio separation

Pradyumna Reddy, Scott Wisdom, Klaus Greff, John R. Hershey, Thomas Kipf

Comments: Accepted at the Self-supervision in Audio, Speech and Beyond (SASB) Workshop at ICASSP 2023

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)