Audio and Speech Processing

Authors and titles for April 2022

[76] arXiv:2204.05753 [pdf, other]

Title: Enhancement of Pitch Controllability using Timbre-Preserving Pitch Augmentation in FastPitch

Hanbin Bae, Young-Sun Joo

Comments: Submitted to INTERSPEECH 2022

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)

[77] arXiv:2204.05841 [pdf, other]

Title: VoiceFixer: A Unified Framework for High-Fidelity Speech Restoration

Haohe Liu, Xubo Liu, Qiuqiang Kong, Qiao Tian, Yan Zhao, DeLiang Wang, Chuanzeng Huang, Yuxuan Wang

Comments: Submitted to INTERSPEECH 2022

Journal-ref: Proc. Interspeech 2022

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[78] arXiv:2204.06086 [pdf, other]

Title: A Post Auto-regressive GAN Vocoder Focused on Spectrum Fracture

Zhenxing Lu, Mengnan He, Ruixiong Zhang, Caixia Gong

Comments: Experimental parts should be improved

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[79] arXiv:2204.06164 [pdf, other]

Title: A Unified Cascaded Encoder ASR Model for Dynamic Model Sizes

Shaojin Ding, Weiran Wang, Ding Zhao, Tara N. Sainath, Yanzhang He, Robert David, Rami Botros, Xin Wang, Rina Panigrahy, Qiao Liang, Dongseong Hwang, Ian McGraw, Rohit Prabhavalkar, Trevor Strohman

Comments: Accepted by INTERSPEECH 2022

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[80] arXiv:2204.06322 [pdf, other]

Title: Production federated keyword spotting via distillation, filtering, and joint federated-centralized training

Andrew Hard, Kurt Partridge, Neng Chen, Sean Augenstein, Aishanee Shah, Hyun Jin Park, Alex Park, Sara Ng, Jessica Nguyen, Ignacio Lopez Moreno, Rajiv Mathews, Françoise Beaufays

Comments: Accepted to Interspeech 2022

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[81] arXiv:2204.06478 [pdf, other]

Title: BEHM-GAN: Bandwidth Extension of Historical Music using Generative Adversarial Networks

Eloi Moliner, Vesa Välimäki

Comments: Accepted at IEEE Transactions on Audio, Speech, and Language Processing

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[82] arXiv:2204.06907 [pdf, other]

Title: Lombard Effect for Bilingual Speakers in Cantonese and English: importance of spectro-temporal features

Maximilian Karl Scharf, Sabine Hochmuth, Lena L.N. Wong, Birger Kollmeier, Anna Warzybok

Comments: Submitted to INTERSPEECH2022

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[83] arXiv:2204.07092 [pdf, other]

Title: RadioSES: mmWave-Based Audioradio Speech Enhancement and Separation System

Muhammed Zahid Ozturk, Chenshu Wu, Beibei Wang, Min Wu, K. J. Ray Liu

Comments: Project webpage: this https URL

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[84] arXiv:2204.07353 [pdf, other]

Title: Anomalous Sound Detection Based on Machine Activity Detection

Tomoya Nishida, Kota Dohi, Takashi Endo, Masaaki Yamamoto, Yohei Kawaguchi

Comments: 5 pages, 2 figures, 1 table

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[85] arXiv:2204.07375 [pdf, other]

Title: Speaker-Aware Mixture of Mixtures Training for Weakly Supervised Speaker Extraction

Zifeng Zhao, Rongzhi Gu, Dongchao Yang, Jinchuan Tian, Yuexian Zou

Comments: 5 pages, 4 tables, 4 figures. Submitted to INTERSPEECH 2022

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[86] arXiv:2204.07402 [pdf, other]

Title: BYOL for Audio: Exploring Pre-trained General-purpose Audio Representations

Daisuke Niizumi, Daiki Takeuchi, Yasunori Ohishi, Noboru Harada, Kunio Kashino

Comments: 15 pages, 6 figures, and 15 tables. Under the review process

Journal-ref: IEEE/ACM Trans. Audio, Speech, Language Process. 31 (2023) 137-151

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[87] arXiv:2204.08094 [pdf, other]

Title: A Data-Driven Methodology for Considering Feasibility and Pairwise Likelihood in Deep Learning Based Guitar Tablature Transcription Systems

Frank Cwitkowitz, Jonathan Driedger, Zhiyao Duan

Comments: Sound and Music Computing Conference (SMC) 2022

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[88] arXiv:2204.08692 [pdf, other]

Title: Time Domain Adversarial Voice Conversion for ADD 2022

Cheng Wen, Tingwei Guo, Xingjun Tan, Rui Yan, Shuran Zhou, Chuandong Xie, Wei Zou, Xiangang Li

Comments: Accepted to ICASSP 2022

Subjects: Audio and Speech Processing (eess.AS); Cryptography and Security (cs.CR); Sound (cs.SD)

[89] arXiv:2204.08720 [pdf, other]

Title: Audio Deep Fake Detection System with Neural Stitching for ADD 2022

Rui Yan, Cheng Wen, Shuran Zhou, Tingwei Guo, Wei Zou, Xiangang Li

Comments: Accepted to ICASSP 2022

Subjects: Audio and Speech Processing (eess.AS); Cryptography and Security (cs.CR); Sound (cs.SD)

[90] arXiv:2204.08765 [pdf, other]

Title: Speech Dereverberation with A Reverberation Time Shortening Target

Rui Zhou, Wenye Zhu, Xiaofei Li

Comments: Submitted to ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[91] arXiv:2204.08858 [pdf, other]

Title: An Investigation of Monotonic Transducers for Large-Scale Automatic Speech Recognition

Niko Moritz, Frank Seide, Duc Le, Jay Mahadeokar, Christian Fuegen

Comments: Accepted to SLT 2022

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[92] arXiv:2204.09079 [pdf, other]

Title: Music Source Separation with Generative Flow

Ge Zhu, Jordan Darefsky, Fei Jiang, Anton Selitskiy, Zhiyao Duan

Comments: Accepted by Signal Processing Letters

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[93] arXiv:2204.09934 [pdf, other]

Title: FastDiff: A Fast Conditional Diffusion Model for High-Quality Speech Synthesis

Rongjie Huang, Max W. Y. Lam, Jun Wang, Dan Su, Dong Yu, Yi Ren, Zhou Zhao

Comments: Accepted by IJCAI 2022

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[94] arXiv:2204.10020 [pdf, other]

Title: Cross-Speaker Emotion Transfer for Low-Resource Text-to-Speech Using Non-Parallel Voice Conversion with Pitch-Shift Data Augmentation

Ryo Terashima, Ryuichi Yamamoto, Eunwoo Song, Yuma Shirahata, Hyun-Wook Yoon, Jae-Min Kim, Kentaro Tachibana

Comments: Accepted to INTERSPEECH 2022

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)

[95] arXiv:2204.10172 [pdf, other]

Title: Gated Multimodal Fusion with Contrastive Learning for Turn-taking Prediction in Human-robot Dialogue

Jiudong Yang, Peiying Wang, Yi Zhu, Mingchao Feng, Meng Chen, Xiaodong He

Comments: Accepted by ICASSP 2022

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[96] arXiv:2204.10228 [pdf, other]

Title: The NIST CTS Speaker Recognition Challenge

Seyed Omid Sadjadi, Craig Greenberg, Elliot Singer, Lisa Mason, Douglas Reynolds

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[97] arXiv:2204.10242 [pdf, other]

Title: The 2021 NIST Speaker Recognition Evaluation

Seyed Omid Sadjadi, Craig Greenberg, Elliot Singer, Lisa Mason, Douglas Reynolds

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Image and Video Processing (eess.IV)

[98] arXiv:2204.11030 [pdf, other]

Title: Improving Self-Supervised Learning-based MOS Prediction Networks

Bálint Gyires-Tóth, Csaba Zainkó

Comments: Submitted to Interspeech 2022

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD)

[99] arXiv:2204.11032 [pdf, other]

Title: Heterogeneous Separation Consistency Training for Adaptation of Unsupervised Speech Separation

Jiangyu Han, Yanhua Long

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[100] arXiv:2204.11180 [pdf, other]

Title: Few-Shot Speaker Identification Using Depthwise Separable Convolutional Network with Channel Attention

Yanxiong Li, Wucheng Wang, Hao Chen, Wenchang Cao, Wei Li, Qianhua He

Comments: Accepted by Odyssey 2022 (The Speaker and Language Recognition Workshop 2022, Beijing, China)

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[101] arXiv:2204.11232 [pdf, other]

Title: Improving the Naturalness of Simulated Conversations for End-to-End Neural Diarization

Natsuo Yamashita, Shota Horiguchi, Takeshi Homma

Comments: Accepted to Speaker Odyssey 2022

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[102] arXiv:2204.11286 [pdf, other]

Title: Improved far-field speech recognition using Joint Variational Autoencoder

Shashi Kumar, Shakti P. Rath, Abhishek Pandey

Comments: 5 pages, 2 figures, 3 tables

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[103] arXiv:2204.11501 [pdf, other]

Title: Graph Convolutional Network Based Semi-Supervised Learning on Multi-Speaker Meeting Data

Fuchuan Tong, Siqi Zheng, Min Zhang, Yafeng Chen, Hongbin Suo, Qingyang Hong, Lin Li

Comments: Accepted by ICASSP 2022

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[104] arXiv:2204.11933 [pdf, other]

Title: Cleanformer: A multichannel array configuration-invariant neural enhancement frontend for ASR in smart speakers

Joseph Caroselli, Arun Narayanan, Nathan Howard, Tom O'Malley

Comments: Accepted to ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[105] arXiv:2204.12076 [pdf, other]

Title: ATST: Audio Representation Learning with Teacher-Student Transformer

Xian Li, Xiaofei Li

Comments: INTERSPEECH2022(Accepted)

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)

[106] arXiv:2204.12092 [pdf, other]

Title: Mask scalar prediction for improving robust automatic speech recognition

Arun Narayanan, James Walker, Sankaran Panchapagesan, Nathan Howard, Yuma Koizumi

Comments: Submitted to Interspeech 2022

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[107] arXiv:2204.12260 [pdf, other]

Title: Masked Spectrogram Modeling using Masked Autoencoders for Learning General-purpose Audio Representation

Daisuke Niizumi, Daiki Takeuchi, Yasunori Ohishi, Noboru Harada, Kunio Kashino

Comments: 22 pages, 8 figures. Under the review process

Journal-ref: HEAR: Holistic Evaluation of Audio Representations (NeurIPS 2021 Competition) PMLR 166 (2022) 1-24

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[108] arXiv:2204.12279 [pdf, other]

Title: Low-dimensional representation of infant and adult vocalization acoustics

Silvia Pagliarini, Sara Schneider, Christopher T. Kello, Anne S. Warlaumont

Comments: Under review at Interspeech 2022

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[109] arXiv:2204.12308 [pdf, other]

Title: Supervised Attention in Sequence-to-Sequence Models for Speech Recognition

Gene-Ping Yang, Hao Tang

Comments: Accepted at ICASSP 2022

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[110] arXiv:2204.12649 [pdf, other]

Title: Study on the Fairness of Speaker Verification Systems on Underrepresented Accents in English

Mariel Estevez, Luciana Ferrer

Comments: 5 pages, 2 figures, submitted to INTERSPEECH

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[111] arXiv:2204.12777 [pdf, other]

Title: Ultra Fast Speech Separation Model with Teacher Student Learning

Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu

Comments: Accepted by interspeech 2021

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[112] arXiv:2204.13883 [pdf, other]

Title: Autonomous In-Situ Soundscape Augmentation via Joint Selection of Masker and Gain

Karn N. Watcharasupat, Kenneth Ooi, Bhan Lam, Trevor Wong, Zhen-Ting Ong, Woon-Seng Gan

Comments: Accepted to IEEE Signal Processing Letters. (c) 2022 IEEE

Journal-ref: IEEE Signal Processing Letters, Vol. 29, pp. 1749 - 1753, 2022

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[113] arXiv:2204.13890 [pdf, other]

Title: Deployment of an IoT System for Adaptive In-Situ Soundscape Augmentation

Trevor Wong, Karn N. Watcharasupat, Bhan Lam, Kenneth Ooi, Zhen-Ting Ong, Furi Andi Karnapi, Woon-Seng Gan

Comments: To be presented at the 51st International Congress and Exposition on Noise Control Engineering

Journal-ref: INTER-NOISE and NOISE-CON Congress and Conference Proceedings, Feb. 2022, vol. 265, no. 5, pp. 2013-2021

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Systems and Control (eess.SY)

[114] arXiv:2204.00061 (cross-list from cs.SD) [pdf, other]

Title: Data-augmented cross-lingual synthesis in a teacher-student framework

Marcel de Korte, Jaebok Kim, Aki Kunikoshi, Adaeze Adigwe, Esther Klabbers

Comments: Submitted to INTERSPEECH 2022

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[115] arXiv:2204.00088 (cross-list from cs.SD) [pdf, other]

Title: Speech and the n-Back task as a lens into depression. How combining both may allow us to isolate different core symptoms of depression

Salvatore Fara, Stefano Goria, Emilia Molimpakis, Nicholas Cummins

Comments: Submitted to Interspeech 2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Quantitative Methods (q-bio.QM)

[116] arXiv:2204.00094 (cross-list from cs.SD) [pdf, other]

Title: Perceptive, non-linear Speech Processing and Spiking Neural Networks

Jean Rouat, Ramin Pichevar, Stéphane Loiselle

Comments: preprint of the 2005 published paper: Perceptive, Non-linear Speech Processing and Spiking Neural Networks. In: Chollet, G., Esposito, A., Faundez-Zanuy, M., Marinaro, M. (eds) Nonlinear Speech Modeling and Applications. NN 2004. Lecture Notes in Computer Science, vol 3445. Springer, Berlin, Heidelberg

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Neurons and Cognition (q-bio.NC)

[117] arXiv:2204.00164 (cross-list from cs.CL) [pdf, other]

Title: Filter-based Discriminative Autoencoders for Children Speech Recognition

Chiang-Lin Tai, Hung-Shin Lee, Yu Tsao, Hsin-Min Wang

Comments: Published in EUSIPCO 2022

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[118] arXiv:2204.00174 (cross-list from cs.CL) [pdf, other]

Title: InterAug: Augmenting Noisy Intermediate Predictions for CTC-based ASR

Yu Nakagome, Tatsuya Komatsu, Yusuke Fujita, Shuta Ichimura, Yusuke Kida

Comments: This paper was submitted to INTERSPEECH2022

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[119] arXiv:2204.00175 (cross-list from cs.CL) [pdf, other]

Title: Alternate Intermediate Conditioning with Syllable-level and Character-level Targets for Japanese ASR

Yusuke Fujita, Tatsuya Komatsu, Yusuke Kida

Comments: SLT 2022

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[120] arXiv:2204.00176 (cross-list from cs.CL) [pdf, other]

Title: Better Intermediates Improve CTC Inference

Tatsuya Komatsu, Yusuke Fujita, Jaesong Lee, Lukas Lee, Shinji Watanabe, Yusuke Kida

Comments: 5 pages, submitted INTERSPEECH2022

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[121] arXiv:2204.00212 (cross-list from cs.CL) [pdf, other]

Title: Effect and Analysis of Large-scale Language Model Rescoring on Competitive ASR Systems

Takuma Udagawa, Masayuki Suzuki, Gakuto Kurata, Nobuyasu Itoh, George Saon

Comments: Accepted to Interspeech 2022

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[122] arXiv:2204.00291 (cross-list from cs.CL) [pdf, other]

Title: Text-To-Speech Data Augmentation for Low Resource Speech Recognition

Rodolfo Zevallos

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[123] arXiv:2204.00311 (cross-list from cs.SD) [pdf, other]

Title: Speaker verification in mismatch training and testing conditions

Marcos Faundez-Zanuy, Adam Slupinski

Comments: 4 pages, published in 6th international conference on spoken language processing (ICSLP 2000), Vol. II, pp.322-325. ICSLP 2000, ISBN 7-80150-144-4/G.18Beijing (China). October 16-20, 2000. arXiv admin note: substantial text overlap with arXiv:2203.00513

Journal-ref: 6th international conference on spoken language processing (ICSLP 2000), Vol. II, pp.322-325, 2000

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[124] arXiv:2204.00331 (cross-list from cs.SD) [pdf, other]

Title: Using segment-based features of jaw movements to recognize foraging activities in grazing cattle

José O. Chelotti, Sebastián R. Vanrell, Luciano S. Martinez-Rau, Julio R. Galli, Santiago A. Utsumi, Alejandra M. Planisich, Suyai A. Almirón, Diego H. Milone, Leonardo L. Giovanini, H. Leonardo Rufiner

Comments: Preprint submitted to journal

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[125] arXiv:2204.00348 (cross-list from cs.CL) [pdf, other]

Title: WavFT: Acoustic model finetuning with labelled and unlabelled data

Utkarsh Chauhan, Vikas Joshi, Rupesh R. Mehta

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[126] arXiv:2204.00352 (cross-list from cs.LG) [pdf, other]

Title: On the Efficiency of Integrating Self-supervised Learning and Meta-learning for User-defined Few-shot Keyword Spotting

Wei-Tsung Kao, Yuan-Kuei Wu, Chia-Ping Chen, Zhi-Sheng Chen, Yu-Pao Tsai, Hung-Yi Lee

Comments: Accepted by SLT 2022

Subjects: Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[127] arXiv:2204.00540 (cross-list from cs.SD) [pdf, other]

Title: End-to-End Integration of Speech Recognition, Speech Enhancement, and Self-Supervised Learning Representation

Xuankai Chang, Takashi Maekaku, Yuya Fujita, Shinji Watanabe

Comments: Submitted to Interspeech 2022

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[128] arXiv:2204.00558 (cross-list from cs.CL) [pdf, other]

Title: Multi-task RNN-T with Semantic Decoder for Streamable Spoken Language Understanding

Xuandi Fu, Feng-Ju Chang, Martin Radfar, Kai Wei, Jing Liu, Grant P. Strimel, Kanthashree Mysore Sathyendra

Comments: Accepted at ICASSP 2022

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[129] arXiv:2204.00604 (cross-list from cs.CV) [pdf, other]

Title: Quantized GAN for Complex Music Generation from Dance Videos

Ye Zhu, Kyle Olszewski, Yu Wu, Panos Achlioptas, Menglei Chai, Yan Yan, Sergey Tulyakov

Comments: Dataset and code at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[130] arXiv:2204.00628 (cross-list from cs.SD) [pdf, other]

Title: Learning Neural Acoustic Fields

Andrew Luo, Yilun Du, Michael J. Tarr, Joshua B. Tenenbaum, Antonio Torralba, Chuang Gan

Comments: NeurIPS 2022. Project page: this https URL

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO); Audio and Speech Processing (eess.AS)

[131] arXiv:2204.00652 (cross-list from cs.SD) [pdf, other]

Title: End-to-end multi-talker audio-visual ASR using an active speaker attention module

Richard Rose, Olivier Siohan

Comments: 5 pages, 3 figures, 3 tables, 28 citations

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[132] arXiv:2204.00679 (cross-list from cs.CV) [pdf, other]

Title: Learning Audio-Video Modalities from Image Captions

Arsha Nagrani, Paul Hongsuck Seo, Bryan Seybold, Anja Hauth, Santiago Manen, Chen Sun, Cordelia Schmid

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[133] arXiv:2204.00770 (cross-list from cs.SD) [pdf, other]

Title: Speaker adaptation for Wav2vec2 based dysarthric ASR

Murali Karthick Baskar, Tim Herzig, Diana Nguyen, Mireia Diez, Tim Polzehl, Lukáš Burget, Jan "Honza'' Černocký

Comments: Submitted to INTERSPEECH 2022

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[134] arXiv:2204.00803 (cross-list from cs.CL) [pdf, other]

Title: End-to-end model for named entity recognition from speech without paired training data

Salima Mdhaffar, Jarod Duret, Titouan Parcollet, Yannick Estève

Comments: Submitted to INTERSPEECH 2022

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[135] arXiv:2204.00819 (cross-list from cs.SD) [pdf, other]

Title: Leveraging Phone Mask Training for Phonetic-Reduction-Robust E2E Uyghur Speech Recognition

Guodong Ma, Pengfei Hu, Jian Kang, Shen Huang, Hao Huang

Comments: Accepted by INTERSPEECH 2021

Journal-ref: INTERSPEECH 2021

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[136] arXiv:2204.00821 (cross-list from cs.SD) [pdf, other]

Title: Improving Target Sound Extraction with Timestamp Information

Helin Wang, Dongchao Yang, Chao Weng, Jianwei Yu, Yuexian Zou

Comments: submitted to interspeech2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[137] arXiv:2204.00873 (cross-list from cs.SD) [pdf, other]

Title: Acoustic-to-articulatory Inversion based on Speech Decomposition and Auxiliary Feature

Jianrong Wang, Jinyu Liu, Longxuan Zhao, Shanyu Wang, Ruiguo Yu, Li Liu

Journal-ref: ICASSP 2022

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[138] arXiv:2204.00902 (cross-list from cs.SD) [pdf, other]

Title: An objective test tool for pitch extractors' response attributes

Hideki Kawahara, Kohei Yatabe, Ken-Ichi Sakakibara, Tatsuya Kitamura, Hideki Banno, Masanori Morise

Comments: 5 pages, 9 figures, submitted to Interspeech2022. arXiv admin note: text overlap with arXiv:2111.03629

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[139] arXiv:2204.00907 (cross-list from cs.SD) [pdf, other]

Title: StyleWaveGAN: Style-based synthesis of drum sounds with extensive controls using generative adversarial networks

Antoine Lavault, Axel Roebel, Matthieu Voiry

Comments: Accepted for publication in Sound and Music Computing 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[140] arXiv:2204.00911 (cross-list from cs.SD) [pdf, other]

Title: Measuring pitch extractors' response to frequency-modulated multi-component signals

Hideki Kawahara, Kohei Yatabe, Ken-Ichi Sakakibara, Tatsuya Kitamura, Hideki Banno, Masanori Morise

Comments: 11 pages, 9 figures, The following article has been submitted to/accepted by The Acoustical Society of America. After it is published, it will be found at this http URL

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[141] arXiv:2204.00977 (cross-list from cs.CL) [pdf, other]

Title: Deep Speech Based End-to-End Automated Speech Recognition (ASR) for Indian-English Accents

Priyank Dubey, Bilal Shah

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[142] arXiv:2204.00990 (cross-list from cs.SD) [pdf, other]

Title: Content-Dependent Fine-Grained Speaker Embedding for Zero-Shot Speaker Adaptation in Text-to-Speech Synthesis

Yixuan Zhou, Changhe Song, Xiang Li, Luwen Zhang, Zhiyong Wu, Yanyao Bian, Dan Su, Helen Meng

Comments: Accepted by Interspeech 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[143] arXiv:2204.01009 (cross-list from cs.SD) [pdf, other]

Title: A Computational Analysis of Pitch Drift in Unaccompanied Solo Singing using DBSCAN Clustering

Sepideh Shafiei, S. Hakam

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[144] arXiv:2204.01115 (cross-list from cs.SD) [pdf, other]

Title: On incorporating social speaker characteristics in synthetic speech

Sai Sirisha Rallabandi, Sebastian Möller

Comments: Submitted to Interspeech 2022

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[145] arXiv:2204.01235 (cross-list from cs.CL) [pdf, other]

Title: An Analysis of Semantically-Aligned Speech-Text Embeddings

Muhammad Huzaifah, Ivan Kukanov

Comments: This is the accepted version of the paper published at IEEE Spoken Language Technology (SLT) Workshop 2022

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[146] arXiv:2204.01265 (cross-list from cs.CV) [pdf, other]

Title: Multi-modality Associative Bridging through Memory: Speech Sound Recollected from Face Video

Minsu Kim, Joanna Hong, Se Jin Park, Yong Man Ro

Comments: Published at ICCV 2021

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[147] arXiv:2204.01294 (cross-list from cs.SD) [pdf, other]

Title: On The Model Size Selection For Speaker Identification

Marcos Faundez-Zanuy

Comments: 5 pages, published in Speaker odyssey 2001, The speaker recognition workshop. 189-194 Crete (Greece)

Journal-ref: 2001 A Speaker Odyssey - The Speaker Recognition Workshop June 18-22, 2001, Crete, Greece

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[148] arXiv:2204.01295 (cross-list from cs.SD) [pdf, other]

Title: Nonlinear Vectorial Prediction with Neural Nets

Marcos Faundez-Zanuy

Comments: 9 pages, published in Proceedings of the 6th International Work Conference on Artificial and Natural Neural Networks: Bio inspired Applications of Connectionism Part II June 2001 Pages 754 761

Journal-ref: Lecture Notes in Computer Science LNCS 2085 Vol. II, pages 754-761. IWANN 2001, Granada (Spain) ISSN 0302-9743

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[149] arXiv:2204.01338 (cross-list from cs.SD) [pdf, other]

Title: An Initialization Scheme for Meeting Separation with Spatial Mixture Models

Christoph Boeddeker, Tobias Cord-Landwehr, Thilo von Neumann, Reinhold Haeb-Umbach

Comments: Submitted to INTERSPEECH 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[150] arXiv:2204.01360 (cross-list from cs.SD) [pdf, other]

Title: Learning the Proximity Operator in Unfolded ADMM for Phase Retrieval

Pierre-Hugo Vial, Paul Magron, Thomas Oberlin, Cédric Févotte

Comments: 10 pages, 5 figures, submitted to IEEE SPL

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[151] arXiv:2204.01397 (cross-list from cs.CL) [pdf, other]

Title: A Study of Gender Impact in Self-supervised Models for Speech-to-Text Systems

Marcely Zanon Boito, Laurent Besacier, Natalia Tomashenko, Yannick Estève

Comments: Accepted to INTERSPEECH 2022 (Special session Inclusive and Fair Speech Technologies)

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[152] arXiv:2204.01564 (cross-list from cs.SD) [pdf, other]

Title: Introducing ECAPA-TDNN and Wav2Vec2.0 Embeddings to Stuttering Detection

Shakeel Ahmad Sheikh, Md Sahidullah, Fabrice Hirsch, Slim Ouni

Comments: Submitted to Interspeech 2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[153] arXiv:2204.01670 (cross-list from cs.CL) [pdf, other]

Title: Cross-lingual Self-Supervised Speech Representations for Improved Dysarthric Speech Recognition

Abner Hernandez, Paula Andrea Pérez-Toro, Elmar Nöth, Juan Rafael Orozco-Arroyave, Andreas Maier, Seung Hee Yang

Comments: Submitted for review at Interspeech 2022

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[154] arXiv:2204.01672 (cross-list from cs.SD) [pdf, other]

Title: Residual-guided Personalized Speech Synthesis based on Face Image

Jianrong Wang, Zixuan Wang, Xiaosheng Hu, Xuewei Li, Qiang Fang, Li Liu

Comments: ICASSP 2022

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[155] arXiv:2204.01726 (cross-list from cs.CV) [pdf, other]

Title: Lip to Speech Synthesis with Visual Context Attentional GAN

Minsu Kim, Joanna Hong, Yong Man Ro

Comments: Published at NeurIPS 2021

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[156] arXiv:2204.01787 (cross-list from cs.SD) [pdf, other]

Title: GWA: A Large High-Quality Acoustic Dataset for Audio Processing

Zhenyu Tang, Rohith Aralikatti, Anton Ratnarajah, Dinesh Manocha

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[157] arXiv:2204.01893 (cross-list from cs.CL) [pdf, other]

Title: Deliberation Model for On-Device Spoken Language Understanding

Duc Le, Akshat Shrivastava, Paden Tomasello, Suyoun Kim, Aleksandr Livshits, Ozlem Kalinli, Michael L. Seltzer

Comments: Accepted for publication at INTERSPEECH 2022

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[158] arXiv:2204.01905 (cross-list from cs.SD) [pdf, other]

Title: Learning to Adapt to Domain Shifts with Few-shot Samples in Anomalous Sound Detection

Bingqing Chen, Luca Bondi, Samarjit Das

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[159] arXiv:2204.01954 (cross-list from physics.comp-ph) [pdf, other]

Title: Application of a Spectral Method to Simulate Quasi-Three-Dimensional Underwater Acoustic Fields

Houwang Tu, Yongxian Wang, Wei Liu, Chunmei Yang, Jixing Qin, Shuqing Ma, Xiaodong Wang

Comments: 31 pages, 22 figures. arXiv admin note: text overlap with arXiv:2112.13602

Subjects: Computational Physics (physics.comp-ph); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[160] arXiv:2204.01977 (cross-list from cs.SD) [pdf, other]

Title: Audio-visual multi-channel speech separation, dereverberation and recognition

Guinan Li, Jianwei Yu, Jiajun Deng, Xunying Liu, Helen Meng

Comments: Accepted by ICASSP 2022

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[161] arXiv:2204.02023 (cross-list from cs.SD) [pdf, other]

Title: A Complementary Joint Training Approach Using Unpaired Speech and Text for Low-Resource Automatic Speech Recognition

Ye-Qian Du, Jie Zhang, Qiu-Shi Zhu, Li-Rong Dai, Ming-Hui Wu, Xin Fang, Zhou-Wang Yang

Comments: 5 pages, 3 figures

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[162] arXiv:2204.02040 (cross-list from cs.SD) [pdf, other]

Title: On the Relevance of Bandwidth Extension for Speaker Verification

Marcos Faundez-Zanuy, Mattias Nilsson, W. Bastiaan Kleijn

Comments: 4 pages published in 7th International Conference on Spoken Language Processing, September 16-20, 2002, Denver, Colorado, USA. arXiv admin note: text overlap with arXiv:2202.13865

Journal-ref: 7th International Conference on Spoken Language Processing (ICSLP2002), September 16-20, 2002

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Audio and Speech Processing (eess.AS)

[163] arXiv:2204.02088 (cross-list from cs.SD) [pdf, other]

Title: A Mixed supervised Learning Framework for Target Sound Detection

Dongchao Yang, Helin Wang, Yuexian Zou, Wenwu Wang

Comments: submitted to DCASE workshop

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[164] arXiv:2204.02090 (cross-list from cs.CV) [pdf, other]

Title: VocaLiST: An Audio-Visual Synchronisation Model for Lips and Voices

Venkatesh S. Kadandale, Juan F. Montesinos, Gloria Haro

Comments: Paper accepted to Interspeech 2022; Project Page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[165] arXiv:2204.02101 (cross-list from cs.SD) [pdf, other]

Title: Non-Linear Speech coding with MLP, RBF and Elman based prediction

Marcos Faundez-Zanuy

Comments: 9 pages, published in Mira, J., Álvarez, J.R. (eds) Artificial Neural Nets Problem Solving Methods. IWANN 2003. Lecture Notes in Computer Science, vol 2687. Springer, Berlin, Heidelberg

Journal-ref: International Work-Conference on Artificial Neural Networks IWANN 2003, LNCS 2687 Menorca (Spain)

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[166] arXiv:2204.02121 (cross-list from cs.SD) [pdf, other]

Title: MetaAudio: A Few-Shot Audio Classification Benchmark

Calum Heggan, Sam Budgett, Timothy Hospedales, Mehrdad Yaghoobi

Comments: 9 pages with 1 figure and 2 main results tables. V1 Preprint

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[167] arXiv:2204.02143 (cross-list from cs.SD) [pdf, other]

Title: RaDur: A Reference-aware and Duration-robust Network for Target Sound Detection

Dongchao Yang, Helin Wang, Zhongjie Ye, Yuexian Zou, Wenwu Wang

Comments: submitted to interspeech2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[168] arXiv:2204.02152 (cross-list from cs.SD) [pdf, other]

Title: UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022

Takaaki Saeki, Detai Xin, Wataru Nakata, Tomoki Koriyama, Shinnosuke Takamichi, Hiroshi Saruwatari

Comments: Accepted to INTERSPEECH 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[169] arXiv:2204.02172 (cross-list from cs.SD) [pdf, other]

Title: Adversarial Learning of Intermediate Acoustic Feature for End-to-End Lightweight Text-to-Speech

Hyungchan Yoon, Seyun Um, Changwhan Kim, Hong-Goo Kang

Comments: INTERSPEECH 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[170] arXiv:2204.02269 (cross-list from cs.SD) [pdf, other]

Title: Repeat after me: Self-supervised learning of acoustic-to-articulatory mapping by vocal imitation

Marc-Antoine Georges, Julien Diard, Laurent Girin, Jean-Luc Schwartz, Thomas Hueber

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[171] arXiv:2204.02279 (cross-list from cs.SD) [pdf, other]

Title: How Information on Acoustic Scenes and Sound Events Mutually Benefits Event Detection and Scene Classification Tasks

Keisuke Imoto, Yuka Komatsu, Shunsuke Tsubaki, Tatsuya Komatsu

Comments: Submitted to INTERSPEECH 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[172] arXiv:2204.02389 (cross-list from cs.CV) [pdf, other]

Title: ObjectFolder 2.0: A Multisensory Object Dataset for Sim2Real Transfer

Ruohan Gao, Zilin Si, Yen-Yu Chang, Samuel Clarke, Jeannette Bohg, Li Fei-Fei, Wenzhen Yuan, Jiajun Wu

Comments: In CVPR 2022. Gao, Si, and Chang contributed equally to this work. Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[173] arXiv:2204.02400 (cross-list from cs.SD) [pdf, other]

Title: What can predictive speech coders learn from speaker recognizers?

Marcos Faundez-Zanuy

Comments: 7 pages, published in ITRW on Non-Linear Speech Processing (NOLISP 03), May 20-23, 2003, Le Croisic, France, paper 001. arXiv admin note: text overlap with arXiv:2204.02101

Journal-ref: Non-Linear Speech Processing (NOLISP) 2003

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[174] arXiv:2204.02455 (cross-list from cs.SD) [pdf, other]

Title: Improving Voice Trigger Detection with Metric Learning

Prateeth Nayak, Takuya Higuchi, Anmol Gupta, Shivesh Ranjan, Stephen Shum, Siddharth Sigtia, Erik Marchi, Varun Lakshminarasimhan, Minsik Cho, Saurabh Adya, Chandra Dhir, Ahmed Tewfik

Comments: Accepted at InterSpeech 2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[175] arXiv:2204.02470 (cross-list from cs.CL) [pdf, other]

Title: Combining Spectral and Self-Supervised Features for Low Resource Speech Recognition and Translation

Dan Berrebbi, Jiatong Shi, Brian Yan, Osbel Lopez-Francisco, Jonathan D. Amith, Shinji Watanabe

Comments: 5 pages, 2 figures, submitted to Interspeech 2022

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)