Audio and Speech Processing

Authors and titles for April 2021

[1] arXiv:2104.00120 [pdf, other]

Title: Multi-Encoder Learning and Stream Fusion for Transformer-Based End-to-End Automatic Speech Recognition

Timo Lohrenz, Zhengyang Li, Tim Fingscheidt

Comments: accepted at INTERSPEECH 2021

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[2] arXiv:2104.00230 [pdf, other]

Title: Bidirectional Multiscale Feature Aggregation for Speaker Verification

Jiajun Qi, Wu Guo, Bin Gu

Subjects: Audio and Speech Processing (eess.AS)

[3] arXiv:2104.00259 [pdf, other]

Title: Interactive spatial speech recognition maps based on simulated speech recognition experiments

Marc René Schädler

Comments: 16 pages, 11 figures, related code this https URL

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[4] arXiv:2104.00353 [pdf, other]

Title: CycleDRUMS: Automatic Drum Arrangement For Bass Lines Using CycleGAN

Giorgio Barnabò, Giovanni Trappolini, Lorenzo Lastilla, Cesare Campagnano, Angela Fan, Fabio Petroni, Fabrizio Silvestri

Comments: 9 pages, 5 figures, submitted to IEEE Transactions on Multimedia, the authors contributed equally to this work

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)

[5] arXiv:2104.00436 [pdf, other]

Title: Expressive Text-to-Speech using Style Tag

Minchan Kim, Sung Jun Cheon, Byoung Jin Choi, Jong Jin Kim, Nam Soo Kim

Comments: Accepted by Interspeech 2021

Subjects: Audio and Speech Processing (eess.AS)

[6] arXiv:2104.00624 [pdf, other]

Title: Fast DCTTS: Efficient Deep Convolutional Text-to-Speech

Minsu Kang, Jihyun Lee, Simin Kim, Injung Kim

Comments: 5 pages, 1 figure, to be published in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2021

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[7] arXiv:2104.00769 [pdf, other]

Title: Keyword Transformer: A Self-Attention Model for Keyword Spotting

Axel Berg, Mark O'Connor, Miguel Tairum Cruz

Comments: Proceedings of INTERSPEECH

Journal-ref: Proc. Interspeech 2021, 4249-4253

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[8] arXiv:2104.00931 [pdf, other]

Title: Assem-VC: Realistic Voice Conversion by Assembling Modern Speech Synthesis Techniques

Kang-wook Kim, Seung-won Park, Junhyeok Lee, Myun-chul Joe

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[9] arXiv:2104.00960 [pdf, other]

Title: INTERSPEECH 2021 ConferencingSpeech Challenge: Towards Far-field Multi-Channel Speech Enhancement for Video Conferencing

Wei Rao, Yihui Fu, Yanxin Hu, Xin Xu, Yvkai Jv, Jiangyu Han, Zhongjie Jiang, Lei Xie, Yannan Wang, Shinji Watanabe, Zheng-Hua Tan, Hui Bu, Tao Yu, Shidong Shang

Comments: 5 pages, submitted to INTERSPEECH 2021

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[10] arXiv:2104.00994 [pdf, other]

Title: Unsupervised Acoustic Unit Discovery by Leveraging a Language-Independent Subword Discriminative Feature Representation

Siyuan Feng, Piotr Żelasko, Laureano Moro-Velázquez, Odette Scharenborg

Comments: Accepted for publication in INTERSPEECH 2021

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[11] arXiv:2104.01227 [pdf, other]

Title: MetricNet: Towards Improved Modeling For Non-Intrusive Speech Quality Assessment

Meng Yu, Chunlei Zhang, Yong Xu, Shixiong Zhang, Dong Yu

Comments: Submitted to Interspeech 2021

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[12] arXiv:2104.01320 [pdf, other]

Title: An Empirical Study on Channel Effects for Synthetic Voice Spoofing Countermeasure Systems

You Zhang, Ge Zhu, Fei Jiang, Zhiyao Duan

Comments: 5 pages, 6 figures, in Proc. INTERSPEECH 2021

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[13] arXiv:2104.01384 [pdf, other]

Title: ExKaldi-RT: A Real-Time Automatic Speech Recognition Extension Toolkit of Kaldi

Yu Wang, Chee Siang Leow, Akio Kobayashi, Takehito Utsuro, Hiromitsu Nishizaki

Comments: Accepted at the IEEE 10th Global Conference on Consumer Electronics

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[14] arXiv:2104.01409 [pdf, other]

Title: Diff-TTS: A Denoising Diffusion Model for Text-to-Speech

Myeonghun Jeong, Hyeongju Kim, Sung Jun Cheon, Byoung Jin Choi, Nam Soo Kim

Comments: Submitted to INTERSPEECH 2021

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)

[15] arXiv:2104.01433 [pdf, other]

Title: Deep Feature CycleGANs: Speaker Identity Preserving Non-parallel Microphone-Telephone Domain Adaptation for Speaker Verification

Saurabh Kataria, Jesús Villalba, Piotr Żelasko, Laureano Moro-Velázquez, Najim Dehak

Subjects: Audio and Speech Processing (eess.AS)

[16] arXiv:2104.01466 [pdf, other]

Title: ECAPA-TDNN Embeddings for Speaker Diarization

Nauman Dawalatabad, Mirco Ravanelli, François Grondin, Jenthe Thienpondt, Brecht Desplanques, Hwidong Na

Subjects: Audio and Speech Processing (eess.AS)

[17] arXiv:2104.01471 [pdf, other]

Title: Adversarial Joint Training with Self-Attention Mechanism for Robust End-to-End Speech Recognition

Lujun Li, Yikai Kang, Yuchen Shi, Ludwig Kürzinger, Tobias Watzel, Gerhard Rigoll

Subjects: Audio and Speech Processing (eess.AS)

[18] arXiv:2104.01497 [pdf, other]

Title: Hi-Fi Multi-Speaker English TTS Dataset

Evelina Bakhturina, Vitaly Lavrukhin, Boris Ginsburg, Yang Zhang

Subjects: Audio and Speech Processing (eess.AS)

[19] arXiv:2104.01522 [pdf, other]

Title: TSNAT: Two-Step Non-Autoregressvie Transformer Models for Speech Recognition

Zhengkun Tian, Jiangyan Yi, Jianhua Tao, Ye Bai, Shuai Zhang, Zhengqi Wen, Xuefei Liu

Comments: Submitted to Interspeech2021

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[20] arXiv:2104.01541 [pdf, other]

Title: Attention Back-end for Automatic Speaker Verification with Multiple Enrollment Utterances

Chang Zeng, Xin Wang, Erica Cooper, Xiaoxiao Miao, Junichi Yamagishi

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[21] arXiv:2104.01721 [pdf, other]

Title: Citrinet: Closing the Gap between Non-Autoregressive and Autoregressive End-to-End Models for Automatic Speech Recognition

Somshubra Majumdar, Jagadeesh Balam, Oleksii Hrinchuk, Vitaly Lavrukhin, Vahid Noroozi, Boris Ginsburg

Subjects: Audio and Speech Processing (eess.AS)

[22] arXiv:2104.01818 [pdf, other]

Title: The Multi-speaker Multi-style Voice Cloning Challenge 2021

Qicong Xie, Xiaohai Tian, Guanghou Liu, Kun Song, Lei Xie, Zhiyong Wu, Hai Li, Song Shi, Haizhou Li, Fen Hong, Hui Bu, Xin Xu

Comments: has been accepted to ICASSP 2021

Subjects: Audio and Speech Processing (eess.AS)

[23] arXiv:2104.01882 [pdf, other]

Title: Speaker conditioned acoustic modeling for multi-speaker conversational ASR

Srikanth Raj Chetupalli, Sriram Ganapathy

Comments: Manuscript accepted for presentation at Interspeech 2022

Subjects: Audio and Speech Processing (eess.AS)

[24] arXiv:2104.01954 [pdf, other]

Title: Reformulating DOVER-Lap Label Mapping as a Graph Partitioning Problem

Desh Raj, Sanjeev Khudanpur

Comments: 5 pages, 3 figures. Acceped at INTERSPEECH 2021

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[25] arXiv:2104.02017 [pdf, other]

Title: Efficient Personalized Speech Enhancement through Self-Supervised Learning

Aswin Sivaraman, Minje Kim

Comments: 15 pages, 9 figures, published in IEEE JSTSP 2022

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[26] arXiv:2104.02018 [pdf, other]

Title: Personalized Speech Enhancement through Self-Supervised Data Augmentation and Purification

Aswin Sivaraman, Sunwoo Kim, Minje Kim

Comments: 5 pages, 3 figures, under review

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[27] arXiv:2104.02125 [pdf, other]

Title: SpeakerStew: Scaling to Many Languages with a Triaged Multilingual Text-Dependent and Text-Independent Speaker Verification System

Roza Chojnacka, Jason Pelecanos, Quan Wang, Ignacio Lopez Moreno

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[28] arXiv:2104.02128 [pdf, other]

Title: End-to-End Speaker-Attributed ASR with Transformer

Naoyuki Kanda, Guoli Ye, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka

Comments: Submitted to INTERSPEECH 2021

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[29] arXiv:2104.02321 [pdf, other]

Title: NU-Wave: A Diffusion Probabilistic Model for Neural Audio Upsampling

Junhyeok Lee, Seungu Han

Comments: Accepted to Interspeech 2021

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[30] arXiv:2104.02332 [pdf, other]

Title: Detecting English Speech in the Air Traffic Control Voice Communication

Igor Szoke, Santosh Kesiraju, Ondrej Novotny, Martin Kocour, Karel Vesely, Jan "Honza" Cernocky

Subjects: Audio and Speech Processing (eess.AS)

[31] arXiv:2104.02359 [pdf, other]

Title: LEAP Submission for the Third DIHARD Diarization Challenge

Prachi Singh, Rajat Varma, Venkat Krishnamohan, Srikanth Raj Chetupalli, Sriram Ganapathy

Comments: Accepted in INTERSPEECH 2021

Subjects: Audio and Speech Processing (eess.AS)

[32] arXiv:2104.02370 [pdf, other]

Title: Integrating Frequency Translational Invariance in TDNNs and Frequency Positional Information in 2D ResNets to Enhance Speaker Verification

Jenthe Thienpondt, Brecht Desplanques, Kris Demuynck

Comments: proceedings of INTERSPEECH 2021

Subjects: Audio and Speech Processing (eess.AS)

[33] arXiv:2104.02397 [pdf, other]

Title: ProsoBeast Prosody Annotation Tool

Branislav Gerazov, Michael Wagner

Comments: Accepted at Interspeech 2021

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)

[34] arXiv:2104.02469 [pdf, other]

Title: Speaker Diarization using Two-pass Leave-One-Out Gaussian PLDA Clustering of DNN Embeddings

Kiran Karra, Alan McCree

Comments: 5 pages, 2 figures, accepted at INTERSPEECH 2021

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Signal Processing (eess.SP)

[35] arXiv:2104.02518 [pdf, other]

Title: An Initial Investigation for Detecting Partially Spoofed Audio

Lin Zhang, Xin Wang, Erica Cooper, Junichi Yamagishi, Jose Patino, Nicholas Evans

Comments: INTERSPEECH 2021

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[36] arXiv:2104.02526 [pdf, other]

Title: LT-LM: a novel non-autoregressive language model for single-shot lattice rescoring

Anton Mitrofanov, Mariya Korenevskaya, Ivan Podluzhny, Yuri Khokhlov, Aleksandr Laptev, Andrei Andrusenko, Aleksei Ilin, Maxim Korenevsky, Ivan Medennikov, Aleksei Romanenko

Comments: Submitted to InterSpeech 2021

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)

[37] arXiv:2104.02571 [pdf, other]

Title: Speaker embeddings by modeling channel-wise correlations

Themos Stafylakis, Johan Rohdin, Lukas Burget

Comments: Accepted at Interspeech 2021

Subjects: Audio and Speech Processing (eess.AS); Computer Vision and Pattern Recognition (cs.CV)

[38] arXiv:2104.02724 [pdf, other]

Title: Relaxing the Conditional Independence Assumption of CTC-based ASR by Conditioning on Intermediate Predictions

Jumon Nozaki, Tatsuya Komatsu

Comments: Accepted to INTERSPEECH2021

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[39] arXiv:2104.02757 [pdf, other]

Title: Exploring Targeted Universal Adversarial Perturbations to End-to-end ASR Models

Zhiyun Lu, Wei Han, Yu Zhang, Liangliang Cao

Comments: Submitted to INTERSPEECH 2021

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[40] arXiv:2104.02819 [pdf, other]

Title: Learning to Rank Microphones for Distant Speech Recognition

Samuele Cornell, Alessio Brutti, Marco Matassoni, Stefano Squartini

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)

[41] arXiv:2104.02858 [pdf, other]

Title: Capturing Multi-Resolution Context by Dilated Self-Attention

Niko Moritz, Takaaki Hori, Jonathan Le Roux

Comments: In Proc. ICASSP 2021

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[42] arXiv:2104.02878 [pdf, other]

Title: Three-class Overlapped Speech Detection using a Convolutional Recurrent Neural Network

Jee-weon Jung, Hee-Soo Heo, Youngki Kwon, Joon Son Chung, Bong-Jin Lee

Comments: 5 pages, 2 figures, 4 tables, submitted to Interspeech as a conference paper

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[43] arXiv:2104.02879 [pdf, other]

Title: Adapting Speaker Embeddings for Speaker Diarisation

Youngki Kwon, Jee-weon Jung, Hee-Soo Heo, You Jin Kim, Bong-Jin Lee, Joon Son Chung

Comments: 5 pages, 2 figures, 3 tables, submitted to Interspeech as a conference paper

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[44] arXiv:2104.02882 [pdf, other]

Title: FSR: Accelerating the Inference Process of Transducer-Based Models by Applying Fast-Skip Regularization

Zhengkun Tian, Jiangyan Yi, Ye Bai, Jianhua Tao, Shuai Zhang, Zhengqi Wen

Comments: Submitted to INTERSPEECH2021

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[45] arXiv:2104.02901 [pdf, other]

Title: S2VC: A Framework for Any-to-Any Voice Conversion with Self-Supervised Pretrained Representations

Jheng-hao Lin, Yist Y. Lin, Chung-Ming Chien, Hung-yi Lee

Comments: Accepted by INTERSPEECH 2021

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[46] arXiv:2104.03004 [pdf, other]

Title: Siamese Neural Network with Joint Bayesian Model Structure for Speaker Verification

Xugang Lu, Peng Shen, Yu Tsao, Hisashi Kawai

Comments: arXiv admin note: substantial text overlap with arXiv:2101.03329

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[47] arXiv:2104.03009 [pdf, other]

Title: The AS-NU System for the M2VoC Challenge

Cheng-Hung Hu, Yi-Chiao Wu, Wen-Chin Huang, Yu-Huai Peng, Yu-Wen Chen, Pin-Jui Ku, Tomoki Toda, Yu Tsao, Hsin-Min Wang

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[48] arXiv:2104.03017 [pdf, other]

Title: Utilizing Self-supervised Representations for MOS Prediction

Wei-Cheng Tseng, Chien-yu Huang, Wei-Tsung Kao, Yist Y. Lin, Hung-yi Lee

Comments: In Proceedings of Interspeech 2021. We acknowledge the support of AWS Machine Learning Research Awards program. Source code available at this https URL

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[49] arXiv:2104.03074 [pdf, other]

Title: Audio declipping performance enhancement via crossfading

Pavel Záviška, Pavel Rajmic, Ondřej Mokrý

Journal-ref: Elsevier Signal Processing, vol. 192, March 2022, 108365

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[50] arXiv:2104.03416 [pdf, other]

Title: Pushing the Limits of Non-Autoregressive Speech Recognition

Edwin G. Ng, Chung-Cheng Chiu, Yu Zhang, William Chan

Comments: Proceedings of INTERSPEECH

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)