Sound

Authors and titles for June 2021

[51] arXiv:2106.07431 [pdf, other]

Title: CRASH: Raw Audio Score-based Generative Modeling for Controllable High-resolution Drum Sound Synthesis

Simon Rouard, Gaëtan Hadjeres

Comments: 12 pages, 11 figures

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[52] arXiv:2106.07448 [pdf, other]

Title: A Novel mapping for visual to auditory sensory substitution

Ezsan Mehrbani, Sezedeh Fatemeh Mirhoseini, Noushin Riahi

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS); Image and Video Processing (eess.IV)

[53] arXiv:2106.07577 [pdf, other]

Title: F-T-LSTM based Complex Network for Joint Acoustic Echo Cancellation and Speech Enhancement

Shimin Zhang, Yuxiang Kong, Shubo Lv, Yanxin Hu, Lei Xie

Comments: Accepted by Interspeech 2021

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[54] arXiv:2106.07732 [pdf, other]

Title: Learning Audio-Visual Dereverberation

Changan Chen, Wei Sun, David Harwath, Kristen Grauman

Comments: Accepted at ICASSP 2023. This is the longer version of the five-page camera-ready paper. Project page: this https URL

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[55] arXiv:2106.07787 [pdf, other]

Title: Tracing Back Music Emotion Predictions to Sound Sources and Intuitive Perceptual Qualities

Shreyan Chowdhury, Verena Praher, Gerhard Widmer

Comments: In Proceedings of the 18th Sound and Music Computing Conference (SMC 2021)

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[56] arXiv:2106.07843 [pdf, other]

Title: Teacher-Student MixIT for Unsupervised and Semi-supervised Speech Separation

Jisi Zhang, Catalin Zorila, Rama Doddipatla, Jon Barker

Comments: Accepted to Interspeech 2021

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[57] arXiv:2106.07874 [pdf, other]

Title: Towards the Objective Speech Assessment of Smoking Status based on Voice Features: A Review of the Literature

Zhizhong Ma, Chris Bullen, Joanna Ting Wai Chu, Ruili Wang, Yingchun Wang, Satwinder Singh

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[58] arXiv:2106.07886 [pdf, other]

Title: MLP Singer: Towards Rapid Parallel Korean Singing Voice Synthesis

Jaesung Tae, Hyeongju Kim, Younggun Lee

Comments: 6 pages, 5 figures, 2 tables, IEEE MLSP 2021

Journal-ref: 2021 IEEE 31st International Workshop on Machine Learning for Signal Processing (MLSP)

Subjects: Sound (cs.SD)

[59] arXiv:2106.08004 [pdf, other]

Title: Adaptive Margin Circle Loss for Speaker Verification

Runqiu Xiao

Comments: Accepted by Interspeech 2021

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[60] arXiv:2106.08207 [pdf, other]

Title: Graph-based Label Propagation for Semi-Supervised Speaker Identification

Long Chen, Venkatesh Ravichandran, Andreas Stolcke

Comments: To appear in Interspeech 2021

Journal-ref: Proc. Interspeech, Sept. 2021, pp. 4588-4592

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG)

[61] arXiv:2106.08427 [pdf, other]

Title: Pathological voice adaptation with autoencoder-based voice conversion

Marc Illa, Bence Mark Halpern, Rob van Son, Laureano Moro-Velazquez, Odette Scharenborg

Comments: 6 pages, 3 figures. Accepted to the 11th ISCA Speech Synthesis Workshop (2021)

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[62] arXiv:2106.08479 [pdf, other]

Title: Tonal Frequencies, Consonance, Dissonance: A Math-Bio Intersection

Steve Mathew

Comments: 9 pages, 1 figure, 1 table

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[63] arXiv:2106.08507 [pdf, other]

Title: WSRGlow: A Glow-based Waveform Generative Model for Audio Super-Resolution

Kexun Zhang, Yi Ren, Changliang Xu, Zhou Zhao

Comments: Accepted by INTERSPEECH 2021

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[64] arXiv:2106.08685 [pdf, other]

Title: Drum-Aware Ensemble Architecture for Improved Joint Musical Beat and Downbeat Tracking

Ching-Yu Chiu, Alvin Wen-Yu Su, Yi-Hsuan Yang

Comments: Accepted to IEEE Signal Processing Letters (May 2021)

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[65] arXiv:2106.08703 [pdf, other]

Title: Source Separation-based Data Augmentation for Improved Joint Beat and Downbeat Tracking

Ching-Yu Chiu, Joann Ching, Wen-Yi Hsiao, Yu-Hua Chen, Alvin Wen-Yu Su, Yi-Hsuan Yang

Comments: Accepted to European Signal Processing Conference (EUSIPCO 2021)

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[66] arXiv:2106.08873 [pdf, other]

Title: Voicy: Zero-Shot Non-Parallel Voice Conversion in Noisy Reverberant Environments

Alejandro Mottini, Jaime Lorenzo-Trueba, Sri Vishnu Kumar Karlapati, Thomas Drugman

Comments: Presented at the Speech Synthesis Workshops 2021 (SSW11)

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[67] arXiv:2106.09236 [pdf, other]

Title: Efficient Conformer with Prob-Sparse Attention Mechanism for End-to-EndSpeech Recognition

Xiong Wang, Sining Sun, Lei Xie, Long Ma

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[68] arXiv:2106.09320 [pdf, other]

Title: Multi-Level Transfer Learning from Near-Field to Far-Field Speaker Verification

Li Zhang, Qing Wang, Kong Aik Lee, Lei Xie, Haizhou Li

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[69] arXiv:2106.09669 [pdf, other]

Title: Improving On-Screen Sound Separation for Open-Domain Videos with Audio-Visual Self-Attention

Efthymios Tzinis, Scott Wisdom, Tal Remez, John R. Hershey

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[70] arXiv:2106.10003 [pdf, other]

Title: Improving Performance of Seen and Unseen Speech Style Transfer in End-to-end Neural TTS

Xiaochun An, Frank K. Soong, Lei Xie

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[71] arXiv:2106.10045 [pdf, other]

Title: Synchronising speech segments with musical beats in Mandarin and English singing

Cong Zhang, Jian Zhu

Comments: To be published in the Proceeding of Interspeech 2021

Journal-ref: Proc. Interspeech 2021, 1199-1203 (2001)

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[72] arXiv:2106.10406 [pdf, other]

Title: Improving robustness of one-shot voice conversion with deep discriminative speaker encoder

Hongqiang Du, Lei Xie

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[73] arXiv:2106.10481 [pdf, other]

Title: Advances in Speech Vocoding for Text-to-Speech with Continuous Parameters

Mohammed Salah Al-Radhi, Tamás Gábor Csapó, Géza Németh

Comments: 6 pages, 3 figures, International Conference on Artificial Intelligence and Speech Technology (AIST2020)

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[74] arXiv:2106.11075 [pdf, other]

Title: EML Online Speech Activity Detection for the Fearless Steps Challenge Phase-III

Omid Ghahabi, Volker Fischer

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[75] arXiv:2106.11233 [pdf, other]

Title: Affinity Mixup for Weakly Supervised Sound Event Detection

Mohammad Rasool Izadi, Robert Stevenson, Laura N. Kloepper

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[76] arXiv:2106.11335 [pdf, other]

Title: Do sound event representations generalize to other audio tasks? A case study in audio transfer learning

Anurag Kumar, Yun Wang, Vamsi Krishna Ithapu, Christian Fuegen

Comments: Accepted Interspeech 2021

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[77] arXiv:2106.11411 [pdf, other]

Title: Attention-based cross-modal fusion for audio-visual voice activity detection in musical video streams

Yuanbo Hou, Zhesong Yu, Xia Liang, Xingjian Du, Bilei Zhu, Zejun Ma, Dick Botteldooren

Comments: Accepted by INTERSPEECH 2021

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[78] arXiv:2106.11532 [pdf, other]

Title: Key-Sparse Transformer for Multimodal Speech Emotion Recognition

Weidong Chen, Xiaofeng Xing, Xiangmin Xu, Jichen Yang, Jianxin Pang

Comments: This paper was accepted by ICASSP 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[79] arXiv:2106.11713 [pdf, other]

Title: Multi-accent Speech Separation with One Shot Learning

Kuan-Po Huang, Yuan-Kuei Wu, Hung-yi Lee

Comments: Accepted at ACL 2021 Meta Learning for NLP

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[80] arXiv:2106.11730 [pdf, other]

Title: Learning to Inference with Early Exit in the Progressive Speech Enhancement

Andong Li, Chengshi Zheng, Lu Zhang, Xiaodong Li

Comments: Accepted by EUSIPCO2021

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[81] arXiv:2106.11789 [pdf, other]

Title: Glance and Gaze: A Collaborative Learning Framework for Single-channel Speech Enhancement

Andong Li, Chengshi Zheng, Lu Zhang, Xiaodong Li

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[82] arXiv:2106.12132 [pdf, other]

Title: Enrollment-less training for personalized voice activity detection

Naoki Makishima, Mana Ihori, Tomohiro Tanaka, Akihiko Takashima, Shota Orihashi, Ryo Masumura

Comments: Accepted to INTERSPEECH 2021

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[83] arXiv:2106.12271 [pdf, other]

Title: Unsupervised Speech Enhancement using Dynamical Variational Auto-Encoders

Xiaoyu Bie, Simon Leglaive, Xavier Alameda-Pineda, Laurent Girin

Journal-ref: IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 30, pp. 2993-3007, 2022

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[84] arXiv:2106.12743 [pdf, other]

Title: A Simultaneous Denoising and Dereverberation Framework with Target Decoupling

Andong Li, Wenzhe Liu, Xiaoxue Luo, Guochen Yu, Chengshi Zheng, Xiaodong Li

Comments: Accepted at Interspeech 2021

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[85] arXiv:2106.12851 [pdf, other]

Title: Additive Phoneme-aware Margin Softmax Loss for Language Recognition

Zheng Li, Yan Liu, Lin Li, Qingyang Hong

Comments: Accepted by Interspeech 2021

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[86] arXiv:2106.12896 [pdf, other]

Title: Non-Autoregressive TTS with Explicit Duration Modelling for Low-Resource Highly Expressive Speech

Raahil Shah, Kamil Pokora, Abdelhamid Ezzerg, Viacheslav Klimkov, Goeric Huybrechts, Bartosz Putrycz, Daniel Korzekwa, Thomas Merritt

Comments: 6 pages, 5 figures. Accepted to Speech Synthesis Workshop (SSW) 2021

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[87] arXiv:2106.12914 [pdf, other]

Title: Speech is Silver, Silence is Golden: What do ASVspoof-trained Models Really Learn?

Nicolas M. Müller, Franziska Dieckmann, Pavel Czempin, Roman Canals, Konstantin Böttinger, Jennifer Williams

Journal-ref: ASVspoof 2021 Workshop

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[88] arXiv:2106.12992 [pdf, other]

Title: SofaMyRoom: a fast and multiplatform "shoebox" room simulator for binaural room impulse response dataset generation

Roberto Barumerli, Daniele Bianchi, Michele Geronazzo, Federico Avanzini

Comments: 18 pages,4 figures, accompanying paper for an acoustic simulator description

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[89] arXiv:2106.13043 [pdf, other]

Title: AudioCLIP: Extending CLIP to Image, Text and Audio

Andrey Guzhov, Federico Raue, Jörn Hees, Andreas Dengel

Comments: submitted to GCPR 2021

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[90] arXiv:2106.13419 [pdf, other]

Title: Basis-MelGAN: Efficient Neural Vocoder Based on Audio Decomposition

Zhengxi Liu, Yanmin Qian

Comments: Accepted to INTERSPEECH 2021

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[91] arXiv:2106.13479 [pdf, other]

Title: Preliminary study on using vector quantization latent spaces for TTS/VC systems with consistent performance

Hieu-Thi Luong, Junichi Yamagishi

Comments: to be presented at SSW11

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[92] arXiv:2106.13511 [pdf, other]

Title: Evaluation of Deep-Learning-Based Voice Activity Detectors and Room Impulse Response Models in Reverberant Environments

Amir Ivry, Israel Cohen, Baruch Berdugo

Comments: Accepted to ICASSP 2020

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[93] arXiv:2106.13514 [pdf, other]

Title: Phoneme-aware and Channel-wise Attentive Learning for Text DependentSpeaker Verification

Yan Liu, Zheng Li, Lin Li, Qingyang Hong

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[94] arXiv:2106.13531 [pdf, other]

Title: Deep Residual Echo Suppression with A Tunable Tradeoff Between Signal Distortion and Echo Suppression

Amir Ivry, Israel Cohen, Baruch Berdugo

Comments: Accepted to ICASSP 2021

Journal-ref: pp. 126--130, year 2021

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[95] arXiv:2106.13754 [pdf, other]

Title: Nonlinear Acoustic Echo Cancellation with Deep Learning

Amir Ivry, Israel Cohen, Baruch Berdugo

Comments: Accepted to Interspeech 2021

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[96] arXiv:2106.13763 [pdf, other]

Title: Voice Activity Detection for Transient Noisy Environment Based on Diffusion Nets

Amir Ivry, Baruch Berdugo, Israel Cohen

Comments: Accepted to IEEE journal of selected topics in signal processing 2019

Journal-ref: volume 13, number 2, pp. 254--264, year 2019

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[97] arXiv:2106.13871 [pdf, other]

Title: Transflower: probabilistic autoregressive dance generation with multimodal attention

Guillermo Valle-Pérez, Gustav Eje Henter, Jonas Beskow, André Holzapfel, Pierre-Yves Oudeyer, Simon Alexanderson

Comments: Article presented at SIGGRAPH Asia 2021, and published in ACM Transactions on Graphics

Subjects: Sound (cs.SD); Graphics (cs.GR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[98] arXiv:2106.14136 [pdf, html, other]

Title: Listen As You Wish: Audio based Event Detection via Text-to-Audio Grounding in Smart Cities

Haoyu Tang, Yunxiao Wang, Jihua Zhu, Shuaike Zhang, Mingzhu Xu, Qinghai Zheng, Yupeng Hu

Comments: 16 pages

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[99] arXiv:2106.14371 [pdf, other]

Title: Sparsely Overlapped Speech Training in the Time Domain: Joint Learning of Target Speech Separation and Personal VAD Benefits

Qingjian Lin, Lin Yang, Xuyang Wang, Luyuan Xie, Chen Jia, Junjie Wang

Comments: Accepted by APSIPA 2021

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[100] arXiv:2106.15523 [pdf, other]

Title: Sounds of COVID-19: exploring realistic performance of audio-based digital testing

Jing Han, Tong Xia, Dimitris Spathis, Erika Bondareva, Chloë Brown, Jagmohan Chauhan, Ting Dang, Andreas Grammenos, Apinan Hasthanasombat, Andres Floto, Pietro Cicuta, Cecilia Mascolo

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)