Direct Punjabi to English speech translation using discrete units
Authors:
Prabhjot Kaur,
L. Andrew M. Bush,
Weisong Shi
Abstract:
Speech-to-speech translation is yet to reach the same level of coverage as text-to-text translation systems. The current speech technology is highly limited in its coverage of over 7000 languages spoken worldwide, leaving more than half of the population deprived of such technology and shared experiences. With voice-assisted technology (such as social robots and speech-to-text apps) and auditory c…
▽ More
Speech-to-speech translation is yet to reach the same level of coverage as text-to-text translation systems. The current speech technology is highly limited in its coverage of over 7000 languages spoken worldwide, leaving more than half of the population deprived of such technology and shared experiences. With voice-assisted technology (such as social robots and speech-to-text apps) and auditory content (such as podcasts and lectures) on the rise, ensuring that the technology is available for all is more important than ever. Speech translation can play a vital role in mitigating technological disparity and creating a more inclusive society. With a motive to contribute towards speech translation research for low-resource languages, our work presents a direct speech-to-speech translation model for one of the Indic languages called Punjabi to English. Additionally, we explore the performance of using a discrete representation of speech called discrete acoustic units as input to the Transformer-based translation model. The model, abbreviated as Unit-to-Unit Translation (U2UT), takes a sequence of discrete units of the source language (the language being translated from) and outputs a sequence of discrete units of the target language (the language being translated to). Our results show that the U2UT model performs better than the Speech-to-Unit Translation (S2UT) model by a 3.69 BLEU score.
△ Less
Submitted 24 February, 2024;
originally announced February 2024.
multiMap: A Gradient Spoiled Sequence for Simultaneously Measuring B1+, B0, T1/M0, T2, T2*, and Fat Fraction of a Slice
Authors:
Nicholas Dwork,
Adam B. Kerr,
Ethan M. I. Johnson,
Corey A. Baron,
Shreyas S. Vasanawala,
Peder E. Z. Larson,
Adam M. Bush,
John Pauly
Abstract:
We propose multiMap, a single scan that can generate several quantitative maps simultaneously. The sequence acquires multiple images in a time-efficient manner, which can be modeled for T_2, T2*, main- and transmit-field inhomogeneity, T_1:equilibrium magnetization, and water and fat content. The sequence is constructed so that cross-dependencies between parameters are isolated. Thus, each paramet…
▽ More
We propose multiMap, a single scan that can generate several quantitative maps simultaneously. The sequence acquires multiple images in a time-efficient manner, which can be modeled for T_2, T2*, main- and transmit-field inhomogeneity, T_1:equilibrium magnetization, and water and fat content. The sequence is constructed so that cross-dependencies between parameters are isolated. Thus, each parameter can be estimated independently. Estimates of all parameters are shown on bottle phantoms, the brain, and the knee. The results are compared to estimates from established techniques.
△ Less
Submitted 31 July, 2020; v1 submitted 30 July, 2020;
originally announced July 2020.
