Showing 1–20 of 20 results for author: Rajmic, P

Unsupervised Estimation of Nonlinear Audio Effects: Comparing Diffusion-Based and Adversarial approaches

Authors: Eloi Moliner, Michal Švento, Alec Wright, Lauri Juvela, Pavel Rajmic, Vesa Välimäki

Abstract: Accurately estimating nonlinear audio effects without access to paired input-output signals remains a challenging problem.This work studies unsupervised probabilistic approaches for solving this task. We introduce a method, novel for this application, based on diffusion generative models for blind system identification, enabling the estimation of unknown nonlinear effects using black- and gray-box… ▽ More Accurately estimating nonlinear audio effects without access to paired input-output signals remains a challenging problem.This work studies unsupervised probabilistic approaches for solving this task. We introduce a method, novel for this application, based on diffusion generative models for blind system identification, enabling the estimation of unknown nonlinear effects using black- and gray-box models. This study compares this method with a previously proposed adversarial approach, analyzing the performance of both methods under different parameterizations of the effect operator and varying lengths of available effected recordings.Through experiments on guitar distortion effects, we show that the diffusion-based approach provides more stable results and is less sensitive to data availability, while the adversarial approach is superior at estimating more pronounced distortion effects. Our findings contribute to the robust unsupervised blind estimation of audio effects, demonstrating the potential of diffusion models for system identification in music technology. △ Less

Submitted 7 April, 2025; originally announced April 2025.

Comments: Submitted to the 28th International Conference on Digital Audio Effects (DAFx25)

Regularized autoregressive modeling and its application to audio signal declipping

Authors: Ondřej Mokrý, Pavel Rajmic

Abstract: Autoregressive (AR) modeling is invaluable in signal processing, in particular in speech and audio fields. Attempts in the literature can be found that regularize or constrain either the time-domain signal values or the AR coefficients, which is done for various reasons, including the incorporation of prior information or numerical stabilization. Although these attempts are appealing, an encompass… ▽ More Autoregressive (AR) modeling is invaluable in signal processing, in particular in speech and audio fields. Attempts in the literature can be found that regularize or constrain either the time-domain signal values or the AR coefficients, which is done for various reasons, including the incorporation of prior information or numerical stabilization. Although these attempts are appealing, an encompassing and generic modeling framework is still missing. We propose such a framework and the related optimization problem and algorithm. We discuss the computational demands of the algorithm and explore the effects of various improvements on its convergence speed. In the experimental part, we demonstrate the usefulness of our approach on the audio declipping problem. We compare its performance against the state-of-the-art methods and demonstrate the competitiveness of the proposed method, especially for mildly clipped signals. The evaluation is extended by considering a heuristic algorithm of generalized linear prediction (GLP), a strong competitor which has only been presented as a patent and is new in the scientific community. △ Less

Submitted 23 October, 2024; originally announced October 2024.

Dequantization of a signal from two parallel quantized observations

Authors: Vojtěch Kovanda, Pavel Rajmic

Abstract: We propose a technique of signal acquisition using a combination of two devices with different sampling rates and quantization accuracies. Subsequent processing involving sparsity regularization enables us to reconstruct the signal at such a sampling frequency and with such a bit depth that was not possible using the two devices independently. Objective and subjective tests show the superiority of… ▽ More We propose a technique of signal acquisition using a combination of two devices with different sampling rates and quantization accuracies. Subsequent processing involving sparsity regularization enables us to reconstruct the signal at such a sampling frequency and with such a bit depth that was not possible using the two devices independently. Objective and subjective tests show the superiority of the proposed method in comparison with alternatives. △ Less

Submitted 11 March, 2025; v1 submitted 12 September, 2024; originally announced September 2024.

Comments: This preprint has been withdrawn by the authors since the experiments have been found to contain somewhat unfair comparison between the proposed method and the others. Authors work on another paper containing a new experimental section

Janssen 2.0: Audio Inpainting in the Time-frequency Domain

Authors: Ondřej Mokrý, Peter Balušík, Pavel Rajmic

Abstract: The paper focuses on inpainting missing parts of an audio signal spectrogram. The autoregression-based Janssen algorithm, the state-of-the-art for the time-domain audio inpainting, is adapted for the time-frequency setting. This novel method, termed Janssen-TF, is compared to the deep-prior neural network approach using both objective metrics and a~subjective listening test, proving Janssen-TF to… ▽ More The paper focuses on inpainting missing parts of an audio signal spectrogram. The autoregression-based Janssen algorithm, the state-of-the-art for the time-domain audio inpainting, is adapted for the time-frequency setting. This novel method, termed Janssen-TF, is compared to the deep-prior neural network approach using both objective metrics and a~subjective listening test, proving Janssen-TF to be superior in all the considered measures. △ Less

Submitted 12 February, 2025; v1 submitted 10 September, 2024; originally announced September 2024.

Comments: Submitted to EUSIPCO 2025

The best autoregressive approach to audio inpainting is gap-wise Janssen

Authors: Ondřej Mokrý, Pavel Rajmic

Abstract: A novel variant of the Janssen method for audio inpainting is presented. The new method is compared with a number of other popular audio inpainting methods based on autoregressive modeling. Main differences between the particular approaches are pointed out. In the experimental part, the importance of the choice of the AR model estimator is confirmed by objective metrics, and the effect of the chos… ▽ More A novel variant of the Janssen method for audio inpainting is presented. The new method is compared with a number of other popular audio inpainting methods based on autoregressive modeling. Main differences between the particular approaches are pointed out. In the experimental part, the importance of the choice of the AR model estimator is confirmed by objective metrics, and the effect of the chosen AR model order and window size is explored. The results of small-scale and mid-scale computational experiments are in agreement. The results show the superiority of the proposed gap-wise Janssen approach, which is confirmed by a listening test. △ Less

Submitted 3 March, 2025; v1 submitted 7 March, 2024; originally announced March 2024.

Improving DCE-MRI through unfolded low-rank + sparse optimisation

Authors: Ondřej Mokrý, Jiří Vitouš, Pavel Rajmic, Radovan Jiřík

Abstract: A method for perfusion imaging with DCE-MRI is developed based on two popular paradigms: the low-rank + sparse model for optimisation-based reconstruction, and the deep unfolding. A learnable algorithm derived from a proximal algorithm is designed with emphasis on simplicity and interpretability. The resulting deep network is trained and evaluated using a simulated measurement of a rat with a brai… ▽ More A method for perfusion imaging with DCE-MRI is developed based on two popular paradigms: the low-rank + sparse model for optimisation-based reconstruction, and the deep unfolding. A learnable algorithm derived from a proximal algorithm is designed with emphasis on simplicity and interpretability. The resulting deep network is trained and evaluated using a simulated measurement of a rat with a brain tumor, showing large performance gain over the classical low-rank + sparse baseline. Moreover, quantitative perfusion analysis is performed based on the reconstructed sequence, proving that even training based on a simple pixel-wise error can lead to significant improvement of the quality of the perfusion maps. △ Less

Submitted 12 December, 2023; originally announced December 2023.

Comments: This work has been submitted to the IEEE for possible publication

Multiple Hankel matrix rank minimization for audio inpainting

Authors: Pavel Záviška, Pavel Rajmic, Ondřej Mokrý

Abstract: Sasaki et al. (2018) presented an efficient audio declipping algorithm, based on the properties of Hankel-structure matrices constructed from time-domain signal blocks. We adapt their approach to solving the audio inpainting problem, where samples are missing in the signal. We analyze the algorithm and provide modifications, some of them leading to an improved performance. Overall, it turns out th… ▽ More Sasaki et al. (2018) presented an efficient audio declipping algorithm, based on the properties of Hankel-structure matrices constructed from time-domain signal blocks. We adapt their approach to solving the audio inpainting problem, where samples are missing in the signal. We analyze the algorithm and provide modifications, some of them leading to an improved performance. Overall, it turns out that the new algorithms perform reasonably well for speech signals but they are not competitive in the case of music signals. △ Less

Submitted 14 July, 2023; v1 submitted 31 March, 2023; originally announced March 2023.

Journal ref: 2023 46th International Conference on Telecommunications and Signal Processing (TSP)

Audio Declipping with (Weighted) Analysis Social Sparsity

Authors: Pavel Záviška, Pavel Rajmic

Abstract: We develop the analysis (cosparse) variant of the popular audio declipping algorithm of Siedenburg et al. (2014). Furthermore, we extend both the old and the new variants by the possibility of weighting the time-frequency coefficients. We examine the audio reconstruction performance of several combinations of weights and shrinkage operators. The weights are shown to improve the reconstruction qual… ▽ More We develop the analysis (cosparse) variant of the popular audio declipping algorithm of Siedenburg et al. (2014). Furthermore, we extend both the old and the new variants by the possibility of weighting the time-frequency coefficients. We examine the audio reconstruction performance of several combinations of weights and shrinkage operators. The weights are shown to improve the reconstruction quality in some cases; however, the best scores achieved by the non-weighted methods are not surpassed with the help of weights. Yet, the analysis Empirical Wiener (EW) shrinkage was able to reach the quality of a computationally more expensive competitor, the Persistent Empirical Wiener (PEW). Moreover, the proposed analysis variant incorporating PEW slightly outperforms the synthesis counterpart in terms of an auditorily motivated metric. △ Less

Submitted 27 June, 2022; v1 submitted 20 May, 2022; originally announced May 2022.

Journal ref: 2022 45th International Conference on Telecommunications and Signal Processing (TSP)

Audio declipping performance enhancement via crossfading

Authors: Pavel Záviška, Pavel Rajmic, Ondřej Mokrý

Abstract: Some audio declipping methods produce waveforms that do not fully respect the physical process of clipping, which is why we refer to them as inconsistent. This letter reports what effect on perception it has if the solution by inconsistent methods is forced consistent by postprocessing. We first propose a simple sample replacement method, then we identify its main weaknesses and propose an improve… ▽ More Some audio declipping methods produce waveforms that do not fully respect the physical process of clipping, which is why we refer to them as inconsistent. This letter reports what effect on perception it has if the solution by inconsistent methods is forced consistent by postprocessing. We first propose a simple sample replacement method, then we identify its main weaknesses and propose an improved variant. The experiments show that the vast majority of inconsistent declipping methods significantly benefit from the proposed approach in terms of objective perceptual metrics. In particular, we show that the SS PEW method based on social sparsity combined with the proposed method performs comparable to top methods from the consistent class, but at a computational cost of one order of magnitude lower. △ Less

Submitted 7 April, 2021; originally announced April 2021.

Journal ref: Elsevier Signal Processing, vol. 192, March 2022, 108365

Audio Dequantization Using (Co)Sparse (Non)Convex Methods

Authors: Pavel Záviška, Pavel Rajmic, Ondřej Mokrý

Abstract: The paper deals with the hitherto neglected topic of audio dequantization. It reviews the state-of-the-art sparsity-based approaches and proposes several new methods. Convex as well as non-convex approaches are included, and all the presented formulations come in both the synthesis and analysis variants. In the experiments the methods are evaluated using the signal-to-distortion ratio (SDR) and PE… ▽ More The paper deals with the hitherto neglected topic of audio dequantization. It reviews the state-of-the-art sparsity-based approaches and proposes several new methods. Convex as well as non-convex approaches are included, and all the presented formulations come in both the synthesis and analysis variants. In the experiments the methods are evaluated using the signal-to-distortion ratio (SDR) and PEMO-Q, a perceptually motivated metric. △ Less

Submitted 10 February, 2021; v1 submitted 30 October, 2020; originally announced October 2020.

Journal ref: ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

A survey and an extensive evaluation of popular audio declipping methods

Authors: Pavel Záviška, Pavel Rajmic, Alexey Ozerov, Lucas Rencker

Abstract: Dynamic range limitations in signal processing often lead to clipping, or saturation, in signals. The task of audio declipping is estimating the original audio signal, given its clipped measurements, and has attracted much interest in recent years. Audio declipping algorithms often make assumptions about the underlying signal, such as sparsity or low-rankness, and about the measurement system. In… ▽ More Dynamic range limitations in signal processing often lead to clipping, or saturation, in signals. The task of audio declipping is estimating the original audio signal, given its clipped measurements, and has attracted much interest in recent years. Audio declipping algorithms often make assumptions about the underlying signal, such as sparsity or low-rankness, and about the measurement system. In this paper, we provide an extensive review of audio declipping algorithms proposed in the literature. For each algorithm, we present assumptions that are made about the audio signal, the modeling domain, and the optimization algorithm. Furthermore, we provide an extensive numerical evaluation of popular declipping algorithms, on real audio data. We evaluate each algorithm in terms of the Signal-to-Distortion Ratio, and also using perceptual metrics of sound quality. The article is accompanied by a repository containing the evaluated methods. △ Less

Submitted 4 January, 2021; v1 submitted 15 July, 2020; originally announced July 2020.

Journal ref: IEEE Journal of Selected Topics in Signal Processing, vol. 15, no. 1, pp. 5-24, Jan. 2021

Approximal operator with application to audio inpainting

Authors: Ondřej Mokrý, Pavel Rajmic

Abstract: In their recent evaluation of time-frequency representations and structured sparsity approaches to audio inpainting, Lieb and Stark (2018) have used a particular mapping as a proximal operator. This operator serves as the fundamental part of an iterative numerical solver. However, their mapping is improperly justified. The present article proves that their mapping is indeed a proximal operator, an… ▽ More In their recent evaluation of time-frequency representations and structured sparsity approaches to audio inpainting, Lieb and Stark (2018) have used a particular mapping as a proximal operator. This operator serves as the fundamental part of an iterative numerical solver. However, their mapping is improperly justified. The present article proves that their mapping is indeed a proximal operator, and also derives its proper counterpart. Furthermore, it is rationalized that Lieb and Stark's operator can be understood as an approximation of the proper mapping. Surprisingly, in most cases, such an approximation (referred to as the approximal operator) is shown to provide even better numerical results in audio inpainting compared to its proper counterpart, while being computationally much more effective. △ Less

Submitted 14 September, 2020; v1 submitted 4 May, 2020; originally announced May 2020.

Flexible framework for audio reconstruction

Authors: Ondřej Mokrý, Pavel Rajmic, Pavel Záviška

Abstract: The paper presents a unified, flexible framework for the tasks of audio inpainting, declipping, and dequantization. The concept is further extended to cover analogous degradation models in a transformed domain, e.g. quantization of the signal's time-frequency coefficients. The task of reconstructing an audio signal from degraded observations in two different domains is formulated as an inverse pro… ▽ More The paper presents a unified, flexible framework for the tasks of audio inpainting, declipping, and dequantization. The concept is further extended to cover analogous degradation models in a transformed domain, e.g. quantization of the signal's time-frequency coefficients. The task of reconstructing an audio signal from degraded observations in two different domains is formulated as an inverse problem, and several algorithmic solutions are developed. The viability of the presented concept is demonstrated on an example where audio reconstruction from partial and quantized observations of both the time-domain signal and its time-frequency coefficients is carried out. △ Less

Submitted 29 July, 2020; v1 submitted 23 April, 2020; originally announced April 2020.

Journal ref: 23rd International Conference on Digital Audio Effects (eDAFx2020)

Sparse and Cosparse Audio Dequantization Using Convex Optimization

Authors: Pavel Záviška, Pavel Rajmic

Abstract: The paper shows the potential of sparsity-based methods in restoring quantized signals. Following up on the study of Brauer et al. (IEEE ICASSP 2016), we significantly extend the range of the evaluation scenarios: we introduce the analysis (cosparse) model, we use more effective algorithms, we experiment with another time-frequency transform. The paper shows that the analysis-based model performs… ▽ More The paper shows the potential of sparsity-based methods in restoring quantized signals. Following up on the study of Brauer et al. (IEEE ICASSP 2016), we significantly extend the range of the evaluation scenarios: we introduce the analysis (cosparse) model, we use more effective algorithms, we experiment with another time-frequency transform. The paper shows that the analysis-based model performs comparably to the synthesis-model, but the Gabor transform produces better results than the originally used cosine transform. Last but not least, we provide codes and data in a reproducible way. △ Less

Submitted 20 May, 2020; v1 submitted 5 March, 2020; originally announced March 2020.

Journal ref: 2020 43rd International Conference on Telecommunications and Signal Processing (TSP)

Audio Inpainting: Revisited and Reweighted

Authors: Ondřej Mokrý, Pavel Rajmic

Abstract: We deal with the problem of sparsity-based audio inpainting, i.e. filling in the missing segments of audio. A consequence of the approaches based on mathematical optimization is the insufficient amplitude of the signal in the filled gaps. Remaining in the framework based on sparsity and convex optimization, we propose improvements to audio inpainting, aiming at compensating for such an energy loss… ▽ More We deal with the problem of sparsity-based audio inpainting, i.e. filling in the missing segments of audio. A consequence of the approaches based on mathematical optimization is the insufficient amplitude of the signal in the filled gaps. Remaining in the framework based on sparsity and convex optimization, we propose improvements to audio inpainting, aiming at compensating for such an energy loss. The new ideas are based on different types of weighting, both in the coefficient and the time domains. We show that our propositions improve the inpainting performance in terms of both the SNR and ODG. △ Less

Submitted 21 August, 2020; v1 submitted 8 January, 2020; originally announced January 2020.

Psychoacoustically Motivated Audio Declipping Based on Weighted l1 Minimization

Authors: Pavel Záviška, Pavel Rajmic, Jíří Schimmel

Abstract: A novel method for audio declipping based on sparsity is presented. The method incorporates psychoacoustic information by weighting the transform coefficients in the $\ell_1$ minimization. Weighting leads to an improved quality of restoration while retaining a low complexity of the algorithm. Three possible constructions of the weights are proposed, based on the absolute threshold of hearing, the… ▽ More A novel method for audio declipping based on sparsity is presented. The method incorporates psychoacoustic information by weighting the transform coefficients in the $\ell_1$ minimization. Weighting leads to an improved quality of restoration while retaining a low complexity of the algorithm. Three possible constructions of the weights are proposed, based on the absolute threshold of hearing, the global masking threshold and on a quadratic curve. Experiments compare the restoration quality according to the signal-to-distortion ratio (SDR) and PEMO-Q objective difference grade (ODG) and indicate that with correctly chosen weights, the presented method is able to compete, or even outperform, the current state of the art. △ Less

Submitted 1 July, 2020; v1 submitted 2 May, 2019; originally announced May 2019.

Journal ref: 2019 42nd International Conference on Telecommunications and Signal Processing (TSP)

Introducing SPAIN (SParse Audio INpainter)

Authors: Ondřej Mokrý, Pavel Záviška, Pavel Rajmic, Vítězslav Veselý

Abstract: A novel sparsity-based algorithm for audio inpainting is proposed. It is an adaptation of the SPADE algorithm by Kitić et al., originally developed for audio declipping, to the task of audio inpainting. The new SPAIN (SParse Audio INpainter) comes in synthesis and analysis variants. Experiments show that both A-SPAIN and S-SPAIN outperform other sparsity-based inpainting algorithms. Moreover, A-SP… ▽ More A novel sparsity-based algorithm for audio inpainting is proposed. It is an adaptation of the SPADE algorithm by Kitić et al., originally developed for audio declipping, to the task of audio inpainting. The new SPAIN (SParse Audio INpainter) comes in synthesis and analysis variants. Experiments show that both A-SPAIN and S-SPAIN outperform other sparsity-based inpainting algorithms. Moreover, A-SPAIN performs on a par with the state-of-the-art method based on linear prediction in terms of the SNR, and, for larger gaps, SPAIN is even slightly better in terms of the PEMO-Q psychoacoustic criterion. △ Less

Submitted 18 June, 2019; v1 submitted 31 October, 2018; originally announced October 2018.

Journal ref: 2019 27th European Signal Processing Conference (EUSIPCO)

A Proper version of Synthesis-based Sparse Audio Declipper

Authors: Pavel Záviška, Pavel Rajmic, Ondřej Mokrý, Zdeněk Průša

Abstract: Methods based on sparse representation have found great use in the recovery of audio signals degraded by clipping. The state of the art in declipping has been achieved by the SPADE algorithm by Kitić et. al. (LVA/ICA2015). Our recent study (LVA/ICA2018) has shown that although the original S-SPADE can be improved such that it converges significantly faster than the A-SPADE, the restoration quality… ▽ More Methods based on sparse representation have found great use in the recovery of audio signals degraded by clipping. The state of the art in declipping has been achieved by the SPADE algorithm by Kitić et. al. (LVA/ICA2015). Our recent study (LVA/ICA2018) has shown that although the original S-SPADE can be improved such that it converges significantly faster than the A-SPADE, the restoration quality is significantly worse. In the present paper, we propose a new version of S-SPADE. Experiments show that the novel version of S-SPADE outperforms its old version in terms of restoration quality, and that it is comparable with the A-SPADE while being even slightly faster than A-SPADE. △ Less

Submitted 16 January, 2020; v1 submitted 29 October, 2018; originally announced October 2018.

Journal ref: ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brighton, United Kingdom, 2019, pp. 591-595

S-SPADE Done Right: Detailed Study of the Sparse Audio Declipper Algorithms

Authors: Pavel Záviška, Ondřej Mokrý, Pavel Rajmic

Abstract: This technical report shows and discusses in detail how Sparse Audio Declipper (SPADE) algorithms are derived from the signal model using the ADMM approach. The analysis version (A-SPADE) of Kitić et. al. (LVA/ICA 2015) is derived and justified. The synthesis version (S-SPADE) of the same research team is shown to solve a different optimization task than intended. This issue is corrected in this r… ▽ More This technical report shows and discusses in detail how Sparse Audio Declipper (SPADE) algorithms are derived from the signal model using the ADMM approach. The analysis version (A-SPADE) of Kitić et. al. (LVA/ICA 2015) is derived and justified. The synthesis version (S-SPADE) of the same research team is shown to solve a different optimization task than intended. This issue is corrected in this report, leading to the new S-SPADE algorithm which is in line to A-SPADE. △ Less

Submitted 16 January, 2020; v1 submitted 26 September, 2018; originally announced September 2018.

Revisiting Synthesis Model of Sparse Audio Declipper

Authors: Pavel Záviška, Pavel Rajmic, Zdeněk Průša, Vítězslav Veselý

Abstract: The state of the art in audio declipping has currently been achieved by SPADE (SParse Audio DEclipper) algorithm by Kitić et al. Until now, the synthesis/sparse variant, S-SPADE, has been considered significantly slower than its analysis/cosparse counterpart, A-SPADE. It turns out that the opposite is true: by exploiting a recent projection lemma, individual iterations of both algorithms can be ma… ▽ More The state of the art in audio declipping has currently been achieved by SPADE (SParse Audio DEclipper) algorithm by Kitić et al. Until now, the synthesis/sparse variant, S-SPADE, has been considered significantly slower than its analysis/cosparse counterpart, A-SPADE. It turns out that the opposite is true: by exploiting a recent projection lemma, individual iterations of both algorithms can be made equally computationally expensive, while S-SPADE tends to require considerably fewer iterations to converge. In this paper, the two algorithms are compared across a range of parameters such as the window length, window overlap and redundancy of the transform. The experiments show that although S-SPADE typically converges faster, the average performance in terms of restoration quality is not superior to A-SPADE. △ Less

Submitted 11 July, 2018; v1 submitted 10 July, 2018; originally announced July 2018.

Journal ref: LVA ICA 2018. The 14th International Conference on Latent Variable Analysis and Signal Separation, Guildford, United Kingdom, July 2018