-
DeepInverse: A Python package for solving imaging inverse problems with deep learning
Authors:
Julián Tachella,
Matthieu Terris,
Samuel Hurault,
Andrew Wang,
Dongdong Chen,
Minh-Hai Nguyen,
Maxime Song,
Thomas Davies,
Leo Davy,
Jonathan Dong,
Paul Escande,
Johannes Hertrich,
Zhiyuan Hu,
Tobías I. Liaudat,
Nils Laurent,
Brett Levac,
Mathurin Massias,
Thomas Moreau,
Thibaut Modrzyk,
Brayan Monroy,
Sebastian Neumayer,
Jérémy Scanvic,
Florian Sarron,
Victor Sechaud,
Georg Schramm
, et al. (2 additional authors not shown)
Abstract:
DeepInverse is an open-source PyTorch-based library for solving imaging inverse problems. The library covers all crucial steps in image reconstruction from the efficient implementation of forward operators (e.g., optics, MRI, tomography), to the definition and resolution of variational problems and the design and training of advanced neural network architectures. In this paper, we describe the mai…
▽ More
DeepInverse is an open-source PyTorch-based library for solving imaging inverse problems. The library covers all crucial steps in image reconstruction from the efficient implementation of forward operators (e.g., optics, MRI, tomography), to the definition and resolution of variational problems and the design and training of advanced neural network architectures. In this paper, we describe the main functionality of the library and discuss the main design choices.
△ Less
Submitted 17 June, 2025; v1 submitted 26 May, 2025;
originally announced May 2025.
-
On the Concentration of the Minimizers of Empirical Risks
Authors:
Paul Escande
Abstract:
Obtaining guarantees on the convergence of the minimizers of empirical risks to the ones of the true risk is a fundamental matter in statistical learning. Instead of deriving guarantees on the usual estimation error, the goal of this paper is to provide concentration inequalities on the distance between the sets of minimizers of the risks for a broad spectrum of estimation problems. In particular,…
▽ More
Obtaining guarantees on the convergence of the minimizers of empirical risks to the ones of the true risk is a fundamental matter in statistical learning. Instead of deriving guarantees on the usual estimation error, the goal of this paper is to provide concentration inequalities on the distance between the sets of minimizers of the risks for a broad spectrum of estimation problems. In particular, the risks are defined on metric spaces through probability measures that are also supported on metric spaces. A particular attention will therefore be given to include unbounded spaces and non-convex cost functions that might also be unbounded. This work identifies a set of assumptions allowing to describe a regime that seem to govern the concentration in many estimation problems, where the empirical minimizers are stable. This stability can then be leveraged to prove parametric concentration rates in probability and in expectation. The assumptions are verified, and the bounds showcased, on a selection of estimation problems such as barycenters on metric space with positive or negative curvature, subspaces of covariance matrices, regression problems and entropic-Wasserstein barycenters.
△ Less
Submitted 11 September, 2024; v1 submitted 3 April, 2023;
originally announced April 2023.
-
Random walk informed community detection reveals heterogeneities in the lymph node conduits network
Authors:
Solène Song,
Malek Senoussi,
Paul Escande,
Paul Villoutreix
Abstract:
Random walks on networks are widely used to model stochastic processes such as search strategies, transportation problems or disease propagation. A prominent example of such process is the guiding of naive T cells by the lymph node conduits network. Here,we propose a general framework to find network heterogeneities, which we define as connectivity patterns that affect the random walk. We propose…
▽ More
Random walks on networks are widely used to model stochastic processes such as search strategies, transportation problems or disease propagation. A prominent example of such process is the guiding of naive T cells by the lymph node conduits network. Here,we propose a general framework to find network heterogeneities, which we define as connectivity patterns that affect the random walk. We propose to characterize and measure these heterogeneities by detecting communities in a way that is interpretable in terms of random walk. Moreover, we use an approximation to accurately and efficiently compute these quantities on large networks. Finally, we propose an interactive data visualization platform to follow the dynamics of the random walks and their characteristics on our datasets, and a ready-to-use pipeline for other datasets upon download. By computing quantitative feature of random walk informed communities detected within the network, we show that the lymph node conduit network is spatially coherent, however, despite its quasi-regularity, contains some random walk related heterogeneities. To evaluate these characteristics, we applied the same workflow of diffusion based community detection and analysis on the LNCN and a series of generated toy networks.
△ Less
Submitted 20 October, 2022; v1 submitted 14 February, 2022;
originally announced February 2022.
-
Fast Wavelet Decomposition of Linear Operators through Product-Convolution Expansions
Authors:
Paul Escande,
Pierre Weiss
Abstract:
Wavelet decompositions of integral operators have proven their efficiency in reducing computing times for many problems, ranging from the simulation of waves or fluids to the resolution of inverse problems in imaging. Unfortunately, computing the decomposition is itself a hard problem which is oftentimes out of reach for large scale problems. The objective of this work is to design fast decomposit…
▽ More
Wavelet decompositions of integral operators have proven their efficiency in reducing computing times for many problems, ranging from the simulation of waves or fluids to the resolution of inverse problems in imaging. Unfortunately, computing the decomposition is itself a hard problem which is oftentimes out of reach for large scale problems. The objective of this work is to design fast decomposition algorithms based on another representation called product-convolution expansion. This decomposition can be evaluated efficiently assuming that a few impulse responses of the operator are available, but it is usually less efficient than the wavelet decomposition when incorporated in iterative methods. The proposed decomposition algorithms, run in quasi-linear time and we provide some numerical experiments to assess its performance for an imaging problem involving space varying blurs.
△ Less
Submitted 31 July, 2020; v1 submitted 20 May, 2020;
originally announced May 2020.
-
A scalable estimator of sets of integral operators
Authors:
Valentin Debarnot,
Paul Escande,
Pierre Weiss
Abstract:
We propose a scalable method to find a subspace $\widehat{\mathcal{H}}$ of low-rank tensors that simultaneously approximates a set of integral operators. The method can be seen as a generalization of the Tucker-2 decomposition model, which was never used in this context. In addition, we propose to construct a convex set $\widehat{\mathcal{C}} \subset \widehat{\mathcal{H}}$ as the convex hull of th…
▽ More
We propose a scalable method to find a subspace $\widehat{\mathcal{H}}$ of low-rank tensors that simultaneously approximates a set of integral operators. The method can be seen as a generalization of the Tucker-2 decomposition model, which was never used in this context. In addition, we propose to construct a convex set $\widehat{\mathcal{C}} \subset \widehat{\mathcal{H}}$ as the convex hull of the observed operators. It is a minimax optimal estimator under the Nikodym metric. We then provide an efficient algorithm to compute projection on $\widehat{\mathcal{C}}$. We observe a good empirical behavior of the method in simulations. The main aim of this work is to improve the identifiability of complex linear operators in blind inverse problems.
△ Less
Submitted 28 November, 2018;
originally announced November 2018.
-
Estimation of linear operators from scattered impulse responses
Authors:
Jérémie Bigot,
Paul Escande,
Pierre Weiss
Abstract:
We provide a new estimator of integral operators with smooth kernels, obtained from a set of scattered and noisy impulse responses. The proposed approach relies on the formalism of smoothing in reproducing kernel Hilbert spaces and on the choice of an appropriate regularization term that takes the smoothness of the operator into account. It is numerically tractable in very large dimensions. We stu…
▽ More
We provide a new estimator of integral operators with smooth kernels, obtained from a set of scattered and noisy impulse responses. The proposed approach relies on the formalism of smoothing in reproducing kernel Hilbert spaces and on the choice of an appropriate regularization term that takes the smoothness of the operator into account. It is numerically tractable in very large dimensions. We study the estimator's robustness to noise and analyze its approximation properties with respect to the size and the geometry of the dataset. In addition, we show minimax optimality of the proposed estimator.
△ Less
Submitted 1 December, 2017; v1 submitted 13 October, 2016;
originally announced October 2016.
-
Approximation of integral operators using convolution-product expansions
Authors:
Paul Escande,
Pierre Weiss
Abstract:
We consider a class of linear integral operators with impulse responses varying regularly in time or space. These operators appear in a large number of applications ranging from signal/image processing to biology. Evaluating their action on functions is a computation-ally intensive problem necessary for many practical problems. We analyze a technique called convolution-product expansion: the opera…
▽ More
We consider a class of linear integral operators with impulse responses varying regularly in time or space. These operators appear in a large number of applications ranging from signal/image processing to biology. Evaluating their action on functions is a computation-ally intensive problem necessary for many practical problems. We analyze a technique called convolution-product expansion: the operator is locally approximated by a convolution, allowing to design fast numerical algorithms based on the fast Fourier transform. We design various types of expansions, provide their explicit rates of approximation and their complexity depending on the time varying impulse response smoothness. This analysis suggests novel wavelet based implementations of the method with numerous assets such as optimal approximation rates, low complexity and storage requirements as well as adaptivity to the kernels regularity. The proposed methods are an alternative to more standard procedures such as panel clustering, cross approximations, wavelet expansions or hierarchical matrices.
△ Less
Submitted 15 April, 2016;
originally announced April 2016.
-
Real-time $\ell^1$ -- $\ell^2$ deblurring using wavelet expansions of operators
Authors:
Paul Escande,
Pierre Weiss
Abstract:
Image deblurring is a fundamental problem in imaging, usually solved with com-putationally intensive optimization procedures. We show that the minimization can be significantly accelerated by leveraging the fact that images and blur operators are compressible in the same orthogonal wavelet basis. The proposed methodology consists of three ingredients: i) a sparse approximation of the blur operator…
▽ More
Image deblurring is a fundamental problem in imaging, usually solved with com-putationally intensive optimization procedures. We show that the minimization can be significantly accelerated by leveraging the fact that images and blur operators are compressible in the same orthogonal wavelet basis. The proposed methodology consists of three ingredients: i) a sparse approximation of the blur operator in wavelet bases, ii) a diagonal preconditioner and iii) an implementation on massively parallel architectures. Combing the three ingredients leads to acceleration factors ranging from 30 to 250 on a typical workstation. For instance, a 1024 x 1024 image can be deblurred in 0.15 seconds, which corresponds to real-time.
△ Less
Submitted 28 December, 2015;
originally announced December 2015.
-
Sparse Wavelet Representations of Spatially Varying Blurring Operators
Authors:
Paul Escande,
Pierre Weiss
Abstract:
Restoring images degraded by spatially varying blur is a problem encountered in many disciplines such as astrophysics, computer vision or biomedical imaging. One of the main challenges to perform this task is to design efficient numerical algorithms to approximate integral operators.We introduce a new method based on a sparse approximation of the blurring operator in the wavelet domain. This metho…
▽ More
Restoring images degraded by spatially varying blur is a problem encountered in many disciplines such as astrophysics, computer vision or biomedical imaging. One of the main challenges to perform this task is to design efficient numerical algorithms to approximate integral operators.We introduce a new method based on a sparse approximation of the blurring operator in the wavelet domain. This method requires $\mathcal{O}\left(N ε^{-d/M}\right)$ operations to provide $ε$-approximations, where $N$ is the number of pixels of a $d$-dimensional image and $M\geq 1$ is a scalar describing the regularity of the blur kernel. In addition, we propose original methods to define sparsity patterns when only the operators regularity is known.Numerical experiments reveal that our algorithm provides a significant improvement compared to standard methods based on windowed convolutions.
△ Less
Submitted 11 October, 2015; v1 submitted 3 April, 2014;
originally announced April 2014.
-
Image restoration using sparse approximations of spatially varying blur operators in the wavelet domain
Authors:
Paul Escande,
Pierre Weiss,
Francois Malgouyres
Abstract:
Restoration of images degraded by spatially varying blurs is an issue of increasing importance in the context of photography, satellite or microscopy imaging. One of the main difficulty to solve this problem comes from the huge dimensions of the blur matrix. It prevents the use of naive approaches for performing matrix-vector multiplications. In this paper, we propose to approximate the blur opera…
▽ More
Restoration of images degraded by spatially varying blurs is an issue of increasing importance in the context of photography, satellite or microscopy imaging. One of the main difficulty to solve this problem comes from the huge dimensions of the blur matrix. It prevents the use of naive approaches for performing matrix-vector multiplications. In this paper, we propose to approximate the blur operator by a matrix sparse in the wavelet domain. We justify this approach from a mathematical point of view and investigate the approximation quality numerically. We finish by showing that the sparsity pattern of the matrix can be pre-defined, which is central in tasks such as blind deconvolution.
△ Less
Submitted 30 May, 2013; v1 submitted 25 February, 2013;
originally announced February 2013.
