-
DeepInverse: A Python package for solving imaging inverse problems with deep learning
Authors:
Julián Tachella,
Matthieu Terris,
Samuel Hurault,
Andrew Wang,
Dongdong Chen,
Minh-Hai Nguyen,
Maxime Song,
Thomas Davies,
Leo Davy,
Jonathan Dong,
Paul Escande,
Johannes Hertrich,
Zhiyuan Hu,
Tobías I. Liaudat,
Nils Laurent,
Brett Levac,
Mathurin Massias,
Thomas Moreau,
Thibaut Modrzyk,
Brayan Monroy,
Sebastian Neumayer,
Jérémy Scanvic,
Florian Sarron,
Victor Sechaud,
Georg Schramm
, et al. (2 additional authors not shown)
Abstract:
DeepInverse is an open-source PyTorch-based library for solving imaging inverse problems. The library covers all crucial steps in image reconstruction from the efficient implementation of forward operators (e.g., optics, MRI, tomography), to the definition and resolution of variational problems and the design and training of advanced neural network architectures. In this paper, we describe the mai…
▽ More
DeepInverse is an open-source PyTorch-based library for solving imaging inverse problems. The library covers all crucial steps in image reconstruction from the efficient implementation of forward operators (e.g., optics, MRI, tomography), to the definition and resolution of variational problems and the design and training of advanced neural network architectures. In this paper, we describe the main functionality of the library and discuss the main design choices.
△ Less
Submitted 17 June, 2025; v1 submitted 26 May, 2025;
originally announced May 2025.
-
Translation-Equivariance of Normalization Layers and Aliasing in Convolutional Neural Networks
Authors:
Jérémy Scanvic,
Quentin Barthélemy,
Julián Tachella
Abstract:
The design of convolutional neural architectures that are exactly equivariant to continuous translations is an active field of research. It promises to benefit scientific computing, notably by making existing imaging systems more physically accurate. Most efforts focus on the design of downsampling/pooling layers, upsampling layers and activation functions, but little attention is dedicated to nor…
▽ More
The design of convolutional neural architectures that are exactly equivariant to continuous translations is an active field of research. It promises to benefit scientific computing, notably by making existing imaging systems more physically accurate. Most efforts focus on the design of downsampling/pooling layers, upsampling layers and activation functions, but little attention is dedicated to normalization layers. In this work, we present a novel theoretical framework for understanding the equivariance of normalization layers to discrete shifts and continuous translations. We also determine necessary and sufficient conditions for normalization layers to be equivariant in terms of the dimensions they operate on. Using real feature maps from ResNet-18 and ImageNet, we test those theoretical results empirically and find that they are consistent with our predictions.
△ Less
Submitted 18 June, 2025; v1 submitted 26 May, 2025;
originally announced May 2025.
-
Scale-Equivariant Imaging: Self-Supervised Learning for Image Super-Resolution and Deblurring
Authors:
Jérémy Scanvic,
Mike Davies,
Patrice Abry,
Julián Tachella
Abstract:
Self-supervised methods have recently proved to be nearly as effective as supervised ones in various imaging inverse problems, paving the way for learning-based approaches in scientific and medical imaging applications where ground truth data is hard or expensive to obtain. These methods critically rely on invariance to translations and/or rotations of the image distribution to learn from incomple…
▽ More
Self-supervised methods have recently proved to be nearly as effective as supervised ones in various imaging inverse problems, paving the way for learning-based approaches in scientific and medical imaging applications where ground truth data is hard or expensive to obtain. These methods critically rely on invariance to translations and/or rotations of the image distribution to learn from incomplete measurement data alone. However, existing approaches fail to obtain competitive performances in the problems of image super-resolution and deblurring, which play a key role in most imaging systems. In this work, we show that invariance to roto-translations is insufficient to learn from measurements that only contain low-frequency information. Instead, we propose scale-equivariant imaging, a new self-supervised approach that leverages the fact that many image distributions are approximately scale-invariant, enabling the recovery of high-frequency information lost in the measurement process. We demonstrate throughout a series of experiments on real datasets that the proposed method outperforms other self-supervised approaches, and obtains performances on par with fully supervised learning.
△ Less
Submitted 26 March, 2025; v1 submitted 18 December, 2023;
originally announced December 2023.
-
Prefix palindromic length of the Sierpinski word
Authors:
Dora V. Bulgakova,
Anna E. Frid,
Jérémy Scanvic
Abstract:
The prefix palindromic length $p_{\mathbf{u}}(n)$ of an infinite word $\mathbf{u}$ is the minimal number of concatenated palindromes needed to express the prefix of length $n$ of $\mathbf{u}$. This function is surprisingly difficult to study; in particular, the conjecture that $p_{\mathbf{u}}(n)$ can be bounded only if $\mathbf{u}$ is ultimately periodic is open since 2013. A more recent conjectur…
▽ More
The prefix palindromic length $p_{\mathbf{u}}(n)$ of an infinite word $\mathbf{u}$ is the minimal number of concatenated palindromes needed to express the prefix of length $n$ of $\mathbf{u}$. This function is surprisingly difficult to study; in particular, the conjecture that $p_{\mathbf{u}}(n)$ can be bounded only if $\mathbf{u}$ is ultimately periodic is open since 2013. A more recent conjecture concerns the prefix palindromic length of the period doubling word: it seems that it is not $2$-regular, and if it is true, this would give a rare if not unique example of a non-regular function of a $2$-automatic word.
For some other $k$-automatic words, however, the prefix palindromic length is known to be $k$-regular. Here we add to the list of those words the Sierpinski word $\mathbf{s}$ and give a complete description of $p_{\mathbf{s}}(n)$.
△ Less
Submitted 14 March, 2022; v1 submitted 24 January, 2022;
originally announced January 2022.
