Showing 1–2 of 2 results for author: Monod, A

Video Restoration with a Deep Plug-and-Play Prior

Authors: Antoine Monod, Julie Delon, Matias Tassano, Andrés Almansa

Abstract: This paper presents a novel method for restoring digital videos via a Deep Plug-and-Play (PnP) approach. Under a Bayesian formalism, the method consists in using a deep convolutional denoising network in place of the proximal operator of the prior in an alternating optimization scheme. We distinguish ourselves from prior PnP work by directly applying that method to restore a digital video from a d… ▽ More This paper presents a novel method for restoring digital videos via a Deep Plug-and-Play (PnP) approach. Under a Bayesian formalism, the method consists in using a deep convolutional denoising network in place of the proximal operator of the prior in an alternating optimization scheme. We distinguish ourselves from prior PnP work by directly applying that method to restore a digital video from a degraded video observation. This way, a network trained once for denoising can be repurposed for other video restoration tasks. Our experiments in video deblurring, super-resolution, and interpolation of random missing pixels all show a clear benefit to using a network specifically designed for video denoising, as it yields better restoration performance and better temporal stability than a single image network with similar denoising performance using the same PnP formulation. Moreover, our method compares favorably to applying a different state-of-the-art PnP scheme separately on each frame of the sequence. This opens new perspectives in the field of video restoration. △ Less

Submitted 15 September, 2022; v1 submitted 6 September, 2022; originally announced September 2022.

Comments: 10 pages + 4 pages supplementary; code at github.com/amonod/pnp-video

ACM Class: I.4

An Analysis and Implementation of the HDR+ Burst Denoising Method

Authors: Antoine Monod, Julie Delon, Thomas Veit

Abstract: HDR+ is an image processing pipeline presented by Google in 2016. At its core lies a denoising algorithm that uses a burst of raw images to produce a single higher quality image. Since it is designed as a versatile solution for smartphone cameras, it does not necessarily aim for the maximization of standard denoising metrics, but rather for the production of natural, visually pleasing images. In t… ▽ More HDR+ is an image processing pipeline presented by Google in 2016. At its core lies a denoising algorithm that uses a burst of raw images to produce a single higher quality image. Since it is designed as a versatile solution for smartphone cameras, it does not necessarily aim for the maximization of standard denoising metrics, but rather for the production of natural, visually pleasing images. In this article, we specifically discuss and analyze the HDR+ burst denoising algorithm architecture and the impact of its various parameters. With this publication, we provide an open source Python implementation of the algorithm, along with an interactive demo. △ Less

Submitted 18 October, 2021; originally announced October 2021.

Comments: 28 pages, 15 figures, published at https://doi.org/10.5201/ipol.2021.336, code on https://github.com/amonod/hdrplus-python

ACM Class: I.4; F.2.1

Journal ref: Image Processing On Line, 11 (2021), pp. 142-169