Showing 1–37 of 37 results for author: Gilles, J

Fast probabilistic snake algorithm

Authors: Jérôme Gilles, Bertrand Collin

Abstract: Few people use the probability theory in order to achieve image segmentation with snake models. In this article, we are presenting an active contour algorithm based on a probability approach inspired by A. Blake work and P. R{é}fr{é}gier's team research in France. Our algorithm, both very fast and highly accurate as far as contour description is concerned, is easily adaptable to any specific appli… ▽ More Few people use the probability theory in order to achieve image segmentation with snake models. In this article, we are presenting an active contour algorithm based on a probability approach inspired by A. Blake work and P. R{é}fr{é}gier's team research in France. Our algorithm, both very fast and highly accurate as far as contour description is concerned, is easily adaptable to any specific application. △ Less

Submitted 13 November, 2024; originally announced November 2024.

Journal ref: International Conference on Image Processing (ICIP), Vol.2, 405-408, Barcelona, Spain, Sept 2003

Choix d'un espace de représentation image adapté à la détection de réseaux routiers

Authors: Jerome Gilles

Abstract: These last years, algorithms allowing to decompose an image into its structures and textures components have emerged. In this paper, we present an application of this type of decomposition to the problem road network detection in aerial or satelite imagery. The algorithmic procedure involves the image decomposition (using a unique property), an alignment detection step based on the Gestalt theory,… ▽ More These last years, algorithms allowing to decompose an image into its structures and textures components have emerged. In this paper, we present an application of this type of decomposition to the problem road network detection in aerial or satelite imagery. The algorithmic procedure involves the image decomposition (using a unique property), an alignment detection step based on the Gestalt theory, and a refinement step using statistical active contours. △ Less

Submitted 12 November, 2024; originally announced November 2024.

Comments: in French language

Journal ref: Traitement et Analyse de l'Information: Méthode et Application (TAIMA), Hammamet, Tunisie, May 2007

Noisy image decomposition: a new structure, texture and noise model based on local adaptivity

Authors: Jerome Gilles

Abstract: These last few years, image decomposition algorithms have been proposed to split an image into two parts: the structures and the textures. These algorithms are not adapted to the case of noisy images because the textures are corrupted by noise. In this paper, we propose a new model which decomposes an image into three parts (structures, textures and noise) based on a local regularization scheme. W… ▽ More These last few years, image decomposition algorithms have been proposed to split an image into two parts: the structures and the textures. These algorithms are not adapted to the case of noisy images because the textures are corrupted by noise. In this paper, we propose a new model which decomposes an image into three parts (structures, textures and noise) based on a local regularization scheme. We compare our results with the recent work of Aujol and Chambolle. We finish by giving another model which combines the advantages of the two previous ones. △ Less

Submitted 12 November, 2024; originally announced November 2024.

Comments: arXiv admin note: text overlap with arXiv:2411.05265

Journal ref: Journal of Mathematical Imaging and Vision (JMIV), Vol.28, No.3, 285-295, 2007

Restoration algorithms and system performance evaluation for active imagers

Authors: Jerome Gilles

Abstract: This paper deals with two fields related to active imaging system. First, we begin to explore image processing algorithms to restore the artefacts like speckle, scintillation and image dancing caused by atmospheric turbulence. Next, we examine how to evaluate the performance of this kind of systems. To do this task, we propose a modified version of the german TRM3 metric which permits to get MTF-l… ▽ More This paper deals with two fields related to active imaging system. First, we begin to explore image processing algorithms to restore the artefacts like speckle, scintillation and image dancing caused by atmospheric turbulence. Next, we examine how to evaluate the performance of this kind of systems. To do this task, we propose a modified version of the german TRM3 metric which permits to get MTF-like measures. We use the database acquired during NATO-TG40 field trials to make our tests. △ Less

Submitted 12 November, 2024; originally announced November 2024.

Journal ref: SPIE Europe Remote Sensing Conference, Florence, Italie, September 2007

Atmospheric turbulence restoration by diffeomorphic image registration and blind deconvolution

Authors: Jerome Gilles, Tristan Dagobert, Carlo De Franchis

Abstract: A novel approach is presented in this paper to improve images which are altered by atmospheric turbulence. Two new algorithms are presented based on two combinations of a blind deconvolution block, an elastic registration block and a temporal filter block. The algorithms are tested on real images acquired in the desert in New Mexico by the NATO RTG40 group. A novel approach is presented in this paper to improve images which are altered by atmospheric turbulence. Two new algorithms are presented based on two combinations of a blind deconvolution block, an elastic registration block and a temporal filter block. The algorithms are tested on real images acquired in the desert in New Mexico by the NATO RTG40 group. △ Less

Submitted 12 November, 2024; originally announced November 2024.

Journal ref: Advanced Concepts for Intelligent Vision Systems (ACIVS), Juan Les Pins, France, October 2008

IR image databases generation under target intrinsic thermal variability constraints

Authors: Jerome Gilles, Stephane Landeau, Tristan Dagobert, Philippe Chevalier, Christian Bolut

Abstract: This paper deals with the problem of infrared image database generation for ATR assessment purposes. Huge databases are required to have quantitative and objective performance evaluations. We propose a method which superimpose targets and occultants on background under image quality metrics constraints to generate realistic images. We also propose a method to generate target signatures with intrin… ▽ More This paper deals with the problem of infrared image database generation for ATR assessment purposes. Huge databases are required to have quantitative and objective performance evaluations. We propose a method which superimpose targets and occultants on background under image quality metrics constraints to generate realistic images. We also propose a method to generate target signatures with intrinsic thermal variability based on 3D models plated with real infrared textures. △ Less

Submitted 12 November, 2024; originally announced November 2024.

Comments: arXiv admin note: substantial text overlap with arXiv:2411.06695

Journal ref: International IR Target and Background Modeling & Simulation Workshop (ITBMS), Toulouse, France, June 2009

Génération de bases de données images IR sous contraintes avec variabilité thermique intrinsèque des cibles

Authors: Jerome Gilles, Stephane Landeau, Tristan Dagobert, Philippe Chevalier, Christian Bolut

Abstract: In this communication, we propose a method which permits to simulate images of targets in infrared imagery by superimposition of vehicle signatures in background, eventually with occultants. We develop a principle which authorizes us to generate different thermal configurations of target signatures. This method enables us to easily generate huge datasets for ATR algorithms performance evaluation. In this communication, we propose a method which permits to simulate images of targets in infrared imagery by superimposition of vehicle signatures in background, eventually with occultants. We develop a principle which authorizes us to generate different thermal configurations of target signatures. This method enables us to easily generate huge datasets for ATR algorithms performance evaluation. △ Less

Submitted 12 November, 2024; originally announced November 2024.

Comments: in French language, GRETSI Symposium on Signal and Image Processing, Dijon, France, September 2009

Séparation en composantes structures, textures et bruit d'une image, apport de l'utilisation des contourlettes

Authors: Jerome Gilles

Abstract: In this paper, we propose to improve image decomposition algorithms in the case of noisy images. In \cite{gilles1,aujoluvw}, the authors propose to separate structures, textures and noise from an image. Unfortunately, the use of separable wavelets shows some artefacts. In this paper, we propose to replace the wavelet transform by the contourlet transform which better approximate geometry in images… ▽ More In this paper, we propose to improve image decomposition algorithms in the case of noisy images. In \cite{gilles1,aujoluvw}, the authors propose to separate structures, textures and noise from an image. Unfortunately, the use of separable wavelets shows some artefacts. In this paper, we propose to replace the wavelet transform by the contourlet transform which better approximate geometry in images. For that, we define contourlet spaces and their associated norms. Then, we get an iterative algorithm which we test on two noisy textured images. △ Less

Submitted 10 November, 2024; originally announced November 2024.

Comments: in French language, GRETSI Symposium on Signal and Image Processing, Dijon, France, September 2009

METRIC: a complete methodology for performances evaluation of automatic target Detection, Recognition and Tracking algorithms in infrared imagery

Authors: Jérôme Gilles, Stéphane Landeau, Tristan Dagobert, Philippe Chevalier, Eric Stiée, Damien Diaz, Jean-Luc Maillart

Abstract: In this communication, we deal with the question of automatic target detection, recognition and tracking (ATD/R/T) algorithms performance assessment. We propose a complete methodology of evaluation which approaches objective image datasets development and adapted metrics definition for the different tasks (detection, recognition and tracking). We present some performance results which are currentl… ▽ More In this communication, we deal with the question of automatic target detection, recognition and tracking (ATD/R/T) algorithms performance assessment. We propose a complete methodology of evaluation which approaches objective image datasets development and adapted metrics definition for the different tasks (detection, recognition and tracking). We present some performance results which are currently processed in a French-MoD program called 2ACI (``Acquisition Automatique de Cibles par Imagerie``). △ Less

Submitted 10 November, 2024; originally announced November 2024.

Journal ref: OPTRO 2010, Paris, France

Image Decomposition: Theory, Numerical Schemes, and Performance Evaluation

Authors: Jerome Gilles

Abstract: This paper describes the many image decomposition models that allow to separate structures and textures or structures, textures, and noise. These models combined a total variation approach with different adapted functional spaces such as Besov or Contourlet spaces or a special oscillating function space based on the work of Yves Meyer. We propose a method to evaluate the performance of such algori… ▽ More This paper describes the many image decomposition models that allow to separate structures and textures or structures, textures, and noise. These models combined a total variation approach with different adapted functional spaces such as Besov or Contourlet spaces or a special oscillating function space based on the work of Yves Meyer. We propose a method to evaluate the performance of such algorithms to enhance understanding of the behavior of these models. △ Less

Submitted 7 November, 2024; originally announced November 2024.

Journal ref: Advances in Imaging and Electron Physics, Chapter 3, Vol.158, 2009

Efficient single image non-uniformity correction algorithm

Authors: Yohann Tendero, Jerome Gilles, Stephane Landeau, Jean-Michel Morel

Abstract: This paper introduces a new way to correct the non-uniformity (NU) in uncooled infrared-type images. The main defect of these uncooled images is the lack of a column (resp. line) time-dependent cross-calibration, resulting in a strong column (resp. line) and time dependent noise. This problem can be considered as a 1D flicker of the columns inside each frame. Thus, classic movie deflickering algor… ▽ More This paper introduces a new way to correct the non-uniformity (NU) in uncooled infrared-type images. The main defect of these uncooled images is the lack of a column (resp. line) time-dependent cross-calibration, resulting in a strong column (resp. line) and time dependent noise. This problem can be considered as a 1D flicker of the columns inside each frame. Thus, classic movie deflickering algorithms can be adapted, to equalize the columns (resp. the lines). The proposed method therefore applies to the series formed by the columns of an infrared image a movie deflickering algorithm. The obtained single image method works on static images, and therefore requires no registration, no camera motion compensation, and no closed aperture sensor equalization. Thus, the method has only one camera dependent parameter, and is landscape independent. This simple method will be compared to a state of the art total variation single image correction on raw real and simulated images. The method is real time, requiring only two operations per pixel. It involves no test-pattern calibration and produces no "ghost artifacts". △ Less

Submitted 7 November, 2024; originally announced November 2024.

Comments: arXiv admin note: substantial text overlap with arXiv:2411.03615

Journal ref: SPIE Security and Defence International Symposium, Toulouse, France, 2010

Properties of BV-G structures + textures decomposition models. Application to road detection in satellite images

Authors: Jerome Gilles, Yves Meyer

Abstract: In this paper we present some theoretical results about a structures-textures image decomposition model which was proposed by the second author. We prove a theorem which gives the behavior of this model in different cases. Finally, as a consequence of the theorem we derive an algorithm for the detection of long and thin objects applied to a road networks detection application in aerial or satellit… ▽ More In this paper we present some theoretical results about a structures-textures image decomposition model which was proposed by the second author. We prove a theorem which gives the behavior of this model in different cases. Finally, as a consequence of the theorem we derive an algorithm for the detection of long and thin objects applied to a road networks detection application in aerial or satellite images. △ Less

Submitted 7 November, 2024; originally announced November 2024.

Journal ref: IEEE Transactions on Image Processing, Vol.19, No.11, 2793-2800, Nov. 2010

ADMIRE: a locally adaptive single-image, non-uniformity correction and denoising algorithm: application to uncooled IR camera

Authors: Yohann Tendero, Jerome Gilles

Abstract: We propose a new way to correct for the non-uniformity (NU) and the noise in uncooled infrared-type images. This method works on static images, needs no registration, no camera motion and no model for the non uniformity. The proposed method uses an hybrid scheme including an automatic locally-adaptive contrast adjustment and a state-of-the-art image denoising method. It permits to correct for a fu… ▽ More We propose a new way to correct for the non-uniformity (NU) and the noise in uncooled infrared-type images. This method works on static images, needs no registration, no camera motion and no model for the non uniformity. The proposed method uses an hybrid scheme including an automatic locally-adaptive contrast adjustment and a state-of-the-art image denoising method. It permits to correct for a fully non-linear NU and the noise efficiently using only one image. We compared it with total variation on real raw and simulated NU infrared images. The strength of this approach lies in its simplicity, low computational cost. It needs no test-pattern or calibration and produces no "ghost-artefact". △ Less

Submitted 5 November, 2024; originally announced November 2024.

Journal ref: SPIE Defense, Security and Sensing conference,Proceedings Volume 8353, Infrared Technology and Applications XXXVIII; 83531O, April 2012

Robot Swarming over the internet

Authors: Will Ferenc, Hannah Kastein, Lauren Lieu, Ryan Wilson, Yuan Rick Huang, Jerome Gilles, Andrea L. Bertozzi, Balaji R. Sharma, Baisravan HomChaudhuri, Subramanian Ramakrishnan, Manish Kumar

Abstract: This paper considers cooperative control of robots involving two different testbed systems in remote locations with communication on the internet. This provides us the capability to exchange robots status like positions, velocities and directions needed for the swarming algorithm. The results show that all robots properly follow some leader defined one of the testbeds. Measurement of data exchange… ▽ More This paper considers cooperative control of robots involving two different testbed systems in remote locations with communication on the internet. This provides us the capability to exchange robots status like positions, velocities and directions needed for the swarming algorithm. The results show that all robots properly follow some leader defined one of the testbeds. Measurement of data exchange rates show no loss of packets, and average transfer delays stay within tolerance limits for practical applications. In our knowledge, the novelty of this paper concerns this kind of control over a large network like internet. △ Less

Submitted 5 November, 2024; originally announced November 2024.

Journal ref: 012 American Control Conference, Montreal, Canada, June 2012

Fried deconvolution

Authors: Jerome Gilles, Stanley Osher

Abstract: In this paper we present a new approach to deblur the effect of atmospheric turbulence in the case of long range imaging. Our method is based on an analytical formulation, the Fried kernel, of the atmosphere modulation transfer function (MTF) and a framelet based deconvolution algorithm. An important parameter is the refractive index structure which requires specific measurements to be known. Then… ▽ More In this paper we present a new approach to deblur the effect of atmospheric turbulence in the case of long range imaging. Our method is based on an analytical formulation, the Fried kernel, of the atmosphere modulation transfer function (MTF) and a framelet based deconvolution algorithm. An important parameter is the refractive index structure which requires specific measurements to be known. Then we propose a method which provides a good estimation of this parameter from the input blurred image. The final algorithms are very easy to implement and show very good results on both simulated blur and real images. △ Less

Submitted 5 November, 2024; originally announced November 2024.

Journal ref: SPIE Defense, Security and Sensing conference, Baltimore, USA, Proceedings Volume 8355, Infrared Imaging Systems: Design, Analysis, Modeling, and Testing XXIII; 83550G, April 2012

Turbulence stabilization

Authors: Yu Mao, Jerome Gilles

Abstract: We recently developed a new approach to get a stabilized image from a sequence of frames acquired through atmospheric turbulence. The goal of this algorihtm is to remove the geometric distortions due by the atmosphere movements. This method is based on a variational formulation and is efficiently solved by the use of Bregman iterations and the operator splitting method. In this paper we propose to… ▽ More We recently developed a new approach to get a stabilized image from a sequence of frames acquired through atmospheric turbulence. The goal of this algorihtm is to remove the geometric distortions due by the atmosphere movements. This method is based on a variational formulation and is efficiently solved by the use of Bregman iterations and the operator splitting method. In this paper we propose to study the influence of the choice of the regularizing term in the model. Then we proposed to experiment some of the most used regularization constraints available in the litterature. △ Less

Submitted 5 November, 2024; originally announced November 2024.

Journal ref: SPIE Defense, Security and Sensing conference, Baltimore, Proceedings Volume 8355, Infrared Imaging Systems: Design, Analysis, Modeling, and Testing XXIII; 83550H, April 2012

Non rigid geometric distortions correction -- Application to atmospheric turbulence stabilization

Authors: Yu Mao, Jerome Gilles

Abstract: A novel approach is presented to recover an image degraded by atmospheric turbulence. Given a sequence of frames affected by turbulence, we construct a variational model to characterize the static image. The optimization problem is solved by Bregman Iteration and the operator splitting method. Our algorithm is simple, efficient, and can be easily generalized for different scenarios. A novel approach is presented to recover an image degraded by atmospheric turbulence. Given a sequence of frames affected by turbulence, we construct a variational model to characterize the static image. The optimization problem is solved by Bregman Iteration and the operator splitting method. Our algorithm is simple, efficient, and can be easily generalized for different scenarios. △ Less

Submitted 3 November, 2024; originally announced November 2024.

Journal ref: Inverse Problems and Imaging Journal, Vol.6, No.3, 531-546, Aug. 2012

Multiscale texture separation

Authors: Jerome Gilles

Abstract: In this paper, we investigate theoretically the behavior of Meyer's image cartoon + texture decomposition model. Our main results is a new theorem which shows that, by combining the decomposition model and a well chosen Littlewood-Paley filter, it is possible to extract almost perfectly a certain class of textures. This theorem leads us to the construction of a parameterless multiscale texture sep… ▽ More In this paper, we investigate theoretically the behavior of Meyer's image cartoon + texture decomposition model. Our main results is a new theorem which shows that, by combining the decomposition model and a well chosen Littlewood-Paley filter, it is possible to extract almost perfectly a certain class of textures. This theorem leads us to the construction of a parameterless multiscale texture separation algorithm. Finally, we propose to extend this algorithm into a directional multiscale texture separation algorithm by designing a directional Littlewood-Paley filter bank. Several experiments show the efficiency of the proposed method both on synthetic and real images. △ Less

Submitted 31 October, 2024; originally announced November 2024.

Journal ref: A SIAM Interdisciplinary Journal, Vol.10, No.4, 1409--1427, Dec. 2012

Detection and tracking of gas plumes in LWIR hyperspectral video sequence data

Authors: Torin Gerhart, Justin Sunu, Ekaterina Merkurjev, Jen-Mei Chang, Jerome Gilles, Andrea L. Bertozzi

Abstract: Automated detection of chemical plumes presents a segmentation challenge. The segmentation problem for gas plumes is difficult due to the diffusive nature of the cloud. The advantage of considering hyperspectral images in the gas plume detection problem over the conventional RGB imagery is the presence of non-visual data, allowing for a richer representation of information. In this paper we presen… ▽ More Automated detection of chemical plumes presents a segmentation challenge. The segmentation problem for gas plumes is difficult due to the diffusive nature of the cloud. The advantage of considering hyperspectral images in the gas plume detection problem over the conventional RGB imagery is the presence of non-visual data, allowing for a richer representation of information. In this paper we present an effective method of visualizing hyperspectral video sequences containing chemical plumes and investigate the effectiveness of segmentation techniques on these post-processed videos. Our approach uses a combination of dimension reduction and histogram equalization to prepare the hyperspectral videos for segmentation. First, Principal Components Analysis (PCA) is used to reduce the dimension of the entire video sequence. This is done by projecting each pixel onto the first few Principal Components resulting in a type of spectral filter. Next, a Midway method for histogram equalization is used. These methods redistribute the intensity values in order to reduce flicker between frames. This properly prepares these high-dimensional video sequences for more traditional segmentation techniques. We compare the ability of various clustering techniques to properly segment the chemical plume. These include K-means, spectral clustering, and the Ginzburg-Landau functional. △ Less

Submitted 31 October, 2024; originally announced November 2024.

Journal ref: SPIE Defense, Security, and Sensing, 2013, Baltimore, Proceedings Volume 8743, Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XIX; 87430J (2013)

2D Empirical Transforms. Wavelets, Ridgelets and Curvelets revisited

Authors: Jerome Gilles, Giang Tran, Stanley Osher

Abstract: A recently developed new approach, called ``Empirical Wavelet Transform'', aims to build 1D adaptive wavelet frames accordingly to the analyzed signal. In this paper, we present several extensions of this approach to 2D signals (images). We revisit some well-known transforms (tensor wavelets, Littlewood-Paley wavelets, ridgelets and curvelets) and show that it is possible to build their empirical… ▽ More A recently developed new approach, called ``Empirical Wavelet Transform'', aims to build 1D adaptive wavelet frames accordingly to the analyzed signal. In this paper, we present several extensions of this approach to 2D signals (images). We revisit some well-known transforms (tensor wavelets, Littlewood-Paley wavelets, ridgelets and curvelets) and show that it is possible to build their empirical counterpart. We prove that such constructions lead to different adaptive frames which show some promising properties for image analysis and processing. △ Less

Submitted 30 October, 2024; originally announced October 2024.

Journal ref: SIAM Journal on Imaging Sciences, Vol.7, No.1, 157--186, January 2014

Wavelet Burst Accumulation for turbulence mitigation

Authors: Jerome Gilles, Stanley Osher

Abstract: In this paper, we investigate the extension of the recently proposed weighted Fourier burst accumulation (FBA) method into the wavelet domain. The purpose of FBA is to reconstruct a clean and sharp image from a sequence of blurred frames. This concept lies in the construction of weights to amplify dominant frequencies in the Fourier spectrum of each frame. The reconstructed image is then obtained… ▽ More In this paper, we investigate the extension of the recently proposed weighted Fourier burst accumulation (FBA) method into the wavelet domain. The purpose of FBA is to reconstruct a clean and sharp image from a sequence of blurred frames. This concept lies in the construction of weights to amplify dominant frequencies in the Fourier spectrum of each frame. The reconstructed image is then obtained by taking the inverse Fourier transform of the average of all processed spectra. In this paper, we first suggest to replace the rigid registration step used in the original algorithm by a non-rigid registration in order to be able to process sequences acquired through atmospheric turbulence. Second, we propose to work in a wavelet domain instead of the Fourier one. This leads us to the construction of two types of algorithms. Finally, we propose an alternative approach to replace the weighting idea by an approach promoting the sparsity in the used space. Several experiments are provided to illustrate the efficiency of the proposed methods. △ Less

Submitted 30 October, 2024; originally announced October 2024.

Journal ref: Journal of Electronic Imaging, Vol.25, No.3, 033003-1--033003-9, May 2016

Open Turbulent Image Set (OTIS)

Authors: Nicholas B. Ferrante, Jerome Gilles

Abstract: Long distance imaging is subject to the impact of the turbulent atmosphere. This results into geometric distortions and some blur effect in the observed frames. Despite the existence of several turbulence mitigation algorithms in the literature, no common dataset exists to objectively evaluate their efficiency. In this paper, we describe a new dataset called OTIS (Open Turbulent Images Set) which… ▽ More Long distance imaging is subject to the impact of the turbulent atmosphere. This results into geometric distortions and some blur effect in the observed frames. Despite the existence of several turbulence mitigation algorithms in the literature, no common dataset exists to objectively evaluate their efficiency. In this paper, we describe a new dataset called OTIS (Open Turbulent Images Set) which contains several sequences (either static or dynamic) acquired through the turbulent atmosphere. For almost all sequences, we provide the corresponding groundtruth in order to make the comparison between algorithms easier. We also discuss possible metrics to perform such comparisons. △ Less

Submitted 30 October, 2024; originally announced October 2024.

Journal ref: Pattern Recognition Letters, Vol.86, 38--41, 2017

Bregman implementation of Meyer's $G-$norm for cartoon + textures decomposition

Authors: Jerome Gilles, Stanley Osher

Abstract: In this paper, we design a very simple algorithm based on Split Bregman iterations to numerically solve the cartoon + textures decomposition model of Meyer. This results in a significant gain in speed compared to Chambolle's nonlinear projectors. In this paper, we design a very simple algorithm based on Split Bregman iterations to numerically solve the cartoon + textures decomposition model of Meyer. This results in a significant gain in speed compared to Chambolle's nonlinear projectors. △ Less

Submitted 30 October, 2024; originally announced October 2024.

Investigation of moving objects through atmospheric turbulence from a non-stationary platform

Authors: Nicholas Ferrante, Jerome Gilles, Shibin Parameswaran

Abstract: In this work, we extract the optical flow field corresponding to moving objects from an image sequence of a scene impacted by atmospheric turbulence \emph{and} captured from a moving camera. Our procedure first computes the optical flow field and creates a motion model to compensate for the flow field induced by camera motion. After subtracting the motion model from the optical flow, we proceed wi… ▽ More In this work, we extract the optical flow field corresponding to moving objects from an image sequence of a scene impacted by atmospheric turbulence \emph{and} captured from a moving camera. Our procedure first computes the optical flow field and creates a motion model to compensate for the flow field induced by camera motion. After subtracting the motion model from the optical flow, we proceed with our previous work, Gilles et al~\cite{gilles2018detection}, where a spatial-temporal cartoon+texture inspired decomposition is performed on the motion-compensated flow field in order to separate flows corresponding to atmospheric turbulence and object motion. Finally, the geometric component is processed with the detection and tracking method and is compared against a ground truth. All of the sequences and code used in this work are open source and are available by contacting the authors. △ Less

Submitted 28 October, 2024; originally announced October 2024.

Journal ref: Proceedings of the SPIE 11137, Applications of Digital Image Processing XLII, 111370X, San Diego, August 2019

Empirical curvelet based Fully Convolutional Network for supervised texture image segmentation

Authors: Yuan Huang, Fugen Zhou, Jerome Gilles

Abstract: In this paper, we propose a new approach to perform supervised texture classification/segmentation. The proposed idea is to feed a Fully Convolutional Network with specific texture descriptors. These texture features are extracted from images by using an empirical curvelet transform. We propose a method to build a unique empirical curvelet filter bank adapted to a given dictionary of textures. We… ▽ More In this paper, we propose a new approach to perform supervised texture classification/segmentation. The proposed idea is to feed a Fully Convolutional Network with specific texture descriptors. These texture features are extracted from images by using an empirical curvelet transform. We propose a method to build a unique empirical curvelet filter bank adapted to a given dictionary of textures. We then show that the output of these filters can be used to build efficient texture descriptors utilized to finally feed deep learning networks. Our approach is finally evaluated on several datasets and compare the results to various state-of-the-art algorithms and show that the proposed method dramatically outperform all existing ones. △ Less

Submitted 28 October, 2024; originally announced October 2024.

Journal ref: Neurocomputing, Vol.349, 31--43, July 2019

Detection of moving objects through turbulent media. Decomposition of Oscillatory vs Non-Oscillatory spatio-temporal vector fields

Authors: Jerome Gilles, Francis Alvarez, Nicholas B. Ferrante, Margaret Fortman, Lena Tahir, Alex Tarter, Anneke von Seeger

Abstract: In this paper, we investigate how moving objects can be detected when images are impacted by atmospheric turbulence. We present a geometric spatio-temporal point of view to the problem and show that it is possible to distinguish movement due to the turbulence vs. moving objects. To perform this task, we propose an extension of 2D cartoon+texture decomposition algorithms to 3D vector fields. Our al… ▽ More In this paper, we investigate how moving objects can be detected when images are impacted by atmospheric turbulence. We present a geometric spatio-temporal point of view to the problem and show that it is possible to distinguish movement due to the turbulence vs. moving objects. To perform this task, we propose an extension of 2D cartoon+texture decomposition algorithms to 3D vector fields. Our algorithm is based on curvelet spaces which permit to better characterize the movement flow geometry. We present experiments on real data which illustrate the efficiency of the proposed method. △ Less

Submitted 28 October, 2024; originally announced October 2024.

Journal ref: Image and Vision Computing Journal, Vol.73, 40--55, May 2018

Evaluation of neural network algorithms for atmospheric turbulence mitigation

Authors: Tushar Jain, Madeline Lubien, Jerome Gilles

Abstract: A variety of neural networks architectures are being studied to tackle blur in images and videos caused by a non-steady camera and objects being captured. In this paper, we present an overview of these existing networks and perform experiments to remove the blur caused by atmospheric turbulence. Our experiments aim to examine the reusability of existing networks and identify desirable aspects of t… ▽ More A variety of neural networks architectures are being studied to tackle blur in images and videos caused by a non-steady camera and objects being captured. In this paper, we present an overview of these existing networks and perform experiments to remove the blur caused by atmospheric turbulence. Our experiments aim to examine the reusability of existing networks and identify desirable aspects of the architecture in a system that is geared specifically towards atmospheric turbulence mitigation. We compare five different architectures, including a network trained in an end-to-end fashion, thereby removing the need for a stabilization step. △ Less

Submitted 28 October, 2024; originally announced October 2024.

Journal ref: SPIE - Signal Processing, Sensor/Information Fusion, and Target Recognition XXXI, Vol.12122, 223--236, 2022

Review of wavelet-based unsupervised texture segmentation, advantage of adaptive wavelets

Authors: Yuan Huang, Valentin De Bortoli, Fugen Zhou, Jerome Gilles

Abstract: Wavelet-based segmentation approaches are widely used for texture segmentation purposes because of their ability to characterize different textures. In this paper, we assess the influence of the chosen wavelet and propose to use the recently introduced empirical wavelets. We show that the adaptability of the empirical wavelet permits to reach better results than classic wavelets. In order to focus… ▽ More Wavelet-based segmentation approaches are widely used for texture segmentation purposes because of their ability to characterize different textures. In this paper, we assess the influence of the chosen wavelet and propose to use the recently introduced empirical wavelets. We show that the adaptability of the empirical wavelet permits to reach better results than classic wavelets. In order to focus only on the textural information, we also propose to perform a cartoon + texture decomposition step before applying the segmentation algorithm. The proposed method is tested on six classic benchmarks, based on several popular texture images. △ Less

Submitted 24 October, 2024; originally announced October 2024.

MSC Class: 42C40 ACM Class: G.0

Journal ref: IET Image Processing, Vol.12, No.9, 1626--1638, August 2018

The Empirical Watershed Wavelet

Authors: Basile Hurat, Zariluz Alvarado, Jerome Gilles

Abstract: The empirical wavelet transform is an adaptive multiresolution analysis tool based on the idea of building filters on a data-driven partition of the Fourier domain. However, existing 2D extensions are constrained by the shape of the detected partitioning. In this paper, we provide theoretical results that permits us to build 2D empirical wavelet filters based on an arbitrary partitioning of the fr… ▽ More The empirical wavelet transform is an adaptive multiresolution analysis tool based on the idea of building filters on a data-driven partition of the Fourier domain. However, existing 2D extensions are constrained by the shape of the detected partitioning. In this paper, we provide theoretical results that permits us to build 2D empirical wavelet filters based on an arbitrary partitioning of the frequency domain. We also propose an algorithm to detect such partitioning from an image spectrum by combining a scale-space representation to estimate the position of dominant harmonic modes and a watershed transform to find the boundaries of the different supports making the expected partition. This whole process allows us to define the empirical watershed wavelet transform. We illustrate the effectiveness and the advantages of such adaptive transform, first visually on toy images, and next on both unsupervised texture segmentation and image deconvolution applications. △ Less

Submitted 24 October, 2024; originally announced October 2024.

MSC Class: 42C40 ACM Class: G.0

Journal ref: Journal of Imaging, Special Issue "2020 Selected Papers from Journal of Imaging Editorial Board Members", Vol.6, No.12, 140, 2020

Empirical Voronoi Wavelets

Authors: Jerome Gilles

Abstract: Recently, the construction of 2D empirical wavelets based on partitioning the Fourier domain with the watershed transform has been proposed. If such approach can build partitions of completely arbitrary shapes, for some applications, it is desirable to keep a certain level of regularity in the geometry of the obtained partitions. In this paper, we propose to build such partition using Voronoi diag… ▽ More Recently, the construction of 2D empirical wavelets based on partitioning the Fourier domain with the watershed transform has been proposed. If such approach can build partitions of completely arbitrary shapes, for some applications, it is desirable to keep a certain level of regularity in the geometry of the obtained partitions. In this paper, we propose to build such partition using Voronoi diagrams. This solution allows us to keep a high level of adaptability while guaranteeing a minimum level of geometric regularity in the detected partition. △ Less

Submitted 13 May, 2024; originally announced July 2024.

Comments: 7 pages, 3 figures, 1 algorithm

MSC Class: 42C40; 68U10

Multiclass histogram-based thresholding using kernel density estimation and scale-space representations

Authors: S. Korneev, J. Gilles, I. Battiato

Abstract: We present a new method for multiclass thresholding of a histogram which is based on the nonparametric Kernel Density (KD) estimation, where the unknown parameters of the KD estimate are defined using the Expectation-Maximization (EM) iterations. The method compares the number of extracted minima of the KD estimate with the number of the requested clusters minus one. If these numbers match, the al… ▽ More We present a new method for multiclass thresholding of a histogram which is based on the nonparametric Kernel Density (KD) estimation, where the unknown parameters of the KD estimate are defined using the Expectation-Maximization (EM) iterations. The method compares the number of extracted minima of the KD estimate with the number of the requested clusters minus one. If these numbers match, the algorithm returns positions of the minima as the threshold values, otherwise, the method gradually decreases/increases the kernel bandwidth until the numbers match. We verify the method using synthetic histograms with known threshold values and using the histogram of real X-ray computed tomography images. After thresholding of the real histogram, we estimated the porosity of the sample and compare it with the direct experimental measurements. The comparison shows the meaningfulness of the thresholding. △ Less

Submitted 9 February, 2022; originally announced February 2022.

A Regularization Approach to Blind Deblurring and Denoising of QR Barcodes

Authors: Yves van Gennip, Prashant Athavale, Jérôme Gilles, Rustum Choksi

Abstract: QR bar codes are prototypical images for which part of the image is a priori known (required patterns). Open source bar code readers, such as ZBar, are readily available. We exploit both these facts to provide and assess purely regularization-based methods for blind deblurring of QR bar codes in the presence of noise. QR bar codes are prototypical images for which part of the image is a priori known (required patterns). Open source bar code readers, such as ZBar, are readily available. We exploit both these facts to provide and assess purely regularization-based methods for blind deblurring of QR bar codes in the presence of noise. △ Less

Submitted 24 March, 2017; v1 submitted 23 October, 2014; originally announced October 2014.

Comments: 14 pages, 19 figures (with a total of 57 subfigures), 1 table; v3: previously missing reference [35] added

MSC Class: 68U10; 65K10

A parameterless scale-space approach to find meaningful modes in histograms - Application to image and spectrum segmentation

Authors: Jérôme Gilles, Kathryn Heal

Abstract: In this paper, we present an algorithm to automatically detect meaningful modes in a histogram. The proposed method is based on the behavior of local minima in a scale-space representation. We show that the detection of such meaningful modes is equivalent in a two classes clustering problem on the length of minima scale-space curves. The algorithm is easy to implement, fast, and does not require a… ▽ More In this paper, we present an algorithm to automatically detect meaningful modes in a histogram. The proposed method is based on the behavior of local minima in a scale-space representation. We show that the detection of such meaningful modes is equivalent in a two classes clustering problem on the length of minima scale-space curves. The algorithm is easy to implement, fast, and does not require any parameters. We present several results on histogram and spectrum segmentation, grayscale image segmentation and color image reduction. △ Less

Submitted 12 January, 2014; originally announced January 2014.

Architecture for Integrated Mems Resonators Quality Factor Measurement

Authors: H. Mathias, F. Parrain, J. -P. Gilles, S. Megherbi, M. Zhang, Ph. Coste, A. Dupret

Abstract: In this paper, an architecture designed for electrical measurement of the quality factor of MEMS resonators is proposed. An estimation of the measurement performance is made using PSPICE simulations taking into account the component's non-idealities. An error on the measured Q value of only several percent is achievable, at a small integration cost, for sufficiently high quality factor values (Q… ▽ More In this paper, an architecture designed for electrical measurement of the quality factor of MEMS resonators is proposed. An estimation of the measurement performance is made using PSPICE simulations taking into account the component's non-idealities. An error on the measured Q value of only several percent is achievable, at a small integration cost, for sufficiently high quality factor values (Q > 100). △ Less

Submitted 26 February, 2008; originally announced February 2008.

Comments: Submitted on behalf of EDA Publishing Association (http://irevues.inist.fr/EDA-Publishing)

Journal ref: Dans Symposium on Design, Test, Integration and Packaging of MEMS/MOEMS - DTIP 2007, Stresa, lago Maggiore : Italie (2007)

Noise and thermal stability of vibrating micro-gyrometers preamplifiers

Authors: R. Levy, A. Dupret, H. Mathias, J. -P. Gilles, F. Parrain, B. Eisenbeis, S. Megherbi

Abstract: The preamplifier is a critical component of gyrometer's electronics. Indeed the resolution of the sensor is limited by its signal to noise ratio, and the gyrometer's thermal stability is limited by its gain drift. In this paper, five different kinds of preamplifiers are presented and compared. Finally, the design of an integrated preamplifier is shown in order to increase the gain stability whil… ▽ More The preamplifier is a critical component of gyrometer's electronics. Indeed the resolution of the sensor is limited by its signal to noise ratio, and the gyrometer's thermal stability is limited by its gain drift. In this paper, five different kinds of preamplifiers are presented and compared. Finally, the design of an integrated preamplifier is shown in order to increase the gain stability while reducing its noise and size. △ Less

Submitted 21 February, 2008; originally announced February 2008.

Comments: Submitted on behalf of EDA Publishing Association (http://irevues.inist.fr/EDA-Publishing)

Journal ref: Dans Symposium on Design, Test, Integration and Packaging of MEMS/MOEMS - DTIP 2007, Stresa, lago Maggiore : Italie (2007)

Mems Q-Factor Enhancement Using Parametric Amplification: Theoretical Study and Design of a Parametric Device

Authors: L. Grasser, H. Mathias, F. Parrain, X. Le Roux, J. -P. Gilles

Abstract: Parametric amplification is an interesting way of artificially increasing a MEMS Quality factor and could be helpful in many kinds of applications. This paper presents a theoretical study of this principle, based on Matlab/Simulink simulations, and proposes design guidelines for parametric structures. A new device designed with this approach is presented together with the corresponding FEM simul… ▽ More Parametric amplification is an interesting way of artificially increasing a MEMS Quality factor and could be helpful in many kinds of applications. This paper presents a theoretical study of this principle, based on Matlab/Simulink simulations, and proposes design guidelines for parametric structures. A new device designed with this approach is presented together with the corresponding FEM simulation results. △ Less

Submitted 21 February, 2008; originally announced February 2008.

Comments: Submitted on behalf of EDA Publishing Association (http://irevues.inist.fr/EDA-Publishing)

Journal ref: Dans Symposium on Design, Test, Integration and Packaging of MEMS/MOEMS - DTIP 2007, Stresa, lago Maggiore : Italie (2007)

Characterization of Flexible RF Microcoil Dedicated to Surface Mri

Authors: M. Woytasik, J. -C. Ginefri, J. -S. Raynaud, M. Poirier-Quinot, E. Dufour-Gergam, J. -P. Grandchamp, L. Darrasse, P. Robert, J. -P. Gilles, E. Martincic, O. Girard

Abstract: In Magnetic Resonance Imaging (MRI), to achieve sufficient Signal to Noise Ratio (SNR), the electrical performance of the RF coil is critical. We developed a device (microcoil) based on the original concept of monolithic resonator. This paper presents the used fabrication process based on micromoulding. The dielectric substrates are flexible thin films of polymer, which allow the microcoil to be… ▽ More In Magnetic Resonance Imaging (MRI), to achieve sufficient Signal to Noise Ratio (SNR), the electrical performance of the RF coil is critical. We developed a device (microcoil) based on the original concept of monolithic resonator. This paper presents the used fabrication process based on micromoulding. The dielectric substrates are flexible thin films of polymer, which allow the microcoil to be form fitted to none-plane surface. Electrical characterizations of the RF coils are first performed and results are compared to the attempted values. Proton MRI of a saline phantom using a flexible RF coil of 15 mm in diameter is performed. When the coil is conformed to the phantom surface, a SNR gain up to 2 is achieved as compared to identical but planar RF coil. Finally, the flexible coil is used in vivo to perform MRI with high spatial resolution on a mouse using a small animal dedicated scanner operating at in a 2.35 T. △ Less

Submitted 21 November, 2007; originally announced November 2007.

Comments: Submitted on behalf of TIMA Editions (http://irevues.inist.fr/tima-editions)

Journal ref: Dans Symposium on Design, Test, Integration and Packaging of MEMS/MOEMS - DTIP 2006, Stresa, Lago Maggiore : Italie (2006)