-
An overview of some mathematical techniques and problems linking 3D vision to 3D printing
Authors:
Emiliano Cristiani,
Maurizio Falcone,
Silvia Tozza
Abstract:
Computer Vision and 3D printing have rapidly evolved in the last 10 years but interactions among them have been very limited so far, despite the fact that they share several mathematical techniques. We try to fill the gap presenting an overview of some techniques for Shape-from-Shading problems as well as for 3D printing with an emphasis on the approaches based on nonlinear partial differential eq…
▽ More
Computer Vision and 3D printing have rapidly evolved in the last 10 years but interactions among them have been very limited so far, despite the fact that they share several mathematical techniques. We try to fill the gap presenting an overview of some techniques for Shape-from-Shading problems as well as for 3D printing with an emphasis on the approaches based on nonlinear partial differential equations and optimization. We also sketch possible couplings to complete the process of object manufacturing starting from one or more images of the object and ending with its final 3D print. We will give some practical examples of this procedure.
△ Less
Submitted 19 September, 2023;
originally announced September 2023.
-
A comparative analysis of denoising algorithms for extragalactic imaging surveys
Authors:
V. Roscani,
S. Tozza,
M. Castellano,
E. Merlin,
D. Ottaviani,
M. Falcone,
A. Fontana
Abstract:
We present a comprehensive analysis of the performance of noise-reduction (``denoising'') algorithms to determine whether they provide advantages in source detection on extragalactic survey images. The methods under analysis are Perona-Malik filtering, Bilateral filter, Total Variation denoising, Structure-texture image decomposition, Non-local means, Wavelets, and Block-matching. We tested the al…
▽ More
We present a comprehensive analysis of the performance of noise-reduction (``denoising'') algorithms to determine whether they provide advantages in source detection on extragalactic survey images. The methods under analysis are Perona-Malik filtering, Bilateral filter, Total Variation denoising, Structure-texture image decomposition, Non-local means, Wavelets, and Block-matching. We tested the algorithms on simulated images of extragalactic fields with resolution and depth typical of the Hubble, Spitzer, and Euclid Space Telescopes, and of ground-based instruments. After choosing their best internal parameters configuration, we assess their performance as a function of resolution, background level, and image type, also testing their ability to preserve the objects fluxes and shapes. We analyze in terms of completeness and purity the catalogs extracted after applying denoising algorithms on a simulated Euclid Wide Survey VIS image, on real H160 (HST) and K-band (HAWK-I) observations of the CANDELS GOODS-South field. Denoising algorithms often outperform the standard approach of filtering with the Point Spread Function (PSF) of the image. Applying Structure-Texture image decomposition, Perona-Malik filtering, the Total Variation method by Chambolle, and Bilateral filtering on the Euclid-VIS image, we obtain catalogs that are both more pure and complete by 0.2 magnitudes than those based on the standard approach. The same result is achieved with the Structure-Texture image decomposition algorithm applied on the H160 image. The advantage of denoising techniques with respect to PSF filtering increases at increasing depth. Moreover, these techniques better preserve the shape of the detected objects with respect to PSF smoothing. Denoising algorithms provide significant improvements in the detection of faint objects and enhance the scientific return of current and future extragalactic surveys.
△ Less
Submitted 3 September, 2020;
originally announced September 2020.
-
Multidimensional smoothness indicators for first-order Hamilton-Jacobi equations
Authors:
Maurizio Falcone,
Giulio Paolucci,
Silvia Tozza
Abstract:
The lack of smoothness is a common feature of weak solutions of nonlinear hyperbolic equations and is a crucial issue in their approximation. This has motivated several efforts to define appropriate indicators, based on the values of the approximate solutions, in order to detect the most troublesome regions of the domain. This information helps to adapt the approximation scheme in order to avoid s…
▽ More
The lack of smoothness is a common feature of weak solutions of nonlinear hyperbolic equations and is a crucial issue in their approximation. This has motivated several efforts to define appropriate indicators, based on the values of the approximate solutions, in order to detect the most troublesome regions of the domain. This information helps to adapt the approximation scheme in order to avoid spurious oscillations when using high-order schemes. In this paper we propose a genuinely multidimensional extension of the WENO procedure in order to overcome the limitations of indicators based on dimensional splitting. Our aim is to obtain new regularity indicators for problems in 2D and apply them to a class of ``adaptive filtered'' schemes for first order evolutive Hamilton-Jacobi equations. According to the usual procedure, filtered schemes are obtained by a simple coupling of a high-order scheme and a monotone scheme. The mixture is governed by a filter function $F$ and by a switching parameter $\varepsilon^n=\varepsilon^n({Δt,Δx})>0$ which goes to 0 as $(Δt,Δx)$ is going to 0. The adaptivity is related to the smoothness indicators and allows to tune automatically the switching parameter $\varepsilon^n_j$ in time and space. Several numerical tests on critical situations in 1D and 2D are presented and confirm the effectiveness of the proposed indicators and the efficiency of our scheme.
△ Less
Submitted 25 February, 2020;
originally announced February 2020.
-
On the segmentation of astronomical images via level-set methods
Authors:
Silvia Tozza,
Maurizio Falcone
Abstract:
Astronomical images are of crucial importance for astronomers since they contain a lot of information about celestial bodies that can not be directly accessible. Most of the information available for the analysis of these objects starts with sky explorations via telescopes and satellites. Unfortunately, the quality of astronomical images is usually very low with respect to other real images and th…
▽ More
Astronomical images are of crucial importance for astronomers since they contain a lot of information about celestial bodies that can not be directly accessible. Most of the information available for the analysis of these objects starts with sky explorations via telescopes and satellites. Unfortunately, the quality of astronomical images is usually very low with respect to other real images and this is due to technical and physical features related to their acquisition process. This increases the percentage of noise and makes more difficult to use directly standard segmentation methods on the original image. In this work we will describe how to process astronomical images in two steps: in the first step we improve the image quality by a rescaling of light intensity whereas in the second step we apply level-set methods to identify the objects. Several experiments will show the effectiveness of this procedure and the results obtained via various discretization techniques for level-set equations.
△ Less
Submitted 9 April, 2019;
originally announced April 2019.
-
A High-Order Scheme for Image Segmentation via a modified Level-Set method
Authors:
Maurizio Falcone,
Giulio Paolucci,
Silvia Tozza
Abstract:
In this paper we propose a high-order accurate scheme for image segmentation based on the level-set method. In this approach, the curve evolution is described as the 0-level set of a representation function but we modify the velocity that drives the curve to the boundary of the object in order to obtain a new velocity with additional properties that are extremely useful to develop a more stable hi…
▽ More
In this paper we propose a high-order accurate scheme for image segmentation based on the level-set method. In this approach, the curve evolution is described as the 0-level set of a representation function but we modify the velocity that drives the curve to the boundary of the object in order to obtain a new velocity with additional properties that are extremely useful to develop a more stable high-order approximation with a small additional cost. The approximation scheme proposed here is the first 2D version of an adaptive "filtered" scheme recently introduced and analyzed by the authors in 1D. This approach is interesting since the implementation of the filtered scheme is rather efficient and easy. The scheme combines two building blocks (a monotone scheme and a high-order scheme) via a filter function and smoothness indicators that allow to detect the regularity of the approximate solution adapting the scheme in an automatic way. Some numerical tests on synthetic and real images confirm the accuracy of the proposed method and the advantages given by the new velocity.
△ Less
Submitted 7 January, 2020; v1 submitted 7 December, 2018;
originally announced December 2018.
-
Convergence of Adaptive Filtered Schemes for First Order Evolutionary Hamilton-Jacobi Equations
Authors:
Maurizio Falcone,
Giulio Paolucci,
Silvia Tozza
Abstract:
We consider a class of "filtered" schemes for first order time dependent Hamilton-Jacobi equations and prove a general convergence result for this class of schemes. A typical filtered scheme is obtained mixing a high-order scheme and a monotone scheme according to a filter function $F$ which decides where the scheme has to switch from one scheme to the other. A crucial role for this switch is play…
▽ More
We consider a class of "filtered" schemes for first order time dependent Hamilton-Jacobi equations and prove a general convergence result for this class of schemes. A typical filtered scheme is obtained mixing a high-order scheme and a monotone scheme according to a filter function $F$ which decides where the scheme has to switch from one scheme to the other. A crucial role for this switch is played by a parameter $\varepsilon=\varepsilon({Δt,Δx})>0$ which goes to 0 as the time and space steps $(Δt,Δx)$ are going to 0 and does not depend on the time $t_n$, for each iteration $n$. The tuning of this parameter in the code is rather delicate and has an influence on the global accuracy of the filtered scheme. Here we introduce an adaptive and automatic choice of $\varepsilon=\varepsilon ^n (Δt, Δx)$ at every iteration modifying the classical set up. The adaptivity is controlled by a smoothness indicator which selects the regions where we modify the regularity threshold $\varepsilon^n$. A convergence result and some error estimates for the new adaptive filtered scheme are proved, this analysis relies on the properties of the scheme and of the smoothness indicators. Finally, we present some numerical tests to compare the adaptive filtered scheme with other methods.
△ Less
Submitted 29 January, 2020; v1 submitted 5 December, 2018;
originally announced December 2018.
-
Linear Differential Constraints for Photo-polarimetric Height Estimation
Authors:
Silvia Tozza,
William A. P. Smith,
Dizhong Zhu,
Ravi Ramamoorthi,
Edwin R. Hancock
Abstract:
In this paper we present a differential approach to photo-polarimetric shape estimation. We propose several alternative differential constraints based on polarisation and photometric shading information and show how to express them in a unified partial differential system. Our method uses the image ratios technique to combine shading and polarisation information in order to directly reconstruct su…
▽ More
In this paper we present a differential approach to photo-polarimetric shape estimation. We propose several alternative differential constraints based on polarisation and photometric shading information and show how to express them in a unified partial differential system. Our method uses the image ratios technique to combine shading and polarisation information in order to directly reconstruct surface height, without first computing surface normal vectors. Moreover, we are able to remove the non-linearities so that the problem reduces to solving a linear differential problem. We also introduce a new method for estimating a polarisation image from multichannel data and, finally, we show it is possible to estimate the illumination directions in a two source setup, extending the method into an uncalibrated scenario. From a numerical point of view, we use a least-squares formulation of the discrete version of the problem. To the best of our knowledge, this is the first work to consider a unified differential approach to solve photo-polarimetric shape estimation directly for height. Numerical results on synthetic and real-world data confirm the effectiveness of our proposed method.
△ Less
Submitted 25 August, 2017;
originally announced August 2017.
-
A discrete Hughes' model for pedestrian flow on graphs
Authors:
Fabio Camilli,
Adriano Festa,
Silvia Tozza
Abstract:
In this paper, we introduce a discrete time-finite state model for pedestrian flow on a graph in the spirit of the Hughes dynamic continuum model. The pedestrians, represented by a density function, move on the graph choosing a route to minimize the instantaneous travel cost to the destination. The density is governed by a conservation law while the minimization principle is described by a graph e…
▽ More
In this paper, we introduce a discrete time-finite state model for pedestrian flow on a graph in the spirit of the Hughes dynamic continuum model. The pedestrians, represented by a density function, move on the graph choosing a route to minimize the instantaneous travel cost to the destination. The density is governed by a conservation law while the minimization principle is described by a graph eikonal equation. We show that the model is well posed and we implement some numerical examples to demonstrate the validity of the proposed model.
△ Less
Submitted 18 April, 2016;
originally announced April 2016.
-
A unified approach to the well-posedness of some non-Lambertian models in Shape-from-Shading theory
Authors:
Fabio Camilli,
Silvia Tozza
Abstract:
In this paper we show that the introduction of an attenuation factor in the %image irradiance brightness equations relative to various perspective Shape from Shading models allows to make the corresponding differential problems well-posed. We propose a unified approach based on the theory of viscosity solution and we show that the brightness equations with the attenuation term admit a unique visco…
▽ More
In this paper we show that the introduction of an attenuation factor in the %image irradiance brightness equations relative to various perspective Shape from Shading models allows to make the corresponding differential problems well-posed. We propose a unified approach based on the theory of viscosity solution and we show that the brightness equations with the attenuation term admit a unique viscosity solution. We also discuss in detail the possible boundary conditions that we can use for the Hamilton-Jacobi equations associated to these models.
△ Less
Submitted 4 October, 2016; v1 submitted 21 March, 2016;
originally announced March 2016.
-
Analysis and approximation of some Shape-from-Shading models for non-Lambertian surfaces
Authors:
Silvia Tozza,
Maurizio Falcone
Abstract:
The reconstruction of a 3D object or a scene is a classical inverse problem in Computer Vision. In the case of a single image this is called the Shape-from-Shading (SfS) problem and it is known to be ill-posed even in a simplified version like the vertical light source case. A huge number of works deals with the orthographic SfS problem based on the Lambertian reflectance model, the most common an…
▽ More
The reconstruction of a 3D object or a scene is a classical inverse problem in Computer Vision. In the case of a single image this is called the Shape-from-Shading (SfS) problem and it is known to be ill-posed even in a simplified version like the vertical light source case. A huge number of works deals with the orthographic SfS problem based on the Lambertian reflectance model, the most common and simplest model which leads to an eikonal type equation when the light source is on the vertical axis. In this paper we want to study non-Lambertian models since they are more realistic and suitable whenever one has to deal with different kind of surfaces, rough or specular. We will present a unified mathematical formulation of some popular orthographic non-Lambertian models, considering vertical and oblique light directions as well as different viewer positions. These models lead to more complex stationary nonlinear partial differential equations of Hamilton-Jacobi type which can be regarded as the generalization of the classical eikonal equation corresponding to the Lambertian case. However, all the equations corresponding to the models considered here (Oren-Nayar and Phong) have a similar structure so we can look for weak solutions to this class in the viscosity solution framework. Via this unified approach, we are able to develop a semi-Lagrangian approximation scheme for the Oren-Nayar and the Phong model and to prove a general convergence result. Numerical simulations on synthetic and real images will illustrate the effectiveness of this approach and the main features of the scheme, also comparing the results with previous results in the literature.
△ Less
Submitted 27 January, 2016; v1 submitted 18 February, 2015;
originally announced February 2015.
