Showing 1–12 of 12 results for author: Digne, J

Topological Autoencoders++: Fast and Accurate Cycle-Aware Dimensionality Reduction

Authors: Mattéo Clémot, Julie Digne, Julien Tierny

Abstract: This paper presents a novel topology-aware dimensionality reduction approach aiming at accurately visualizing the cyclic patterns present in high dimensional data. To that end, we build on the Topological Autoencoders (TopoAE) formulation. First, we provide a novel theoretical analysis of its associated loss and show that a zero loss indeed induces identical persistence pairs (in high and low dime… ▽ More This paper presents a novel topology-aware dimensionality reduction approach aiming at accurately visualizing the cyclic patterns present in high dimensional data. To that end, we build on the Topological Autoencoders (TopoAE) formulation. First, we provide a novel theoretical analysis of its associated loss and show that a zero loss indeed induces identical persistence pairs (in high and low dimensions) for the $0$-dimensional persistent homology (PH$^0$) of the Rips filtration. We also provide a counter example showing that this property no longer holds for a naive extension of TopoAE to PH$^d$ for $d\ge 1$. Based on this observation, we introduce a novel generalization of TopoAE to $1$-dimensional persistent homology (PH$^1$), called TopoAE++, for the accurate generation of cycle-aware planar embeddings, addressing the above failure case. This generalization is based on the notion of cascade distortion, a new penalty term favoring an isometric embedding of the $2$-chains filling persistent $1$-cycles, hence resulting in more faithful geometrical reconstructions of the $1$-cycles in the plane. We further introduce a novel, fast algorithm for the exact computation of PH for Rips filtrations in the plane, yielding improved runtimes over previously documented topology-aware methods. Our method also achieves a better balance between the topological accuracy, as measured by the Wasserstein distance, and the visual preservation of the cycles in low dimensions. Our C++ implementation is available at https://github.com/MClemot/TopologicalAutoencodersPlusPlus. △ Less

Submitted 27 February, 2025; originally announced February 2025.

Eagle: Large-Scale Learning of Turbulent Fluid Dynamics with Mesh Transformers

Authors: Steeven Janny, Aurélien Béneteau, Madiha Nadri, Julie Digne, Nicolas Thome, Christian Wolf

Abstract: Estimating fluid dynamics is classically done through the simulation and integration of numerical models solving the Navier-Stokes equations, which is computationally complex and time-consuming even on high-end hardware. This is a notoriously hard problem to solve, which has recently been addressed with machine learning, in particular graph neural networks (GNN) and variants trained and evaluated… ▽ More Estimating fluid dynamics is classically done through the simulation and integration of numerical models solving the Navier-Stokes equations, which is computationally complex and time-consuming even on high-end hardware. This is a notoriously hard problem to solve, which has recently been addressed with machine learning, in particular graph neural networks (GNN) and variants trained and evaluated on datasets of static objects in static scenes with fixed geometry. We attempt to go beyond existing work in complexity and introduce a new model, method and benchmark. We propose EAGLE, a large-scale dataset of 1.1 million 2D meshes resulting from simulations of unsteady fluid dynamics caused by a moving flow source interacting with nonlinear scene structure, comprised of 600 different scenes of three different types. To perform future forecasting of pressure and velocity on the challenging EAGLE dataset, we introduce a new mesh transformer. It leverages node clustering, graph pooling and global attention to learn long-range dependencies between spatially distant data points without needing a large number of iterations, as existing GNN methods do. We show that our transformer outperforms state-of-the-art performance on, both, existing synthetic and real datasets and on EAGLE. Finally, we highlight that our approach learns to attend to airflow, integrating complex information in a single iteration. △ Less

Submitted 17 March, 2023; v1 submitted 16 February, 2023; originally announced February 2023.

Comments: Published as a conference paper at ICLR 2023

Journal ref: International Conference on Learning Representation (ICLR) 2023

Example-Based Sampling with Diffusion Models

Authors: Bastien Doignies, Nicolas Bonneel, David Coeurjolly, Julie Digne, Loïs Paulin, Jean-Claude Iehl, Victor Ostromoukhov

Abstract: Much effort has been put into developing samplers with specific properties, such as producing blue noise, low-discrepancy, lattice or Poisson disk samples. These samplers can be slow if they rely on optimization processes, may rely on a wide range of numerical methods, are not always differentiable. The success of recent diffusion models for image generation suggests that these models could be app… ▽ More Much effort has been put into developing samplers with specific properties, such as producing blue noise, low-discrepancy, lattice or Poisson disk samples. These samplers can be slow if they rely on optimization processes, may rely on a wide range of numerical methods, are not always differentiable. The success of recent diffusion models for image generation suggests that these models could be appropriate for learning how to generate point sets from examples. However, their convolutional nature makes these methods impractical for dealing with scattered data such as point sets. We propose a generic way to produce 2-d point sets imitating existing samplers from observed point sets using a diffusion model. We address the problem of convolutional layers by leveraging neighborhood information from an optimal transport matching to a uniform grid, that allows us to benefit from fast convolutions on grids, and to support the example-based learning of non-uniform sampling patterns. We demonstrate how the differentiability of our approach can be used to optimize point sets to enforce properties. △ Less

Submitted 10 February, 2023; originally announced February 2023.

ACM Class: I.3.7; I.5.1; I.6.8; G.1.4

Lightweight integration of 3D features to improve 2D image segmentation

Authors: Olivier Pradelle, Raphaelle Chaine, David Wendland, Julie Digne

Abstract: Scene understanding has made tremendous progress over the past few years, as data acquisition systems are now providing an increasing amount of data of various modalities (point cloud, depth, RGB...). However, this improvement comes at a large cost on computation resources and data annotation requirements. To analyze geometric information and images jointly, many approaches rely on both a 2D loss… ▽ More Scene understanding has made tremendous progress over the past few years, as data acquisition systems are now providing an increasing amount of data of various modalities (point cloud, depth, RGB...). However, this improvement comes at a large cost on computation resources and data annotation requirements. To analyze geometric information and images jointly, many approaches rely on both a 2D loss and 3D loss, requiring not only 2D per pixel-labels but also 3D per-point labels. However, obtaining a 3D groundtruth is challenging, time-consuming and error-prone. In this paper, we show that image segmentation can benefit from 3D geometric information without requiring a 3D groundtruth, by training the geometric feature extraction and the 2D segmentation network jointly, in an end-to-end fashion, using only the 2D segmentation loss. Our method starts by extracting a map of 3D features directly from a provided point cloud by using a lightweight 3D neural network. The 3D feature map, merged with the RGB image, is then used as an input to a classical image segmentation network. Our method can be applied to many 2D segmentation networks, improving significantly their performance with only a marginal network weight increase and light input dataset requirements, since no 3D groundtruth is required. △ Less

Submitted 10 July, 2023; v1 submitted 16 December, 2022; originally announced December 2022.

Journal ref: Computers & Graphics, Volume 114, 2023, Pages 326-336, ISSN 0097-8493, (https://www.sciencedirect.com/science/article/pii/S0097849323000936)

Symmetrized semi-discrete optimal transport

Authors: Agathe Herrou, Bruno Lévy, Vincent Nivoliers, Nicolas Bonneel, Julie Digne

Abstract: Interpolating between measures supported by polygonal or polyhedral domains is a problem that has been recently addressed by the semi-discrete optimal transport framework. Within this framework, one of the domains is discretized with a set of samples, while the other one remains continuous. In this paper we present a method to introduce some symmetry into the solution using coupled power diagrams.… ▽ More Interpolating between measures supported by polygonal or polyhedral domains is a problem that has been recently addressed by the semi-discrete optimal transport framework. Within this framework, one of the domains is discretized with a set of samples, while the other one remains continuous. In this paper we present a method to introduce some symmetry into the solution using coupled power diagrams. This symmetry is key to capturing the discontinuities of the transport map reflected in the geometry of the power cells. We design our method as a fixed-point algorithm alternating between computations of semi-discrete transport maps and recentering of the sites. The resulting objects are coupled power diagrams with identical geometry, allowing us to approximate displacement interpolation through linear interpolation of the meshes vertices. Through these coupled power diagrams, we have a natural way of jointly sampling measures. △ Less

Submitted 9 June, 2022; originally announced June 2022.

MSC Class: 49M99 (Primary); 65D99; 90C08 (Secondary) ACM Class: G.1.1; I.3.5

Arbitrary order principal directions and how to compute them

Authors: Julie Digne, Sébastien Valette, Raphaëlle Chaine, Yohann Béarzi

Abstract: Curvature principal directions on geometric surfaces are a ubiquitous concept of Geometry Processing techniques. However they only account for order 2 differential quantities, oblivious of higher order differential behaviors. In this paper, we extend the concept of principal directions to higher orders for surfaces in R^3 by considering symmetric differential tensors. We further show how they can… ▽ More Curvature principal directions on geometric surfaces are a ubiquitous concept of Geometry Processing techniques. However they only account for order 2 differential quantities, oblivious of higher order differential behaviors. In this paper, we extend the concept of principal directions to higher orders for surfaces in R^3 by considering symmetric differential tensors. We further show how they can be explicitly approximated on point set surfaces and that they convey valuable geometric information, that can help the analysis of 3D surfaces. △ Less

Submitted 10 November, 2021; originally announced November 2021.

MSC Class: I.3.5

Dynamic Scene Novel View Synthesis via Deferred Spatio-temporal Consistency

Authors: Beatrix-Emőke Fülöp-Balogh, Eleanor Tursman, James Tompkin, Julie Digne, Nicolas Bonneel

Abstract: Structure from motion (SfM) enables us to reconstruct a scene via casual capture from cameras at different viewpoints, and novel view synthesis (NVS) allows us to render a captured scene from a new viewpoint. Both are hard with casual capture and dynamic scenes: SfM produces noisy and spatio-temporally sparse reconstructed point clouds, resulting in NVS with spatio-temporally inconsistent effects.… ▽ More Structure from motion (SfM) enables us to reconstruct a scene via casual capture from cameras at different viewpoints, and novel view synthesis (NVS) allows us to render a captured scene from a new viewpoint. Both are hard with casual capture and dynamic scenes: SfM produces noisy and spatio-temporally sparse reconstructed point clouds, resulting in NVS with spatio-temporally inconsistent effects. We consider SfM and NVS parts together to ease the challenge. First, for SfM, we recover stable camera poses, then we defer the requirement for temporally-consistent points across the scene and reconstruct only a sparse point cloud per timestep that is noisy in space-time. Second, for NVS, we present a variational diffusion formulation on depths and colors that lets us robustly cope with the noise by enforcing spatio-temporal consistency via per-pixel reprojection weights derived from the input views. Together, this deferred approach generates novel views for dynamic scenes without requiring challenging spatio-temporally consistent reconstructions nor training complex models on large datasets. We demonstrate our algorithm on real-world dynamic scenes against classic and more recent learning-based baseline approaches. △ Less

Submitted 2 September, 2021; originally announced September 2021.

Comments: Accompanying video: https://youtu.be/RXK2iv980nU

Baseline Skinning for Point Sets of Articulated Bodies

Authors: Tong Fu, Raphaëlle Chaine, Julie Digne

Abstract: General skinning techniques aim to deform the surface of an articulated model following the pose change of a skeleton. Their rapidity makes them ideal tools for real-time animation purposes. However, popular skinning algorithms are simple, but they tend to generate undesirable geometric artefacts. In our work, we consider skeletons given in the form of sphere-mesh models controlling both the pose… ▽ More General skinning techniques aim to deform the surface of an articulated model following the pose change of a skeleton. Their rapidity makes them ideal tools for real-time animation purposes. However, popular skinning algorithms are simple, but they tend to generate undesirable geometric artefacts. In our work, we consider skeletons given in the form of sphere-mesh models controlling both the pose and morphology of the shape that is either described as a mesh or a raw point set. We propose a novel skinning method that encodes the point set details above a bundle of baselines covering the sphere-mesh. In particular, we propose a geometrical model of the baseline and detail direction evolution during bone twisting and joints bending rotations. Our approach works directly on point sets and thus preserves the accuracy of the initial sampling. It further avoids computing a weight per point or a costly explicit muscle modelling step. We evaluate our method on several articulated body point sets, showing that it creates fewer artefacts than classical methods. △ Less

Submitted 7 June, 2021; originally announced June 2021.

Learning to Generate Wasserstein Barycenters

Authors: Julien Lacombe, Julie Digne, Nicolas Courty, Nicolas Bonneel

Abstract: Optimal transport is a notoriously difficult problem to solve numerically, with current approaches often remaining intractable for very large scale applications such as those encountered in machine learning. Wasserstein barycenters -- the problem of finding measures in-between given input measures in the optimal transport sense -- is even more computationally demanding as it requires to solve an o… ▽ More Optimal transport is a notoriously difficult problem to solve numerically, with current approaches often remaining intractable for very large scale applications such as those encountered in machine learning. Wasserstein barycenters -- the problem of finding measures in-between given input measures in the optimal transport sense -- is even more computationally demanding as it requires to solve an optimization problem involving optimal transport distances. By training a deep convolutional neural network, we improve by a factor of 60 the computational speed of Wasserstein barycenters over the fastest state-of-the-art approach on the GPU, resulting in milliseconds computational times on $512\times512$ regular grids. We show that our network, trained on Wasserstein barycenters of pairs of measures, generalizes well to the problem of finding Wasserstein barycenters of more than two measures. We demonstrate the efficiency of our approach for computing barycenters of sketches and transferring colors between multiple images. △ Less

Submitted 24 February, 2021; originally announced February 2021.

Comments: 18 pages, 16 figures, submitted to the Machine Learning journal (Springer)

ACM Class: I.2.6; I.4.9; G.2.1; G.3; I.3.3

Code Replicability in Computer Graphics

Authors: Nicolas Bonneel, David Coeurjolly, Julie Digne, Nicolas Mellado

Abstract: Being able to duplicate published research results is an important process of conducting research whether to build upon these findings or to compare with them. This process is called "replicability" when using the original authors' artifacts (e.g., code), or "reproducibility" otherwise (e.g., re-implementing algorithms). Reproducibility and replicability of research results have gained a lot of in… ▽ More Being able to duplicate published research results is an important process of conducting research whether to build upon these findings or to compare with them. This process is called "replicability" when using the original authors' artifacts (e.g., code), or "reproducibility" otherwise (e.g., re-implementing algorithms). Reproducibility and replicability of research results have gained a lot of interest recently with assessment studies being led in various fields, and they are often seen as a trigger for better result diffusion and transparency. In this work, we assess replicability in Computer Graphics, by evaluating whether the code is available and whether it works properly. As a proxy for this field we compiled, ran and analyzed 151 codes out of 374 papers from 2014, 2016 and 2018 SIGGRAPH conferences. This analysis shows a clear increase in the number of papers with available and operational research codes with a dependency on the subfields, and indicates a correlation between code replicability and citation count. We further provide an interactive tool to explore our results and evaluation data. △ Less

Submitted 6 May, 2020; v1 submitted 1 May, 2020; originally announced May 2020.

Comments: 8 pages. ACM Trans. on Graphics (Proceedings of SIGGRAPH 2020)

FAKIR: An algorithm for revealing the anatomy and pose of statues from raw point sets

Authors: Tong Fu, Raphaëlle Chaine, Julie Digne

Abstract: 3D acquisition of archaeological artefacts has become an essential part of cultural heritage research for preservation or restoration purpose. Statues, in particular, have been at the center of many projects. In this paper, we introduce a way to improve the understanding of acquired statues representing real or imaginary creatures by registering a simple and pliable articulated model to the raw po… ▽ More 3D acquisition of archaeological artefacts has become an essential part of cultural heritage research for preservation or restoration purpose. Statues, in particular, have been at the center of many projects. In this paper, we introduce a way to improve the understanding of acquired statues representing real or imaginary creatures by registering a simple and pliable articulated model to the raw point set data. Our approach performs a Forward And bacKward Iterative Registration (FAKIR) which proceeds joint by joint, needing only a few iterations to converge. We are thus able to detect the pose and elementary anatomy of sculptures, with possibly non realistic body proportions. By adapting our simple skeleton, our method can work on animals and imaginary creatures. △ Less

Submitted 7 October, 2020; v1 submitted 26 July, 2019; originally announced July 2019.

Sparse Geometric Representation Through Local Shape Probing

Authors: Julie Digne, Sébastien Valette, Raphaëlle Chaine

Abstract: We propose a new shape analysis approach based on the non-local analysis of local shape variations. Our method relies on a novel description of shape variations, called Local Probing Field (LPF), which describes how a local probing operator transforms a pattern onto the shape. By carefully optimizing the position and orientation of each descriptor, we are able to capture shape similarities and gat… ▽ More We propose a new shape analysis approach based on the non-local analysis of local shape variations. Our method relies on a novel description of shape variations, called Local Probing Field (LPF), which describes how a local probing operator transforms a pattern onto the shape. By carefully optimizing the position and orientation of each descriptor, we are able to capture shape similarities and gather them into a geometrically relevant dictionary over which the shape decomposes sparsely. This new representation permits to handle shapes with mixed intrinsic dimensionality (e.g. shapes containing both surfaces and curves) and to encode various shape features such as boundaries. Our shape representation has several potential applications; here we demonstrate its efficiency for shape resampling and point set denoising for both synthetic and real data. △ Less

Submitted 2 November, 2017; v1 submitted 7 December, 2016; originally announced December 2016.

MSC Class: 68U05; 97R60

Journal ref: IEEE Transactions on Visualization and Computer Graphics, 2017