-
A robust shifted proper orthogonal decomposition: Proximal methods for decomposing flows with multiple transports
Authors:
Philipp Krah,
Arthur Marmin,
Beata Zorawski,
Julius Reiss,
Kai Schneider
Abstract:
We present a new methodology for decomposing flows with multiple transports that further extends the shifted proper orthogonal decomposition (sPOD). The sPOD tries to approximate transport-dominated flows by a sum of co-moving data fields. The proposed methods stem from sPOD but optimize the co-moving fields directly and penalize their nuclear norm to promote low rank of the individual data in the…
▽ More
We present a new methodology for decomposing flows with multiple transports that further extends the shifted proper orthogonal decomposition (sPOD). The sPOD tries to approximate transport-dominated flows by a sum of co-moving data fields. The proposed methods stem from sPOD but optimize the co-moving fields directly and penalize their nuclear norm to promote low rank of the individual data in the decomposition. Furthermore, we add a robustness term to the decomposition that can deal with interpolation error and data noises. Leveraging tools from convex optimization, we derive three proximal algorithms to solve the decomposition problem. We report a numerical comparison with existing methods against synthetic data benchmarks and then show the separation ability of our methods on 1D and 2D incompressible and reactive flows. The resulting methodology is the basis of a new analysis paradigm that results in the same interpretability as the POD for the individual co-moving fields.
△ Less
Submitted 6 March, 2025; v1 submitted 7 March, 2024;
originally announced March 2024.
-
Model Order Reduction for the 1D Boltzmann-BGK Equation: Identifying Intrinsic Variables Using Neural Networks
Authors:
Julian Koellermeier,
Philipp Krah,
Julius Reiss,
Zachary Schellin
Abstract:
Kinetic equations are crucial for modeling non-equilibrium phenomena, but their computational complexity is a challenge. This paper presents a data-driven approach using reduced order models (ROM) to efficiently model non-equilibrium flows in kinetic equations by comparing two ROM approaches: Proper Orthogonal Decomposition (POD) and autoencoder neural networks (AE). While AE initially demonstrate…
▽ More
Kinetic equations are crucial for modeling non-equilibrium phenomena, but their computational complexity is a challenge. This paper presents a data-driven approach using reduced order models (ROM) to efficiently model non-equilibrium flows in kinetic equations by comparing two ROM approaches: Proper Orthogonal Decomposition (POD) and autoencoder neural networks (AE). While AE initially demonstrate higher accuracy, POD's precision improves as more modes are considered. Notably, our work recognizes that the classical POD-MOR approach, although capable of accurately representing the non-linear solution manifold of the kinetic equation, may not provide a parsimonious model of the data due to the inherently non-linear nature of the data manifold. We demonstrate how AEs are used in finding the intrinsic dimension of a system and to allow correlating the intrinsic quantities with macroscopic quantities that have a physical interpretation.
△ Less
Submitted 6 October, 2023;
originally announced October 2023.
-
Parametric model order reduction for a wildland fire model via the shifted POD based deep learning method
Authors:
Shubhaditya Burela,
Philipp Krah,
Julius Reiss
Abstract:
Parametric model order reduction techniques often struggle to accurately represent transport-dominated phenomena due to a slowly decaying Kolmogorov n-width. To address this challenge, we propose a non-intrusive, data-driven methodology that combines the shifted proper orthogonal decomposition (POD) with deep learning. Specifically, the shifted POD technique is utilized to derive a high-fidelity,…
▽ More
Parametric model order reduction techniques often struggle to accurately represent transport-dominated phenomena due to a slowly decaying Kolmogorov n-width. To address this challenge, we propose a non-intrusive, data-driven methodology that combines the shifted proper orthogonal decomposition (POD) with deep learning. Specifically, the shifted POD technique is utilized to derive a high-fidelity, low-dimensional model of the flow, which is subsequently utilized as input to a deep learning framework to forecast the flow dynamics under various temporal and parameter conditions. The efficacy of the proposed approach is demonstrated through the analysis of one- and two-dimensional wildland fire models with varying reaction rates, and its performance is evaluated using multiple error measures. The results indicate that the proposed approach yields highly accurate results within the percent range, while also enabling rapid prediction of system states within seconds.
△ Less
Submitted 28 April, 2023;
originally announced April 2023.
-
Front Transport Reduction for Complex Moving Fronts
Authors:
Philipp Krah,
Steffen Büchholz,
Matthias Häringer,
Julius Reiss
Abstract:
This work addresses model order reduction for complex moving fronts, which are transported by advection or through a reaction-diffusion process. Such systems are especially challenging for model order reduction since the transport cannot be captured by linear reduction methods. Moreover, topological changes, such as splitting or merging of fronts pose difficulties for many nonlinear reduction meth…
▽ More
This work addresses model order reduction for complex moving fronts, which are transported by advection or through a reaction-diffusion process. Such systems are especially challenging for model order reduction since the transport cannot be captured by linear reduction methods. Moreover, topological changes, such as splitting or merging of fronts pose difficulties for many nonlinear reduction methods and the small non-vanishing support of the underlying partial differential equations dynamics makes most nonlinear hyper-reduction methods infeasible. We propose a new decomposition method together with a hyper-reduction scheme that addresses these shortcomings. The decomposition uses a level-set function to parameterize the transport and a nonlinear activation function that captures the structure of the front. This approach is similar to autoencoder artificial neural networks, but additionally provides insights into the system, which can be used for efficient reduced order models. We make use of this property and are thus able to solve the advection equation with the same complexity as the POD-Galerkin approach while obtaining errors of less than one percent for representative examples. Furthermore, we outline a special hyper-reduction method for more complicated advection-reaction-diffusion systems. The capability of the approach is illustrated by various numerical examples in one and two spatial dimensions, including real-life applications to a two-dimensional Bunsen flame.
△ Less
Submitted 16 February, 2022;
originally announced February 2022.
-
Wavelet Adaptive Proper Orthogonal Decomposition for Large Scale Flow Data
Authors:
Philipp Krah,
Thomas Engels,
Kai Schneider,
Julius Reiss
Abstract:
The proper orthogonal decomposition (POD) is a powerful classical tool in fluid mechanics used, for instance, for model reduction and extraction of coherent flow features. However, its applicability to high-resolution data, as produced by three-dimensional direct numerical simulations, is limited owing to its computational complexity. Here, we propose a wavelet-based adaptive version of the POD (t…
▽ More
The proper orthogonal decomposition (POD) is a powerful classical tool in fluid mechanics used, for instance, for model reduction and extraction of coherent flow features. However, its applicability to high-resolution data, as produced by three-dimensional direct numerical simulations, is limited owing to its computational complexity. Here, we propose a wavelet-based adaptive version of the POD (the wPOD), in order to overcome this limitation. The amount of data to be analyzed is reduced by compressing them using biorthogonal wavelets, yielding a sparse representation while conveniently providing control of the compression error. Numerical analysis shows how the distinct error contributions of wavelet compression and POD truncation can be balanced under certain assumptions, allowing us to efficiently process high-resolution data from three-dimensional simulations of flow problems. Using a synthetic academic test case, we compare our algorithm with the randomized singular value decomposition. Furthermore, we demonstrate the ability of our method analyzing data of a 2D wake flow and a 3D flow generated by a flapping insect computed with direct numerical simulation.
△ Less
Submitted 10 November, 2020;
originally announced November 2020.
-
Finite-difference-based simulation and adjoint optimization of gas networks
Authors:
Sonja Hossbach,
Mathias Lemke,
Julius Reiss
Abstract:
The stable operation of gas networks is an important optimization target. While for this task commonly finite volume methods are used, we introduce a new finite difference approach. With a summation by part formulation for the spatial discretization, we get well-defined fluxes between the pipes. This allows a simple and explicit formulation of the coupling conditions at the node. From that, we der…
▽ More
The stable operation of gas networks is an important optimization target. While for this task commonly finite volume methods are used, we introduce a new finite difference approach. With a summation by part formulation for the spatial discretization, we get well-defined fluxes between the pipes. This allows a simple and explicit formulation of the coupling conditions at the node. From that, we derive the adjoint equations for the network simply and transparently. The resulting direct and adjoint equations are numerically efficient and easy to implement. The approach is demonstrated by the optimization of two sample gas networks.
△ Less
Submitted 30 August, 2021; v1 submitted 16 October, 2020;
originally announced October 2020.
-
Optimization-based modal decomposition for systems with multiple transports
Authors:
Julius Reiss
Abstract:
Mode-based model-reduction is used to reduce the degrees of freedom of high dimensional systems, often by describing the system state by a linear combination of spatial modes. Transport dominated phenomena, ubiquitous in technical and scientific applications, often require a large number of linear modes to obtain a small representation error. This difficulty, even for the most simple transports, o…
▽ More
Mode-based model-reduction is used to reduce the degrees of freedom of high dimensional systems, often by describing the system state by a linear combination of spatial modes. Transport dominated phenomena, ubiquitous in technical and scientific applications, often require a large number of linear modes to obtain a small representation error. This difficulty, even for the most simple transports, originates from the inappropriateness of the decomposition structure in time dependent amplitudes of purely spatial modes.
In this article an approach is discussed, which decomposes a flow field into several fields of co-moving frames, where each one can be approximated by a few modes. The method of decomposition is formulated as an optimization problem. Different singular-value-based objective functions are discussed and connected to former formulations. A boundary treatment is provided. The decomposition is applied to generic cases and to a technically relevant flow configuration of combustion physics.
△ Less
Submitted 26 February, 2020;
originally announced February 2020.
-
A wavelet-adaptive method for multiscale simulation of turbulent flows in flying insects
Authors:
Thomas Engels,
Kai Schneider,
Julius Reiss,
Marie Farge
Abstract:
We present a wavelet-based adaptive method for computing 3D multiscale flows in complex, time-dependent geometries, implemented on massively parallel computers. While our focus is on simulations of flapping insects, it can be used for other flow problems, including turbulence, as well. The incompressible fluid is modeled with an artificial compressibility approach in order to avoid solving ellipti…
▽ More
We present a wavelet-based adaptive method for computing 3D multiscale flows in complex, time-dependent geometries, implemented on massively parallel computers. While our focus is on simulations of flapping insects, it can be used for other flow problems, including turbulence, as well. The incompressible fluid is modeled with an artificial compressibility approach in order to avoid solving elliptical problems. No-slip and in/outflow boundary conditions are imposed using volume penalization. The governing equations are discretized on a locally uniform Cartesian grid with centered finite differences, and integrated in time with a Runge--Kutta scheme, both of 4th order. The domain is partitioned into cubic blocks with equidistant grids with different resolution and, for each block, biorthogonal interpolating wavelets are used as refinement indicators and prediction operators. Thresholding the wavelet coefficients allows to generate dynamically evolving grids, and an adaption strategy tracks the solution in both space and scale. Blocks are distributed among MPI processes and the global topology of the grid is encoded using a tree-like data structure. Analyzing the different physical and numerical parameters allows balancing their individual error contributions and thus ensures optimal convergence while minimizing computational effort. Different validation tests score accuracy and performance of our new open source code, WABBIT (Wavelet Adaptive Block-Based solver for Interactions with Turbulence), on massively parallel computers using fully adaptive grids. Flow simulations of flapping insects demonstrate its applicability to complex, bio-inspired problems.
△ Less
Submitted 6 January, 2021; v1 submitted 11 December, 2019;
originally announced December 2019.
-
Model Order Reduction of Combustion Processes with Complex Front Dynamics
Authors:
Philipp Krah,
Mario Sroka,
Julius Reiss
Abstract:
In this work we present a data driven method, used to improve mode-based model order reduction of transport fields with sharp fronts. We assume that the original flow field $q(\mathbf{x},t)=f(φ(\mathbf{x},t))$ can be reconstructed by a front shape function $f$ and a level set function $φ$. The level set function is used to generate a local coordinate, which parametrizes the distance to the front.…
▽ More
In this work we present a data driven method, used to improve mode-based model order reduction of transport fields with sharp fronts. We assume that the original flow field $q(\mathbf{x},t)=f(φ(\mathbf{x},t))$ can be reconstructed by a front shape function $f$ and a level set function $φ$. The level set function is used to generate a local coordinate, which parametrizes the distance to the front. In this way, we are able to embed the local 1D description of the front for complex 2D front dynamics with merging or splitting fronts, while seeking a low rank description of $φ$. Here, the freedom of choosing $φ$ far away from the front can be used to find a low rank description of $φ$ which accelerates the convergence of $\Vert q- f(φ_n)\Vert$, when truncating $φ$ after the $n$th mode. We demonstrate the ability of this new ansatz for a 2D propagating flame with a moving front.
△ Less
Submitted 11 May, 2021; v1 submitted 6 December, 2019;
originally announced December 2019.
-
Mode-based derivation of adjoint equations - a lazy man's approach
Authors:
Julius Reiss,
Mathias Lemke,
Jörn Sesterhenn
Abstract:
A method to calculate the adjoint solution for a large class of partial differential equations is discussed. It differs from the known continuous and discrete adjoint, including automatic differentiation. Thus, it represents an alternative, third method. It is based on a modal representation of the linearized operator of the governing (primal) system. To approximate the operator an extended versio…
▽ More
A method to calculate the adjoint solution for a large class of partial differential equations is discussed. It differs from the known continuous and discrete adjoint, including automatic differentiation. Thus, it represents an alternative, third method. It is based on a modal representation of the linearized operator of the governing (primal) system. To approximate the operator an extended version of the Arnoldi factorization, the dynamical Arnoldi method (DAM) is introduced. The DAM allows to derive approximations for operators of non-symmetric coupled equations, which are inaccessible by the classical Arnoldi factorization. The approach is applied to the Burgers equation and to the Euler equations on periodic and non-periodic domains. Finally, it is tested on an optimization problem.
△ Less
Submitted 7 May, 2018;
originally announced May 2018.
-
Model Reduction for a Pulsed Detonation Combuster via Shifted Proper Orthogonal Decomposition
Authors:
Philipp Schulze,
Julius Reiss,
Volker Mehrmann
Abstract:
We propose a new algorithm to compute a shifted proper orthogonal decomposition (sPOD) for systems dominated by multiple transport velocities. The sPOD is a recently proposed mode decomposition technique which overcomes the poor performance of classical methods like the proper orthogonal decomposition (POD) for transport-dominated phenomena. This is achieved by identifying the transport directions…
▽ More
We propose a new algorithm to compute a shifted proper orthogonal decomposition (sPOD) for systems dominated by multiple transport velocities. The sPOD is a recently proposed mode decomposition technique which overcomes the poor performance of classical methods like the proper orthogonal decomposition (POD) for transport-dominated phenomena. This is achieved by identifying the transport directions and velocities and by shifting the modes in space to track the transports. Our new algorithm carries out a residual minimization in which the main computational cost arises from solving a nonlinear optimization problem scaling with the snapshot dimension. We apply the algorithm to snapshot data from the simulation of a pulsed detonation combuster and observe that very few sPOD modes are sufficient to obtain a good approximation. For the same accuracy, the common POD needs ten times as many modes and, in contrast to the sPOD modes, the POD modes do not reflect the moving front profiles properly.
△ Less
Submitted 5 March, 2018;
originally announced March 2018.
-
The shifted proper orthogonal decomposition: A mode decomposition for multiple transport phenomena
Authors:
Julius Reiss,
Philipp Schulze,
Jörn Sesterhenn,
Volker Mehrmann
Abstract:
Transport-dominated phenomena provide a challenge for common mode-based model reduction approaches. We present a model reduction method, which is suited for these kind of systems. It extends the proper orthogonal decomposition (POD) by introducing time-dependent shifts of the snapshot matrix. The approach, called shifted proper orthogonal decomposition (sPOD), features a determination of the {\it…
▽ More
Transport-dominated phenomena provide a challenge for common mode-based model reduction approaches. We present a model reduction method, which is suited for these kind of systems. It extends the proper orthogonal decomposition (POD) by introducing time-dependent shifts of the snapshot matrix. The approach, called shifted proper orthogonal decomposition (sPOD), features a determination of the {\it multiple} transport velocities and a separation of these. One- and two-dimensional test examples reveal the good performance of the sPOD for transport-dominated phenomena and its superiority in comparison to the POD.
△ Less
Submitted 16 February, 2018; v1 submitted 7 December, 2015;
originally announced December 2015.
-
A family of energy stable, skew-symmetric finite difference schemes on collocated grids
Authors:
Julius Reiss
Abstract:
A simple scheme for incompressible, constant density flows is presented, which avoids odd-even decoupling for the Laplacian on a collocated grids. Energy stability is implied by maintaining strict energy conservation. Momentum is conserved. Arbitrary order in space and time can easily be obtained. The conservation properties hold on transformed grids.
A simple scheme for incompressible, constant density flows is presented, which avoids odd-even decoupling for the Laplacian on a collocated grids. Energy stability is implied by maintaining strict energy conservation. Momentum is conserved. Arbitrary order in space and time can easily be obtained. The conservation properties hold on transformed grids.
△ Less
Submitted 5 February, 2014;
originally announced February 2014.
