-
A Parallel, Energy-Stable Low-Rank Integrator for Nonlinear Multi-Scale Thermal Radiative Transfer
Authors:
Chinmay Patwardhan,
Jonas Kusch
Abstract:
Thermal radiative transfer models physical phenomena ranging from supernovas in astrophysics to radiation from a hohlraum striking a fusion target in plasma physics. Transport and absorption of particles in radiative transfer at different rates lead to a complex interaction between the material and particles that involves highly varying time scales. Resolving these effects can require prohibitivel…
▽ More
Thermal radiative transfer models physical phenomena ranging from supernovas in astrophysics to radiation from a hohlraum striking a fusion target in plasma physics. Transport and absorption of particles in radiative transfer at different rates lead to a complex interaction between the material and particles that involves highly varying time scales. Resolving these effects can require prohibitively small step sizes, which, combined with nonlinear effects and the particle density's high-dimensional phase space, render conventional numerical methods computationally expensive. This work presents an asymptotic--preserving, mass conservative, rank-adaptive, and parallel integrator for a macro--micro decomposition-based dynamical low-rank approximation of the thermal radiative transfer equations. The proposed integrator efficiently incorporates reflection-transmission type boundary conditions in the low-rank factors. It captures the nonlinear effects of thermal radiation and is energy stable with the step size restriction capturing both hyperbolic and parabolic CFL conditions. The efficacy of the proposed integrator is demonstrated with numerical experiments.
△ Less
Submitted 28 February, 2025;
originally announced February 2025.
-
HADL Framework for Noise Resilient Long-Term Time Series Forecasting
Authors:
Aditya Dey,
Jonas Kusch,
Fadi Al Machot
Abstract:
Long-term time series forecasting is critical in domains such as finance, economics, and energy, where accurate and reliable predictions over extended horizons drive strategic decision-making. Despite the progress in machine learning-based models, the impact of temporal noise in extended lookback windows remains underexplored, often degrading model performance and computational efficiency. In this…
▽ More
Long-term time series forecasting is critical in domains such as finance, economics, and energy, where accurate and reliable predictions over extended horizons drive strategic decision-making. Despite the progress in machine learning-based models, the impact of temporal noise in extended lookback windows remains underexplored, often degrading model performance and computational efficiency. In this paper, we propose a novel framework that addresses these challenges by integrating the Discrete Wavelet Transform (DWT) and Discrete Cosine Transform (DCT) to perform noise reduction and extract robust long-term features. These transformations enable the separation of meaningful temporal patterns from noise in both the time and frequency domains. To complement this, we introduce a lightweight low-rank linear prediction layer that not only reduces the influence of residual noise but also improves memory efficiency. Our approach demonstrates competitive robustness to noisy input, significantly reduces computational complexity, and achieves competitive or state-of-the-art forecasting performance across diverse benchmark datasets. Extensive experiments reveal that the proposed framework is particularly effective in scenarios with high noise levels or irregular patterns, making it well suited for real-world forecasting tasks. The code is available in https://github.com/forgee-master/HADL.
△ Less
Submitted 14 February, 2025;
originally announced February 2025.
-
An energy stable and conservative multiplicative dynamical low-rank discretization for the Su-Olson problem
Authors:
Lena Baumann,
Lukas Einkemmer,
Christian Klingenberg,
Jonas Kusch
Abstract:
Computing numerical solutions of the thermal radiative transfer equations on a finely resolved grid can be costly due to high computational and memory requirements. A numerical reduced order method that has recently been applied to a wide variety of kinetic partial differential equations is the concept of dynamical low-rank approximation (DLRA). In this paper, we consider the thermal radiative tra…
▽ More
Computing numerical solutions of the thermal radiative transfer equations on a finely resolved grid can be costly due to high computational and memory requirements. A numerical reduced order method that has recently been applied to a wide variety of kinetic partial differential equations is the concept of dynamical low-rank approximation (DLRA). In this paper, we consider the thermal radiative transfer equations with Su-Olson closure, leading to a linearized kinetic model. For the conducted theoretical and practical considerations we use a multiplicative splitting of the distribution function that poses additional challenges in finding an energy stable discretization and deriving a hyperbolic Courant-Friedrichs-Lewy (CFL) condition. We propose such an energy stable DLRA scheme that makes use of the augmented basis update & Galerkin integrator. This integrator allows for additional basis augmentations, enabling us to give a mathematically rigorous proof of energy stability and local mass conservation. Numerical examples confirm the derived properties and show the computational advantages of the DLRA scheme compared to a numerical solution of the full system of equations.
△ Less
Submitted 5 February, 2025;
originally announced February 2025.
-
An Augmented Backward-Corrected Projector Splitting Integrator for Dynamical Low-Rank Training
Authors:
Jonas Kusch,
Steffen Schotthöfer,
Alexandra Walter
Abstract:
Layer factorization has emerged as a widely used technique for training memory-efficient neural networks. However, layer factorization methods face several challenges, particularly a lack of robustness during the training process. To overcome this limitation, dynamical low-rank training methods have been developed, utilizing robust time integration techniques for low-rank matrix differential equat…
▽ More
Layer factorization has emerged as a widely used technique for training memory-efficient neural networks. However, layer factorization methods face several challenges, particularly a lack of robustness during the training process. To overcome this limitation, dynamical low-rank training methods have been developed, utilizing robust time integration techniques for low-rank matrix differential equations. Although these approaches facilitate efficient training, they still depend on computationally intensive QR and singular value decompositions of matrices with small rank. In this work, we introduce a novel low-rank training method that reduces the number of required QR decompositions. Our approach integrates an augmentation step into a projector-splitting scheme, ensuring convergence to a locally optimal solution. We provide a rigorous theoretical analysis of the proposed method and demonstrate its effectiveness across multiple benchmarks.
△ Less
Submitted 5 February, 2025;
originally announced February 2025.
-
Low-rank variance reduction for uncertain radiative transfer with control variates
Authors:
Chinmay Patwardhan,
Pia Stammer,
Emil Løvbak,
Jonas Kusch,
Sebastian Krumscheid
Abstract:
The radiative transfer equation models various physical processes ranging from plasma simulations to radiation therapy. In practice, these phenomena are often subject to uncertainties. Modeling and propagating these uncertainties requires accurate and efficient solvers for the radiative transfer equations. Due to the equation's high-dimensional phase space, fine-grid solutions of the radiative tra…
▽ More
The radiative transfer equation models various physical processes ranging from plasma simulations to radiation therapy. In practice, these phenomena are often subject to uncertainties. Modeling and propagating these uncertainties requires accurate and efficient solvers for the radiative transfer equations. Due to the equation's high-dimensional phase space, fine-grid solutions of the radiative transfer equation are computationally expensive and memory-intensive. In recent years, dynamical low-rank approximation has become a popular method for solving kinetic equations due to the development of computationally inexpensive, memory-efficient and robust algorithms like the augmented basis update \& Galerkin integrator. In this work, we propose a low-rank Monte Carlo estimator and combine it with a control variate strategy based on multi-fidelity low-rank approximations for variance reduction. We investigate the error analytically and numerically and find that a joint approach to balance rank and grid size is necessary. Numerical experiments further show that the efficiency of estimators can be improved using dynamical low-rank approximation, especially in the context of control variates.
△ Less
Submitted 30 May, 2025; v1 submitted 10 January, 2025;
originally announced January 2025.
-
A Deterministic Dynamical Low-rank Approach for Charged Particle Transport
Authors:
Pia Stammer,
Tiberiu Burlacu,
Niklas Wahl,
Danny Lathouwers,
Jonas Kusch
Abstract:
Deterministically solving charged particle transport problems at a sufficient spatial and angular resolution is often prohibitively expensive, especially due to their highly forward peaked scattering. We propose a model order reduction approach which evolves the solution on a low-rank manifold in time, making computations feasible at much higher resolutions and reducing the overall run-time and me…
▽ More
Deterministically solving charged particle transport problems at a sufficient spatial and angular resolution is often prohibitively expensive, especially due to their highly forward peaked scattering. We propose a model order reduction approach which evolves the solution on a low-rank manifold in time, making computations feasible at much higher resolutions and reducing the overall run-time and memory footprint.
For this, we use a hybrid dynamical low-rank approach based on a collided-uncollided split, i.e., the transport equation is split through a collision source method. Uncollided particles are described using a ray tracer, facilitating the inclusion of boundary conditions and straggling, whereas collided particles are represented using a moment method combined with the dynamical low-rank approximation. Here the energy is treated as a pseudo-time and a rank adaptive integrator is chosen to dynamically adapt the rank in energy. We can reproduce the results of a full-rank reference code at a much lower rank and thus computational cost and memory usage. The solution further achieves comparable accuracy with respect to TOPAS MC as previous deterministic approaches.
△ Less
Submitted 10 January, 2025; v1 submitted 12 December, 2024;
originally announced December 2024.
-
A review of low-rank methods for time-dependent kinetic simulations
Authors:
Lukas Einkemmer,
Katharina Kormann,
Jonas Kusch,
Ryan G. McClarren,
Jing-Mei Qiu
Abstract:
Time-dependent kinetic models are ubiquitous in computational science and engineering. The underlying integro-differential equations in these models are high-dimensional, comprised of a six--dimensional phase space, making simulations of such phenomena extremely expensive. In this article we demonstrate that in many situations, the solution to kinetics problems lives on a low dimensional manifold…
▽ More
Time-dependent kinetic models are ubiquitous in computational science and engineering. The underlying integro-differential equations in these models are high-dimensional, comprised of a six--dimensional phase space, making simulations of such phenomena extremely expensive. In this article we demonstrate that in many situations, the solution to kinetics problems lives on a low dimensional manifold that can be described by a low-rank matrix or tensor approximation. We then review the recent development of so-called low-rank methods that evolve the solution on this manifold. The two classes of methods we review are the dynamical low-rank (DLR) method, which derives differential equations for the low-rank factors, and a Step-and-Truncate (SAT) approach, which projects the solution onto the low-rank representation after each time step. Thorough discussions of time integrators, tensor decompositions, and method properties such as structure preservation and computational efficiency are included. We further show examples of low-rank methods as applied to particle transport and plasma dynamics.
△ Less
Submitted 8 December, 2024;
originally announced December 2024.
-
A parallel Basis Update and Galerkin Integrator for Tree Tensor Networks
Authors:
Gianluca Ceruti,
Jonas Kusch,
Christian Lubich,
Dominik Sulz
Abstract:
Computing the numerical solution to high-dimensional tensor differential equations can lead to prohibitive computational costs and memory requirements. To reduce the memory and computational footprint, dynamical low-rank approximation (DLRA) has proven to be a promising approach. DLRA represents the solution as a low-rank tensor factorization and evolves the resulting low-rank factors in time. A c…
▽ More
Computing the numerical solution to high-dimensional tensor differential equations can lead to prohibitive computational costs and memory requirements. To reduce the memory and computational footprint, dynamical low-rank approximation (DLRA) has proven to be a promising approach. DLRA represents the solution as a low-rank tensor factorization and evolves the resulting low-rank factors in time. A central challenge in DLRA is to find time integration schemes that are robust to the arising small singular values. A robust parallel basis update & Galerkin integrator, which simultaneously evolves all low-rank factors, has recently been derived for matrix differential equations. This work extends the parallel low-rank matrix integrator to Tucker tensors and general tree tensor networks, yielding an algorithm in which all bases and connecting tensors are evolved in parallel over a time step. We formulate the algorithm, provide a robust error bound, and demonstrate the efficiency of the new integrators for problems in quantum many-body physics, uncertainty quantification, and radiative transfer.
△ Less
Submitted 1 December, 2024;
originally announced December 2024.
-
A stable multiplicative dynamical low-rank discretization for the linear Boltzmann-BGK equation
Authors:
Lena Baumann,
Lukas Einkemmer,
Christian Klingenberg,
Jonas Kusch
Abstract:
The numerical method of dynamical low-rank approximation (DLRA) has recently been applied to various kinetic equations showing a significant reduction of the computational effort. In this paper, we apply this concept to the linear Boltzmann-Bhatnagar-Gross-Krook (Boltzmann-BGK) equation which due its high dimensionality is challenging to solve. Inspired by the special structure of the non-linear B…
▽ More
The numerical method of dynamical low-rank approximation (DLRA) has recently been applied to various kinetic equations showing a significant reduction of the computational effort. In this paper, we apply this concept to the linear Boltzmann-Bhatnagar-Gross-Krook (Boltzmann-BGK) equation which due its high dimensionality is challenging to solve. Inspired by the special structure of the non-linear Boltzmann-BGK problem, we consider a multiplicative splitting of the distribution function. We propose a rank-adaptive DLRA scheme making use of the basis update & Galerkin integrator and combine it with an additional basis augmentation to ensure numerical stability, for which an analytical proof is given and a classical hyperbolic Courant-Friedrichs-Lewy (CFL) condition is derived. This allows for a further acceleration of computational times and a better understanding of the underlying problem in finding a suitable discretization of the system. Numerical results of a series of different test examples confirm the accuracy and efficiency of the proposed method compared to the numerical solution of the full system.
△ Less
Submitted 11 November, 2024;
originally announced November 2024.
-
GeoLoRA: Geometric integration for parameter efficient fine-tuning
Authors:
Steffen Schotthöfer,
Emanuele Zangrando,
Gianluca Ceruti,
Francesco Tudisco,
Jonas Kusch
Abstract:
Low-Rank Adaptation (LoRA) has become a widely used method for parameter-efficient fine-tuning of large-scale, pre-trained neural networks. However, LoRA and its extensions face several challenges, including the need for rank adaptivity, robustness, and computational efficiency during the fine-tuning process. We introduce GeoLoRA, a novel approach that addresses these limitations by leveraging dyn…
▽ More
Low-Rank Adaptation (LoRA) has become a widely used method for parameter-efficient fine-tuning of large-scale, pre-trained neural networks. However, LoRA and its extensions face several challenges, including the need for rank adaptivity, robustness, and computational efficiency during the fine-tuning process. We introduce GeoLoRA, a novel approach that addresses these limitations by leveraging dynamical low-rank approximation theory. GeoLoRA requires only a single backpropagation pass over the small-rank adapters, significantly reducing computational cost as compared to similar dynamical low-rank training methods and making it faster than popular baselines such as AdaLoRA. This allows GeoLoRA to efficiently adapt the allocated parameter budget across the model, achieving smaller low-rank adapters compared to heuristic methods like AdaLoRA and LoRA, while maintaining critical convergence, descent, and error-bound theoretical guarantees. The resulting method is not only more efficient but also more robust to varying hyperparameter settings. We demonstrate the effectiveness of GeoLoRA on several state-of-the-art benchmarks, showing that it outperforms existing methods in both accuracy and computational efficiency.
△ Less
Submitted 24 October, 2024;
originally announced October 2024.
-
A multi-fidelity adaptive dynamical low-rank based optimization algorithm for fission criticality problems
Authors:
C. Scalone,
L. Einkemmer,
J. Kusch,
R. J. McClarren
Abstract:
Computing the dominant eigenvalue is important in nuclear systems as it determines the stability of the system (i.e. whether the system is sub or supercritical). Recently, the work of Kusch, Whewell, McClarren and Frank \cite{KWMF} showed that performing a low-rank approximation can be very effective in reducing the high memory requirement and computational cost of such problems. In this work, we…
▽ More
Computing the dominant eigenvalue is important in nuclear systems as it determines the stability of the system (i.e. whether the system is sub or supercritical). Recently, the work of Kusch, Whewell, McClarren and Frank \cite{KWMF} showed that performing a low-rank approximation can be very effective in reducing the high memory requirement and computational cost of such problems. In this work, we propose a rank adaptive approach that changes the rank during the inverse power iteration. This allows us to progressively increase the rank (i.e. changing the fidelity of the model) as we get closer to convergence, thereby further reducing computational cost. We then exploit this multi-fidelity approach to optimize a simplified nuclear reactor. In this case the system is parameterized and the values of the parameters that give criticality are sought.
△ Less
Submitted 23 September, 2024;
originally announced September 2024.
-
Second-order robust parallel integrators for dynamical low-rank approximation
Authors:
Jonas Kusch
Abstract:
Due to its reduced memory and computational demands, dynamical low-rank approximation (DLRA) has sparked significant interest in multiple research communities. A central challenge in DLRA is the development of time integrators that are robust to the curvature of the manifold of low-rank matrices. Recently, a parallel robust time integrator that permits dynamic rank adaptation and enables a fully p…
▽ More
Due to its reduced memory and computational demands, dynamical low-rank approximation (DLRA) has sparked significant interest in multiple research communities. A central challenge in DLRA is the development of time integrators that are robust to the curvature of the manifold of low-rank matrices. Recently, a parallel robust time integrator that permits dynamic rank adaptation and enables a fully parallel update of all low-rank factors was introduced. Despite its favorable computational efficiency, the construction as a first-order approximation to the augmented basis-update & Galerkin integrator restricts the parallel integrator's accuracy to order one. In this work, an extension to higher order is proposed by a careful basis augmentation before solving the matrix differential equations of the factorized solution. A robust error bound with an improved dependence on normal components of the vector field together with a norm preservation property up to small terms is derived. These analytic results are complemented and demonstrated through a series of numerical experiments.
△ Less
Submitted 5 March, 2024;
originally announced March 2024.
-
Asymptotic-preserving and energy stable dynamical low-rank approximation for thermal radiative transfer equations
Authors:
Chinmay Patwardhan,
Martin Frank,
Jonas Kusch
Abstract:
The thermal radiative transfer equations model temperature evolution through a background medium as a result of radiation. When a large number of particles are absorbed in a short time scale, the dynamics tend to a non-linear diffusion-type equation called the Rosseland approximation. The main challenges for constructing numerical schemes that exhibit the correct limiting behavior are posed by the…
▽ More
The thermal radiative transfer equations model temperature evolution through a background medium as a result of radiation. When a large number of particles are absorbed in a short time scale, the dynamics tend to a non-linear diffusion-type equation called the Rosseland approximation. The main challenges for constructing numerical schemes that exhibit the correct limiting behavior are posed by the solution's high-dimensional phase space and multi-scale effects. In this work, we propose an asymptotic-preserving and rank-adaptive dynamical low-rank approximation scheme based on the macro-micro decomposition of the particle density and a modified augmented basis-update \& Galerkin integrator. We show that this scheme, for linear particle emission by the material, dissipates energy over time under a step size restriction that captures the hyperbolic and parabolic CFL conditions. We demonstrate the efficacy of the proposed method in a series of numerical experiments.
△ Less
Submitted 26 February, 2024;
originally announced February 2024.
-
A robust second-order low-rank BUG integrator based on the midpoint rule
Authors:
Gianluca Ceruti,
Lukas Einkemmer,
Jonas Kusch,
Christian Lubich
Abstract:
Dynamical low-rank approximation has become a valuable tool to perform an on-the-fly model order reduction for prohibitively large matrix differential equations. A core ingredient is the construction of integrators that are robust to the presence of small singular values and the resulting large time derivatives of the orthogonal factors in the low-rank matrix representation. Recently, the robust b…
▽ More
Dynamical low-rank approximation has become a valuable tool to perform an on-the-fly model order reduction for prohibitively large matrix differential equations. A core ingredient is the construction of integrators that are robust to the presence of small singular values and the resulting large time derivatives of the orthogonal factors in the low-rank matrix representation. Recently, the robust basis-update & Galerkin (BUG) class of integrators has been introduced. These methods require no steps that evolve the solution backward in time, often have favourable structure-preserving properties, and allow for parallel time-updates of the low-rank factors. The BUG framework is flexible enough to allow for adaptations to these and further requirements. However, the BUG methods presented so far have only first-order robust error bounds. This work proposes a second-order BUG integrator for dynamical low-rank approximation based on the midpoint rule. The integrator first performs a half-step with a first-order BUG integrator, followed by a Galerkin update with a suitably augmented basis. We prove a robust second-order error bound which in addition shows an improved dependence on the normal component of the vector field. These rigorous results are illustrated and complemented by a number of numerical experiments.
△ Less
Submitted 13 February, 2024;
originally announced February 2024.
-
Construction of high-order conservative basis-update and Galerkin dynamical low-rank integrators
Authors:
Lukas Einkemmer,
Jonas Kusch,
Steffen Schotthöfer
Abstract:
Numerical simulations of kinetic problems can become prohibitively expensive due to their large memory requirements and computational costs. A method that has proven to successfully reduce these costs is the dynamical low-rank approximation (DLRA). A major accomplishment in the field of DLRA has been the derivation of robust time integrators that are not limited by the stiffness of the DLRA evolut…
▽ More
Numerical simulations of kinetic problems can become prohibitively expensive due to their large memory requirements and computational costs. A method that has proven to successfully reduce these costs is the dynamical low-rank approximation (DLRA). A major accomplishment in the field of DLRA has been the derivation of robust time integrators that are not limited by the stiffness of the DLRA evolution equations. One key question is whether such robust time integrators can be made locally conservative, i.e., can they preserve the invariants and associated conservation laws of the original problem? In this work, we propose extensions to commonly used basis-update \& Galerkin (BUG) integrators that preserve invariants of the solution as well as the associated conservation laws with little or no additional computational cost. This approach requires only minor modifications of existing implementations. The properties of these integrators are investigated by performing numerical simulations in radiation transport and plasma physics.
△ Less
Submitted 14 June, 2025; v1 submitted 10 November, 2023;
originally announced November 2023.
-
Large-Scale Bottom-Up Fabricated 3D Nonlinear Photonic Crystals
Authors:
Viola Valentina Vogler-Neuling,
Ülle-Linda Talts,
Rebecca Ferraro,
Helena Weigand,
Giovanni Finco,
Joel Winiger,
Peter Benedek,
Justine Kusch,
Artemios Karvounis,
Vanessa Wood,
Jürg Leuthold,
Rachel Grange
Abstract:
Nonlinear optical effects are used to generate coherent light at wavelengths difficult to reach with lasers. Materials periodically poled or nanostructured in the nonlinear susceptibility in three spatial directions are called 3D nonlinear photonic crystals (NPhCs). They enable enhanced nonlinear optical conversion efficiencies, emission control, and simultaneous generation of nonlinear wavelength…
▽ More
Nonlinear optical effects are used to generate coherent light at wavelengths difficult to reach with lasers. Materials periodically poled or nanostructured in the nonlinear susceptibility in three spatial directions are called 3D nonlinear photonic crystals (NPhCs). They enable enhanced nonlinear optical conversion efficiencies, emission control, and simultaneous generation of nonlinear wavelengths. The chemical inertness of efficient second-order nonlinear materials ($χ^{(2)}$) prohibited their nanofabrication until 2018. The current method is restricted to top-down laser-based techniques limiting the periodicity along z-axis to 10 um. We demonstrate the first bottom-up fabricated 3D NPhC in sol-gel derived barium titanate by soft-nanoimprint lithography: a woodpile with eight layers and periodicities of 1 um (xy-plane) and 300 nm (z-plane). The surface areas exceed $5.3\cdot 10^4$ um^2, which is two orders of magnitude larger than the state-of-the-art. This study is expected to initiate bottom-up fabrication of 3D NPhCs with a supremely strong and versatile nonlinear response.
△ Less
Submitted 5 October, 2023;
originally announced October 2023.
-
Energy stable and conservative dynamical low-rank approximation for the Su-Olson problem
Authors:
Lena Baumann,
Lukas Einkemmer,
Christian Klingenberg,
Jonas Kusch
Abstract:
Computational methods for thermal radiative transfer problems exhibit high computational costs and a prohibitive memory footprint when the spatial and directional domains are finely resolved. A strategy to reduce such computational costs is dynamical low-rank approximation (DLRA), which represents and evolves the solution on a low-rank manifold, thereby significantly decreasing computational and m…
▽ More
Computational methods for thermal radiative transfer problems exhibit high computational costs and a prohibitive memory footprint when the spatial and directional domains are finely resolved. A strategy to reduce such computational costs is dynamical low-rank approximation (DLRA), which represents and evolves the solution on a low-rank manifold, thereby significantly decreasing computational and memory requirements. Efficient discretizations for the DLRA evolution equations need to be carefully constructed to guarantee stability while enabling mass conservation. In this work, we focus on the Su-Olson closure leading to a linearized internal energy model and derive a stable discretization through an implicit coupling of internal energy and particle density. Moreover, we propose a rank-adaptive strategy to preserve local mass conservation. Numerical results are presented which showcase the accuracy and efficiency of the proposed low-rank method compared to the solution of the full system.
△ Less
Submitted 23 December, 2023; v1 submitted 14 July, 2023;
originally announced July 2023.
-
Geometry-aware training of factorized layers in tensor Tucker format
Authors:
Emanuele Zangrando,
Steffen Schotthöfer,
Gianluca Ceruti,
Jonas Kusch,
Francesco Tudisco
Abstract:
Reducing parameter redundancies in neural network architectures is crucial for achieving feasible computational and memory requirements during training and inference phases. Given its easy implementation and flexibility, one promising approach is layer factorization, which reshapes weight tensors into a matrix format and parameterizes them as the product of two small rank matrices. However, this a…
▽ More
Reducing parameter redundancies in neural network architectures is crucial for achieving feasible computational and memory requirements during training and inference phases. Given its easy implementation and flexibility, one promising approach is layer factorization, which reshapes weight tensors into a matrix format and parameterizes them as the product of two small rank matrices. However, this approach typically requires an initial full-model warm-up phase, prior knowledge of a feasible rank, and it is sensitive to parameter initialization. In this work, we introduce a novel approach to train the factors of a Tucker decomposition of the weight tensors. Our training proposal proves to be optimal in locally approximating the original unfactorized dynamics independently of the initialization. Furthermore, the rank of each mode is dynamically updated during training. We provide a theoretical analysis of the algorithm, showing convergence, approximation and local descent guarantees. The method's performance is further illustrated through a variety of experiments, showing remarkable training compression rates and comparable or even better performance than the full baseline and alternative layer factorization strategies.
△ Less
Submitted 14 October, 2024; v1 submitted 30 May, 2023;
originally announced May 2023.
-
A parallel rank-adaptive integrator for dynamical low-rank approximation
Authors:
Gianluca Ceruti,
Jonas Kusch,
Christian Lubich
Abstract:
This work introduces a parallel and rank-adaptive matrix integrator for dynamical low-rank approximation. The method is related to the previously proposed rank-adaptive basis update & Galerkin (BUG) integrator but differs significantly in that all arising differential equations, both for the basis and the Galerkin coefficients, are solved in parallel. Moreover, this approach eliminates the need fo…
▽ More
This work introduces a parallel and rank-adaptive matrix integrator for dynamical low-rank approximation. The method is related to the previously proposed rank-adaptive basis update & Galerkin (BUG) integrator but differs significantly in that all arising differential equations, both for the basis and the Galerkin coefficients, are solved in parallel. Moreover, this approach eliminates the need for a potentially costly coefficient update with augmented basis matrices. The integrator also incorporates a new step rejection strategy that enhances the robustness of both the parallel integrator and the BUG integrator. By construction, the parallel integrator inherits the robust error bound of the BUG and projector-splitting integrators. Comparisons of the parallel and BUG integrators are presented by a series of numerical experiments which demonstrate the efficiency of the proposed method, for problems from radiative transfer and radiation therapy.
△ Less
Submitted 12 April, 2023;
originally announced April 2023.
-
Macro-micro decomposition for consistent and conservative model order reduction of hyperbolic shallow water moment equations: A study using POD-Galerkin and dynamical low rank approximation
Authors:
Julian Koellermeier,
Philipp Krah,
Jonas Kusch
Abstract:
Geophysical flow simulations using hyperbolic shallow water moment equations require an efficient discretization of a potentially large system of PDEs, the so-called moment system. This calls for tailored model order reduction techniques that allow for efficient and accurate simulations while guaranteeing physical properties like mass conservation. In this paper, we develop the first model reducti…
▽ More
Geophysical flow simulations using hyperbolic shallow water moment equations require an efficient discretization of a potentially large system of PDEs, the so-called moment system. This calls for tailored model order reduction techniques that allow for efficient and accurate simulations while guaranteeing physical properties like mass conservation. In this paper, we develop the first model reduction for the hyperbolic shallow water moment equations and achieve mass conservation. This is accomplished using a macro-micro decomposition of the model into a macroscopic (conservative) part and a microscopic (non-conservative) part with subsequent model reduction using either POD-Galerkin or dynamical low-rank approximation only on the microscopic (non-conservative) part. Numerical experiments showcase the performance of the new model reduction methods including high accuracy and fast computation times together with guaranteed conservation and consistency properties.
△ Less
Submitted 16 July, 2024; v1 submitted 2 February, 2023;
originally announced February 2023.
-
Asymptotic--preserving and energy stable dynamical low-rank approximation
Authors:
Lukas Einkemmer,
Jingwei Hu,
Jonas Kusch
Abstract:
Radiation transport problems are posed in a high-dimensional phase space, limiting the use of finely resolved numerical simulations. An emerging tool to efficiently reduce computational costs and memory footprint in such settings is dynamical low-rank approximation (DLRA). Despite its efficiency, numerical methods for DLRA need to be carefully constructed to guarantee stability while preserving cr…
▽ More
Radiation transport problems are posed in a high-dimensional phase space, limiting the use of finely resolved numerical simulations. An emerging tool to efficiently reduce computational costs and memory footprint in such settings is dynamical low-rank approximation (DLRA). Despite its efficiency, numerical methods for DLRA need to be carefully constructed to guarantee stability while preserving crucial properties of the original problem. Important physical effects that one likes to preserve with DLRA include capturing the diffusion limit in the high-scattering regimes as well as dissipating energy. In this work we propose and analyze a dynamical low-rank method based on the "unconventional" basis-update & Galerkin step integrator. We show that this method is asymptotic-preserving, i.e., it captures the diffusion limit, and energy stable under a CFL condition. The derived CFL condition captures the transition from the hyperbolic to the parabolic regime when approaching the diffusion limit.
△ Less
Submitted 22 December, 2022;
originally announced December 2022.
-
Low-rank lottery tickets: finding efficient low-rank neural networks via matrix differential equations
Authors:
Steffen Schotthöfer,
Emanuele Zangrando,
Jonas Kusch,
Gianluca Ceruti,
Francesco Tudisco
Abstract:
Neural networks have achieved tremendous success in a large variety of applications. However, their memory footprint and computational demand can render them impractical in application settings with limited hardware or energy resources. In this work, we propose a novel algorithm to find efficient low-rank subnetworks. Remarkably, these subnetworks are determined and adapted already during the trai…
▽ More
Neural networks have achieved tremendous success in a large variety of applications. However, their memory footprint and computational demand can render them impractical in application settings with limited hardware or energy resources. In this work, we propose a novel algorithm to find efficient low-rank subnetworks. Remarkably, these subnetworks are determined and adapted already during the training phase and the overall time and memory resources required by both training and evaluating them are significantly reduced. The main idea is to restrict the weight matrices to a low-rank manifold and to update the low-rank factors rather than the full matrix during training. To derive training updates that are restricted to the prescribed manifold, we employ techniques from dynamic model order reduction for matrix differential equations. This allows us to provide approximation, stability, and descent guarantees. Moreover, our method automatically and dynamically adapts the ranks during training to achieve the desired approximation accuracy. The efficiency of the proposed method is demonstrated through a variety of numerical experiments on fully-connected and convolutional networks.
△ Less
Submitted 18 October, 2022; v1 submitted 26 May, 2022;
originally announced May 2022.
-
KiT-RT: An extendable framework for radiative transfer and therapy
Authors:
Jonas Kusch,
Steffen Schotthöfer,
Pia Stammer,
Jannick Wolters,
Tianbai Xiao
Abstract:
In this paper we present KiT-RT (Kinetic Transport Solver for Radiation Therapy), an open-source C++ based framework for solving kinetic equations in radiation therapy applications. The aim of this code framework is to provide a collection of classical deterministic solvers for unstructured meshes that allow for easy extendability. Therefore, KiT-RT is a convenient base to test new numerical metho…
▽ More
In this paper we present KiT-RT (Kinetic Transport Solver for Radiation Therapy), an open-source C++ based framework for solving kinetic equations in radiation therapy applications. The aim of this code framework is to provide a collection of classical deterministic solvers for unstructured meshes that allow for easy extendability. Therefore, KiT-RT is a convenient base to test new numerical methods in various applications and compare them against conventional solvers. The implementation includes spherical-harmonics, minimal entropy, neural minimal entropy and discrete ordinates methods. Solution characteristics and efficiency are presented through several test cases ranging from radiation transport to electron radiation therapy. Due to the variety of included numerical methods and easy extendability, the presented open source code is attractive for both developers, who want a basis to build their own numerical solvers and users or application engineers, who want to gain experimental insights without directly interfering with the codebase.
△ Less
Submitted 12 May, 2022;
originally announced May 2022.
-
A low-rank power iteration scheme for neutron transport criticality problems
Authors:
Jonas Kusch,
Benjamin Whewell,
Ryan McClarren,
Martin Frank
Abstract:
Computing effective eigenvalues for neutron transport often requires a fine numerical resolution. The main challenge of such computations is the high memory effort of classical solvers, which limits the accuracy of chosen discretizations. In this work, we derive a method for the computation of effective eigenvalues when the underlying solution has a low-rank structure. This is accomplished by util…
▽ More
Computing effective eigenvalues for neutron transport often requires a fine numerical resolution. The main challenge of such computations is the high memory effort of classical solvers, which limits the accuracy of chosen discretizations. In this work, we derive a method for the computation of effective eigenvalues when the underlying solution has a low-rank structure. This is accomplished by utilizing dynamical low-rank approximation (DLRA), which is an efficient strategy to derive time evolution equations for low-rank solution representations. The main idea is to interpret the iterates of the classical inverse power iteration as pseudo-time steps and apply the DLRA concepts in this framework. In our numerical experiment, we demonstrate that our method significantly reduces memory requirements while achieving the desired accuracy. Analytic investigations show that the proposed iteration scheme inherits the convergence speed of the inverse power iteration, at least for a simplified setting.
△ Less
Submitted 6 January, 2022;
originally announced January 2022.
-
A flux reconstruction stochastic Galerkin scheme for hyperbolic conservation laws
Authors:
Tianbai Xiao,
Jonas Kusch,
Julian Koellermeier,
Martin Frank
Abstract:
The study of uncertainty propagation poses a great challenge to design numerical solvers with high fidelity. Based on the stochastic Galerkin formulation, this paper addresses the idea and implementation of the first flux reconstruction scheme for hyperbolic conservation laws with random inputs. Unlike the finite volume method, the treatments in physical and random space are consistent, e.g., the…
▽ More
The study of uncertainty propagation poses a great challenge to design numerical solvers with high fidelity. Based on the stochastic Galerkin formulation, this paper addresses the idea and implementation of the first flux reconstruction scheme for hyperbolic conservation laws with random inputs. Unlike the finite volume method, the treatments in physical and random space are consistent, e.g., the modal representation of solutions based on an orthogonal polynomial basis and the nodal representation based on solution collocation points. Therefore, the numerical behaviors of the scheme in the phase space can be designed and understood uniformly. A family of filters is extended to multi-dimensional cases to mitigate the well-known Gibbs phenomenon arising from discontinuities in both physical and random space. The filter function is switched on and off by the dynamic detection of discontinuous solutions, and a slope limiter is employed to preserve the positivity of physically realizable solutions. As a result, the proposed method is able to capture stochastic cross-scale flow evolution where resolved and unresolved regions coexist. Numerical experiments including wave propagation, Burgers' shock, one-dimensional Riemann problem, and two-dimensional shock-vortex interaction problem are presented to validate the scheme. The order of convergence of the current scheme is identified. The capability of the scheme for simulating smooth and discontinuous stochastic flow dynamics is demonstrated. The open-source codes to reproduce the numerical results are available under the MIT license.
△ Less
Submitted 11 December, 2021;
originally announced December 2021.
-
A robust collision source method for rank adaptive dynamical low-rank approximation in radiation therapy
Authors:
Jonas Kusch,
Pia Stammer
Abstract:
Deterministic models for radiation transport describe the density of radiation particles moving through a background material. In radiation therapy applications, the phase space of this density is composed of energy, spatial position and direction of flight. The resulting six-dimensional phase space prohibits fine numerical discretizations, which are essential for the construction of accurate and…
▽ More
Deterministic models for radiation transport describe the density of radiation particles moving through a background material. In radiation therapy applications, the phase space of this density is composed of energy, spatial position and direction of flight. The resulting six-dimensional phase space prohibits fine numerical discretizations, which are essential for the construction of accurate and reliable treatment plans. In this work, we tackle the high dimensional phase space through a dynamical low-rank approximation of the particle density. Dynamical low-rank approximation (DLRA) evolves the solution on a low-rank manifold in time. Interpreting the energy variable as a pseudo-time lets us employ the DLRA framework to represent the solution of the radiation transport equation on a low-rank manifold for every energy. Stiff scattering terms are treated through an efficient implicit energy discretization and a rank adaptive integrator is chosen to dynamically adapt the rank in energy. To facilitate the use of boundary conditions and reduce the overall rank, the radiation transport equation is split into collided and uncollided particles through a collision source method. Uncollided particles are described by a directed quadrature set guaranteeing low computational costs, whereas collided particles are represented by a low-rank solution. It can be shown that the presented method is L$^2$-stable under a time step restriction which does not depend on stiff scattering terms. Moreover, the implicit treatment of scattering does not require numerical inversions of matrices. Numerical results for radiation therapy configurations as well as the line source benchmark underline the efficiency of the proposed method.
△ Less
Submitted 13 November, 2021;
originally announced November 2021.
-
On the stability of robust dynamical low-rank approximations for hyperbolic problems
Authors:
Jonas Kusch,
Lukas Einkemmer,
Gianluca Ceruti
Abstract:
The dynamical low-rank approximation (DLRA) is used to treat high-dimensional problems that arise in such diverse fields as kinetic transport and uncertainty quantification. Even though it is well known that certain spatial and temporal discretizations when combined with the DLRA approach can result in numerical instability, this phenomenon is poorly understood. In this paper we perform a $L^2$ st…
▽ More
The dynamical low-rank approximation (DLRA) is used to treat high-dimensional problems that arise in such diverse fields as kinetic transport and uncertainty quantification. Even though it is well known that certain spatial and temporal discretizations when combined with the DLRA approach can result in numerical instability, this phenomenon is poorly understood. In this paper we perform a $L^2$ stability analysis for the corresponding nonlinear equations of motion. This reveals the source of the instability for the projector splitting integrator when first discretizing the equations and then applying the DLRA. Based on this we propose a projector splitting integrator, based on applying DLRA to the continuous system before performing the discretization, that recovers the classic CFL condition. We also show that the unconventional integrator has more favorable stability properties and explain why the projector splitting integrator performs better when approximating higher moments, while the unconventional integrator is generally superior for first order moments. Furthermore, an efficient and stable dynamical low-rank update for the scattering term in kinetic transport is proposed. Numerical experiments for kinetic transport and uncertainty quantification, which confirm the results of the stability analysis, are presented.
△ Less
Submitted 15 July, 2021;
originally announced July 2021.
-
A Realizable Filtered Intrusive Polynomial Moment Method
Authors:
Graham Alldredge,
Martin Frank,
Jonas Kusch,
Ryan McClarren
Abstract:
Intrusive uncertainty quantification methods for hyperbolic problems exhibit spurious oscillations at shocks, which leads to a significant reduction of the overall approximation quality. Furthermore, a challenging task is to preserve hyperbolicity of the gPC moment system. An intrusive method which guarantees hyperbolicity is the intrusive polynomial moment (IPM) method, which performs the gPC exp…
▽ More
Intrusive uncertainty quantification methods for hyperbolic problems exhibit spurious oscillations at shocks, which leads to a significant reduction of the overall approximation quality. Furthermore, a challenging task is to preserve hyperbolicity of the gPC moment system. An intrusive method which guarantees hyperbolicity is the intrusive polynomial moment (IPM) method, which performs the gPC expansion on the entropy variables. The method, while still being subject to oscillations, requires solving a convex optimization problem in every spatial cell and every time step. The aim of this work is to mitigate oscillations in the IPM solution by applying filters. Filters reduce oscillations by damping high order gPC coefficients. Naive filtering, however, may lead to unrealizable moments, which means that the IPM optimization problem does not have a solution and the method breaks down. In this paper, we propose and analyze two separate strategies to guarantee the existence of a solution to the IPM problem. First, we propose a filter which maintains realizability by being constructed from an underlying Fokker-Planck equation. Second, we regularize the IPM optimization problem to be able to cope with non-realizable gPC coefficients. Consequently, standard filters can be applied to the regularized IPM method. We demonstrate numerical results for the two strategies by investigating the Euler equations with uncertain shock structures in one- and two-dimensional spatial settings. We are able to show a significant reduction of spurious oscillations by the proposed filters.
△ Less
Submitted 16 May, 2021;
originally announced May 2021.
-
Dynamical low-rank approximation for Burgers' equation with uncertainty
Authors:
Jonas Kusch,
Gianluca Ceruti,
Lukas Einkemmer,
Martin Frank
Abstract:
Quantifying uncertainties in hyperbolic equations is a source of several challenges. First, the solution forms shocks leading to oscillatory behaviour in the numerical approximation of the solution. Second, the number of unknowns required for an effective discretization of the solution grows exponentially with the dimension of the uncertainties, yielding high computational costs and large memory r…
▽ More
Quantifying uncertainties in hyperbolic equations is a source of several challenges. First, the solution forms shocks leading to oscillatory behaviour in the numerical approximation of the solution. Second, the number of unknowns required for an effective discretization of the solution grows exponentially with the dimension of the uncertainties, yielding high computational costs and large memory requirements. An efficient representation of the solution via adequate basis functions permits to tackle these difficulties. The generalized polynomial chaos (gPC) polynomials allow such an efficient representation when the distribution of the uncertainties is known. These distributions are usually only available for input uncertainties such as initial conditions, therefore the efficiency of this ansatz can get lost during runtime. In this paper, we make use of the dynamical low-rank approximation (DLRA) to obtain a memory-wise efficient solution approximation on a lower dimensional manifold. We investigate the use of the matrix projector-splitting integrator and the unconventional integrator for dynamical low-rank approximation, deriving separate time evolution equations for the spatial and uncertain basis functions, respectively. This guarantees an efficient approximation of the solution even if the underlying probability distributions change over time. Furthermore, filters to mitigate the appearance of spurious oscillations are implemented, and a strategy to enforce boundary conditions is introduced. The proposed methodology is analyzed for Burgers' equation equipped with uncertain initial values represented by a two-dimensional random vector. The numerical results show a reduction of the memory requirements, and that the important characteristics of the original system are well captured.
△ Less
Submitted 10 May, 2021;
originally announced May 2021.
-
A rank-adaptive robust integrator for dynamical low-rank approximation
Authors:
Gianluca Ceruti,
Jonas Kusch,
Christian Lubich
Abstract:
A rank-adaptive integrator for the dynamical low-rank approximation of matrix and tensor differential equations is presented. The fixed-rank integrator recently proposed by two of the authors is extended to allow for an adaptive choice of the rank, using subspaces that are generated by the integrator itself. The integrator first updates the evolving bases and then does a Galerkin step in the subsp…
▽ More
A rank-adaptive integrator for the dynamical low-rank approximation of matrix and tensor differential equations is presented. The fixed-rank integrator recently proposed by two of the authors is extended to allow for an adaptive choice of the rank, using subspaces that are generated by the integrator itself. The integrator first updates the evolving bases and then does a Galerkin step in the subspace generated by both the new and old bases, which is followed by rank truncation to a given tolerance. It is shown that the adaptive low-rank integrator retains the exactness, robustness and symmetry-preserving properties of the previously proposed fixed-rank integrator. Beyond that, up to the truncation tolerance, the rank-adaptive integrator preserves the norm when the differential equation does, it preserves the energy for Schrödinger equations and Hamiltonian systems, and it preserves the monotonic decrease of the functional in gradient flows. Numerical experiments illustrate the behaviour of the rank-adaptive integrator.
△ Less
Submitted 12 April, 2021;
originally announced April 2021.
-
Oscillation Mitigation of Hyperbolicity-Preserving Intrusive Uncertainty Quantification Methods for Systems of Conservation Laws
Authors:
Jonas Kusch,
Louisa Schlachter
Abstract:
In this article we study intrusive uncertainty quantification schemes for systems of conservation laws with uncertainty. Standard intrusive methods lead to oscillatory solutions which sometimes even cause the loss of hyperbolicity. We consider the stochastic Galerkin scheme, in which we filter the coefficients of the polynomial expansion in order to reduce oscillations. We further apply the multi-…
▽ More
In this article we study intrusive uncertainty quantification schemes for systems of conservation laws with uncertainty. Standard intrusive methods lead to oscillatory solutions which sometimes even cause the loss of hyperbolicity. We consider the stochastic Galerkin scheme, in which we filter the coefficients of the polynomial expansion in order to reduce oscillations. We further apply the multi-element approach and ensure the preservation of hyperbolic solutions through the hyperbolicity limiter. In addition to that, we study the intrusive polynomial moment method, which guarantees hyperbolicity at the cost of solving an optimization problem in every spatial cell and every time step. To reduce numerical costs, we apply the multi-element ansatz to IPM. This ansatz decouples the optimization problems of all multi elements. Thus, we are able to significantly decrease computational costs while improving parallelizability. We finally evaluate these oscillation mitigating approaches on various numerical examples such as a NACA airfoil and a nozzle test case for the two-dimensional Euler equations. In our numerical experiments, we observe the mitigation of spurious artifacts. Furthermore, using the multi-element ansatz for IPM significantly reduces computational costs.
△ Less
Submitted 22 May, 2021; v1 submitted 18 August, 2020;
originally announced August 2020.
-
Intrusive acceleration strategies for Uncertainty Quantification for hyperbolic systems of conservation laws
Authors:
Jonas Kusch,
Jannick Wolters,
Martin Frank
Abstract:
Methods for quantifying the effects of uncertainties in hyperbolic problems can be divided into intrusive and non-intrusive techniques. Non-intrusive methods allow the usage of a given deterministic solver in a black-box manner, while being embarrassingly parallel. However, avoiding intrusive modifications of a given solver takes away the ability to use several inherently intrusive numerical accel…
▽ More
Methods for quantifying the effects of uncertainties in hyperbolic problems can be divided into intrusive and non-intrusive techniques. Non-intrusive methods allow the usage of a given deterministic solver in a black-box manner, while being embarrassingly parallel. However, avoiding intrusive modifications of a given solver takes away the ability to use several inherently intrusive numerical acceleration tools. Moreover, intrusive methods are expected to reach a given accuracy with a smaller number of unknowns compared to non-intrusive techniques. This effect is amplified in settings with high dimensional uncertainty. A downside of intrusive methods is however the need to guarantee hyperbolicity of the resulting moment system. In contrast to stochastic-Galerkin (SG), the Intrusive Polynomial Moment (IPM) method is able to maintain hyperbolicity at the cost of solving an optimization problem in every spatial cell and every time step. In this work, we propose several acceleration techniques for intrusive methods and study their advantages and shortcomings compared to the non-intrusive Stochastic Collocation method. When solving steady problems with IPM, the numerical costs arising from repeatedly solving the IPM optimization problem can be reduced by using concepts from PDE-constrained optimization. Additionally, we propose an adaptive implementation and efficient parallelization strategy of the IPM method. The effectiveness of the proposed adaptations is demonstrated for multi-dimensional uncertainties in fluid dynamics applications, resulting in the observation of requiring a smaller number of unknowns to achieve a given accuracy when using intrusive methods. Furthermore, using the proposed acceleration techniques, our implementation reaches a given accuracy faster than Stochastic Collocation.
△ Less
Submitted 16 January, 2020; v1 submitted 19 December, 2019;
originally announced December 2019.
-
Ray Effect Mitigation for the Discrete Ordinates Method Using Artificial Scattering
Authors:
Martin Frank,
Jonas Kusch,
Thomas Camminady,
Cory D. Hauck
Abstract:
Solving the radiative transfer equation with the discrete ordinates (S$_N$) method leads to a non-physical imprint of the chosen quadrature set on the solution. To mitigate these so-called ray effects, we propose a modification of the S$_N$ method, which we call artificial scattering S$_N$ (as-S$_N$). The method adds an artificial forward-peaked scattering operator which generates angular diffusio…
▽ More
Solving the radiative transfer equation with the discrete ordinates (S$_N$) method leads to a non-physical imprint of the chosen quadrature set on the solution. To mitigate these so-called ray effects, we propose a modification of the S$_N$ method, which we call artificial scattering S$_N$ (as-S$_N$). The method adds an artificial forward-peaked scattering operator which generates angular diffusion to the solution and thereby mitigates ray effects. Similar to artificial viscosity for spatial discretizations, the additional term vanishes as the number of ordinates approaches infinity. Our method allows an efficient implementation of explicit and implicit time integration according to standard S$_N$ solver technology. For two test cases, we demonstrate a significant reduction of the error for the as-S$_N$ method when compared to the standard S$_N$ method, both for explicit and implicit computations. Furthermore, we show that a prescribed numerical precision can be reached with less memory due to the reduction in the number of ordinates.
△ Less
Submitted 21 November, 2019; v1 submitted 20 November, 2019;
originally announced November 2019.
-
Ray Effect Mitigation for the Discrete Ordinates Method through Quadrature Rotation
Authors:
Thomas Camminady,
Martin Frank,
Kerstin Küpper,
Jonas Kusch
Abstract:
Solving the radiation transport equation is a challenging task, due to the high dimensionality of the solution's phase space. The commonly used discrete ordinates (S$_N$) method suffers from ray effects which result from a break in rotational symmetry from the finite set of directions chosen by S$_N$. The spherical harmonics (P$_N$) equations, on the other hand, preserve rotational symmetry, but c…
▽ More
Solving the radiation transport equation is a challenging task, due to the high dimensionality of the solution's phase space. The commonly used discrete ordinates (S$_N$) method suffers from ray effects which result from a break in rotational symmetry from the finite set of directions chosen by S$_N$. The spherical harmonics (P$_N$) equations, on the other hand, preserve rotational symmetry, but can produce negative particle densities. The discrete ordinates (S$_N$) method, in turn, by construction ensures non-negative particle densities.
In this paper we present a modified version of the S$_N$ method, the rotated S$_N$ (rS$_N$) method. Compared to S$_N$, we add a rotation and interpolation step for the angular quadrature points and the respective function values after every time step. Thereby, the number of directions on which the solution evolves is effectively increased and ray effects are mitigated. Solution values on rotated ordinates are computed by an interpolation step. Implementation details are provided and in our experiments the rotation/interpolation step only adds 5% to 10% to the runtime of the S$_N$ method. We apply the rS$_N$ method to the line-source and a lattice test case, both being prone to ray-effects. Ray effects are reduced significantly, even for small numbers of quadrature points. The rS$_N$ method yields qualitatively similar solutions to the S$_N$ method with less than a third of the number of quadrature points, both for the line-source and the lattice problem. The code used to produce our results is freely available and can be downloaded.
△ Less
Submitted 20 August, 2018; v1 submitted 17 August, 2018;
originally announced August 2018.
-
Filtered Stochastic Galerkin Methods For Hyperbolic Equations
Authors:
Jonas Kusch,
Ryan G. McClarren,
Martin Frank
Abstract:
Uncertainty Quantification for nonlinear hyperbolic problems becomes a challenging task in the vicinity of shocks. Standard intrusive methods lead to oscillatory solutions and can result in non-hyperbolic moment systems. The intrusive polynomial moment (IPM) method guarantees hyperbolicity but comes at higher numerical costs. In this paper, we filter the gPC coefficients of the Stochastic Galerkin…
▽ More
Uncertainty Quantification for nonlinear hyperbolic problems becomes a challenging task in the vicinity of shocks. Standard intrusive methods lead to oscillatory solutions and can result in non-hyperbolic moment systems. The intrusive polynomial moment (IPM) method guarantees hyperbolicity but comes at higher numerical costs. In this paper, we filter the gPC coefficients of the Stochastic Galerkin (SG) approximation, which allows a numerically cheap reduction of oscillations. The derived filter is based on Lasso regression which sets small gPC coefficients of high order to zero. We adaptively choose the filter strength to obtain a zero-valued highest order moment, which allows optimality of the corresponding optimization problem. The filtered SG method is tested for Burgers' and the Euler equations. Results show a reduction of oscillations at shocks, which leads to an improved approximation of expectation values and the variance compared to SG and IPM.
△ Less
Submitted 2 October, 2018; v1 submitted 2 August, 2018;
originally announced August 2018.
-
An Approximate Newton Smoothing Method for Shape Optimization
Authors:
Jonas Kusch,
Stephan Schmidt,
Nicolas R. Gauger
Abstract:
A novel methodology to efficiently approximate the Hessian for numerical shape optimization is considered. The method enhances operator symbol approximations by including body fitted coordinates and spatially changing symbols in a semi automated framework based on local Fourier analysis. Contrary to classical operator symbol methods, the proposed strategy will identify areas in which a non-smooth…
▽ More
A novel methodology to efficiently approximate the Hessian for numerical shape optimization is considered. The method enhances operator symbol approximations by including body fitted coordinates and spatially changing symbols in a semi automated framework based on local Fourier analysis. Contrary to classical operator symbol methods, the proposed strategy will identify areas in which a non-smooth design is physically meaningful and will automatically turn off smoothing in these regions. A new strategy to also numerically identify the analytic symbol is derived, extending the procedure to a wide variety of problems. The effectiveness is demonstrated by using drag minimization in Stokes and Navier-Stokes flows.
△ Less
Submitted 30 July, 2018;
originally announced July 2018.
-
The K2-138 System: A Near-Resonant Chain of Five Sub-Neptune Planets Discovered by Citizen Scientists
Authors:
Jessie L. Christiansen,
Ian J. M. Crossfield,
Geert Barentsen,
Chris J. Lintott,
Thomas Barclay,
Brooke D. Simmons,
Erik Petigura,
Joshua E. Schlieder,
Courtney D. Dressing,
Andrew Vanderburg,
David R. Ciardi,
Campbell Allen,
Adam McMaster,
Grant Miller,
Martin Veldthuis,
Sarah Allen,
Zach Wolfenbarger,
Brian Cox,
Julia Zemiro,
Andrew W. Howard,
John Livingston,
Evan Sinukoff,
Timothy Catron,
Andrew Grey,
Joshua J. E. Kusch
, et al. (3 additional authors not shown)
Abstract:
K2-138 is a moderately bright (V = 12.2, K = 10.3) main sequence K-star observed in Campaign 12 of the NASA K2 mission. It hosts five small (1.6-3.3R_Earth) transiting planets in a compact architecture. The periods of the five planets are 2.35 d, 3.56 d, 5.40 d, 8.26 d, and 12.76 d, forming an unbroken chain of near 3:2 resonances. Although we do not detect the predicted 2-5 minute transit timing…
▽ More
K2-138 is a moderately bright (V = 12.2, K = 10.3) main sequence K-star observed in Campaign 12 of the NASA K2 mission. It hosts five small (1.6-3.3R_Earth) transiting planets in a compact architecture. The periods of the five planets are 2.35 d, 3.56 d, 5.40 d, 8.26 d, and 12.76 d, forming an unbroken chain of near 3:2 resonances. Although we do not detect the predicted 2-5 minute transit timing variations with the K2 timing precision, they may be observable by higher cadence observations with, for example, Spitzer or CHEOPS. The planets are amenable to mass measurement by precision radial velocity measurements, and therefore K2-138 could represent a new benchmark systems for comparing radial velocity and TTV masses. K2-138 is the first exoplanet discovery by citizen scientists participating in the Exoplanet Explorers project on the Zooniverse platform.
△ Less
Submitted 19 January, 2018; v1 submitted 11 January, 2018;
originally announced January 2018.
-
Maximum-principle-satisfying second-order Intrusive Polynomial Moment scheme
Authors:
Jonas Kusch,
Graham W. Alldredge,
Martin Frank
Abstract:
Using standard intrusive techniques when solving hyperbolic conservation laws with uncertainties can lead to oscillatory solutions as well as nonhyperbolic moment systems. The Intrusive Polynomial Moment (IPM) method ensures hyperbolicity of the moment system while restricting oscillatory over- and undershoots of specified bounds. In this contribution, we derive a second-order discretization of th…
▽ More
Using standard intrusive techniques when solving hyperbolic conservation laws with uncertainties can lead to oscillatory solutions as well as nonhyperbolic moment systems. The Intrusive Polynomial Moment (IPM) method ensures hyperbolicity of the moment system while restricting oscillatory over- and undershoots of specified bounds. In this contribution, we derive a second-order discretization of the IPM moment system which fulfills the maximum principle. This task is carried out by investigating violations of the specified bounds due to the errors from the numerical optimization required by the scheme. This analysis gives weaker conditions on the entropy that is used, allowing the choice of an entropy which enables choosing the exact minimal and maximal value of the initial condition as bounds. Solutions calculated with the derived scheme are nonoscillatory while fulfilling the maximum principle. The second-order accuracy of our scheme leads to significantly reduced numerical costs.
△ Less
Submitted 2 October, 2018; v1 submitted 19 December, 2017;
originally announced December 2017.
