-
Rapidly Rotating Wall-Mode Convection
Authors:
Geoffrey M. Vasil,
Keaton J. Burns,
Daniel Lecoanet,
Jeffrey S. Oishi,
Benjamin P. Brown,
Keith Julien
Abstract:
In the rapidly rotating limit, we derive a balanced set of reduced equations governing the strongly nonlinear development of the convective wall-mode instability in the interior of a general container. The model illustrates that wall-mode convection is a multiscale phenomenon where the dynamics of the bulk interior diagnostically determine the small-scale dynamics within Stewartson boundary layers…
▽ More
In the rapidly rotating limit, we derive a balanced set of reduced equations governing the strongly nonlinear development of the convective wall-mode instability in the interior of a general container. The model illustrates that wall-mode convection is a multiscale phenomenon where the dynamics of the bulk interior diagnostically determine the small-scale dynamics within Stewartson boundary layers at the sidewalls. The sidewall boundary layers feedback on the interior via a nonlinear lateral heat-flux boundary condition, providing a closed system. Outside the asymptotically thin boundary layer, the convective modes connect to a dynamical interior that maintains scales set by the domain geometry. In many ways, the final system of equations resembles boundary-forced planetary geostrophic baroclinic dynamics coupled with barotropic quasi-geostrophic vorticity. The reduced system contains the results from previous linear instability theory but captured in an elementary fashion, providing a new avenue for investigating wall-mode convection in the strongly nonlinear regime. We also derive the dominant Ekman-flux correction to the onset Rayleigh number for large Taylor number, Ra ~ 31.8 Ta^(1/2) - 4.43 Ta^(5/12) for no-slip boundaries. We demonstrate some of the reduced model's nonlinear dynamics with numerical simulations in a cylindrical container.
△ Less
Submitted 31 October, 2024; v1 submitted 30 September, 2024;
originally announced September 2024.
-
Iterative Methods for Navier--Stokes Inverse Problems
Authors:
Liam O'Connor,
Daniel Lecoanet,
Evan H. Anders,
Kyle C. Augustson,
Keaton J. Burns,
Geoffrey M. Vasil,
Jeffrey S. Oishi,
Benjamin P. Brown
Abstract:
Even when the partial differential equation underlying a physical process can be evolved forward in time, the retrospective (backward in time) inverse problem often has its own challenges and applications. Direct Adjoint Looping (DAL) is the defacto approach for solving retrospective inverse problems, but it has not been applied to deterministic retrospective Navier--Stokes inverse problems in 2D…
▽ More
Even when the partial differential equation underlying a physical process can be evolved forward in time, the retrospective (backward in time) inverse problem often has its own challenges and applications. Direct Adjoint Looping (DAL) is the defacto approach for solving retrospective inverse problems, but it has not been applied to deterministic retrospective Navier--Stokes inverse problems in 2D or 3D. In this paper, we demonstrate that DAL is ill-suited for solving retrospective 2D Navier--Stokes inverse problems. Alongside DAL, we study two other iterative methods: Simple Backward Integration (SBI) and the Quasi-Reversible Method (QRM). Our iterative SBI approach is novel while iterative QRM has previously been used. Using these three iterative methods, we solve two retrospective inverse problems: 1D Korteweg--de Vries--Burgers (decaying nonlinear wave) and 2D Navier--Stokes (unstratified Kelvin--Helmholtz vortex). In both cases, SBI and QRM reproduce the target final states more accurately and in fewer iterations than DAL. We attribute this performance gap to additional terms present in SBI and QRM's respective backward integrations which are absent in DAL.
△ Less
Submitted 1 March, 2024;
originally announced March 2024.
-
Rational function approximation with normalized positive denominators
Authors:
James Chok,
Geoffrey M. Vasil
Abstract:
Rational function approximations provide a simple but flexible alternative to polynomial approximation, allowing one to capture complex non-linearities without oscillatory artifacts. However, there have been few attempts to use rational functions on noisy data due to the likelihood of creating spurious singularities. To avoid the creation of singularities, we use Bernstein polynomials and appropri…
▽ More
Rational function approximations provide a simple but flexible alternative to polynomial approximation, allowing one to capture complex non-linearities without oscillatory artifacts. However, there have been few attempts to use rational functions on noisy data due to the likelihood of creating spurious singularities. To avoid the creation of singularities, we use Bernstein polynomials and appropriate conditions on their coefficients to force the denominator to be strictly positive. While this reduces the range of rational polynomials that can be expressed, it keeps all the benefits of rational functions while maintaining the robustness of polynomial approximation in noisy data scenarios.
Our numerical experiments on noisy data show that existing rational approximation methods continually produce spurious poles inside the approximation domain. This contrasts our method, which cannot create poles in the approximation domain and provides better fits than a polynomial approximation and even penalized splines on functions with multiple variables. Moreover, guaranteeing pole-free in an interval is critical for estimating non-constant coefficients when numerically solving differential equations using spectral methods. This provides a compact representation of the original differential equation, allowing numeric solvers to achieve high accuracy quickly, as seen in our experiments.
△ Less
Submitted 3 April, 2025; v1 submitted 18 October, 2023;
originally announced October 2023.
-
Convex optimization over a probability simplex
Authors:
James Chok,
Geoffrey M. Vasil
Abstract:
We propose a new iteration scheme, the Cauchy-Simplex, to optimize convex problems over the probability simplex $\{w\in\mathbb{R}^n\ |\ \sum_i w_i=1\ \textrm{and}\ w_i\geq0\}$. Specifically, we map the simplex to the positive quadrant of a unit sphere, envisage gradient descent in latent variables, and map the result back in a way that only depends on the simplex variable. Moreover, proving rigoro…
▽ More
We propose a new iteration scheme, the Cauchy-Simplex, to optimize convex problems over the probability simplex $\{w\in\mathbb{R}^n\ |\ \sum_i w_i=1\ \textrm{and}\ w_i\geq0\}$. Specifically, we map the simplex to the positive quadrant of a unit sphere, envisage gradient descent in latent variables, and map the result back in a way that only depends on the simplex variable. Moreover, proving rigorous convergence results in this formulation leads inherently to tools from information theory (e.g., cross-entropy and KL divergence). Each iteration of the Cauchy-Simplex consists of simple operations, making it well-suited for high-dimensional problems. In continuous time, we prove that $f(x_T)-f(x^*) = {O}(1/T)$ for differentiable real-valued convex functions, where $T$ is the number of time steps and $w^*$ is the optimal solution. Numerical experiments of projection onto convex hulls show faster convergence than similar algorithms. Finally, we apply our algorithm to online learning problems and prove the convergence of the average regret for (1) Prediction with expert advice and (2) Universal Portfolios.
△ Less
Submitted 3 April, 2025; v1 submitted 15 May, 2023;
originally announced May 2023.
-
Orthogonal signed-distance coordinates and vector calculus near evolving curves and surfaces
Authors:
Eric W. Hester,
Geoffrey M. Vasil
Abstract:
We provide an elementary derivation of an orthogonal coordinate system for boundary layers around evolving smooth surfaces and curves based on the signed-distance function. We go beyond previous works on the signed-distance function and collate useful vector calculus identities for these coordinates. These results and provided code enable consistent accounting of geometric effects in the derivatio…
▽ More
We provide an elementary derivation of an orthogonal coordinate system for boundary layers around evolving smooth surfaces and curves based on the signed-distance function. We go beyond previous works on the signed-distance function and collate useful vector calculus identities for these coordinates. These results and provided code enable consistent accounting of geometric effects in the derivation of boundary layer asymptotics for a wide range of physical systems.
△ Less
Submitted 7 February, 2023; v1 submitted 6 February, 2023;
originally announced February 2023.
-
Corner cases of the tau method: symmetrically imposing boundary conditions on hypercubes
Authors:
Keaton J. Burns,
Daniel Fortunato,
Keith Julien,
Geoffrey M. Vasil
Abstract:
Polynomial spectral methods produce fast, accurate, and flexible solvers for broad ranges of PDEs with one bounded dimension, where the incorporation of general boundary conditions is well understood. However, automating extensions to domains with multiple bounded dimensions is challenging because of difficulties in imposing boundary conditions at shared edges and corners. Past work has included v…
▽ More
Polynomial spectral methods produce fast, accurate, and flexible solvers for broad ranges of PDEs with one bounded dimension, where the incorporation of general boundary conditions is well understood. However, automating extensions to domains with multiple bounded dimensions is challenging because of difficulties in imposing boundary conditions at shared edges and corners. Past work has included various workarounds, such as the anisotropic inclusion of partial boundary data at shared edges or approaches that only work for specific boundary conditions. Here we present a general system for imposing boundary conditions for elliptic equations on hypercubes. We take an approach based on the generalized tau method, which allows for a wide range of boundary conditions for many different spectral schemes. The generalized tau method has the distinct advantage that the specified polynomial residual determines the exact algebraic solution; afterwards, any stable numerical scheme will find the same result. We can, therefore, provide one-to-one comparisons to traditional collocation and Galerkin methods within the tau framework. As an essential requirement, we add specific tau corrections to the boundary conditions, in addition to the bulk PDE, which produce a unique set of compatible boundary data at shared subsurfaces. Our approach works with general boundary conditions that commute on intersecting subsurfaces, including Dirichlet, Neumann, Robin, and any combination of these on all boundaries. The boundary tau corrections can be made hyperoctahedrally symmetric and easily incorporated into existing solvers. We present the method explicitly for the Poisson equation in two and three dimensions and describe its extension to arbitrary elliptic equations (e.g. biharmonic) in any dimension.
△ Less
Submitted 23 June, 2024; v1 submitted 30 November, 2022;
originally announced November 2022.
-
A gyroscopic polynomial basis in the sphere
Authors:
Abram C. Ellison,
Keith Julien,
Geoffrey M. Vasil
Abstract:
Standard spectral codes for full sphere dynamics utilize a combination of spherical harmonics and a suitableradial basis to represent fluid variables. These basis functions have a rotational invariance not present ingeophysical flows. Gyroscopic alignment - alignment of dynamics along the axis of rotation - is ahallmark of geophysical fluids in the rapidly rotating regime. The Taylor-Proudman theo…
▽ More
Standard spectral codes for full sphere dynamics utilize a combination of spherical harmonics and a suitableradial basis to represent fluid variables. These basis functions have a rotational invariance not present ingeophysical flows. Gyroscopic alignment - alignment of dynamics along the axis of rotation - is ahallmark of geophysical fluids in the rapidly rotating regime. The Taylor-Proudman theorem, resultingfrom a dominant balance of the Coriolis force and the pressure gradient force, yields nearly invariant flows along this axial direction.In this paper we tailor a coordinate system to the cylindrical structures found in rotating spherical flows.This "spherindrical" coordinate system yields a natural hierarchy of basis functions, composed of Jacobi polynomialsin the radial and vertical direction, regular throughout the ball.We expand fluid variables using this basis and utilize sparse Jacobi polynomial algebra to implement all operatorsrelevant for partial differential equations in the spherical setting. We demonstrate the representation power ofthe basis in three eigenvalue problems for rotating fluids.
△ Less
Submitted 5 April, 2022;
originally announced April 2022.
-
On the stability of isothermal shocks in black hole accretion disks
Authors:
Eric W. Hester,
Geoffrey M. Vasil,
Martin Wechselberger
Abstract:
Most black holes possess accretion disks. Models of such disks inform observations and constrain the properties of the black holes and their surrounding medium. Here, we study isothermal shocks in a thin black hole accretion flow. Modelling infinitesimal molecular viscosity allows the use of multiple-scales matched asymptotic methods. We thus derive the first explicit calculations of isothermal sh…
▽ More
Most black holes possess accretion disks. Models of such disks inform observations and constrain the properties of the black holes and their surrounding medium. Here, we study isothermal shocks in a thin black hole accretion flow. Modelling infinitesimal molecular viscosity allows the use of multiple-scales matched asymptotic methods. We thus derive the first explicit calculations of isothermal shock stability. We find that the inner shock is always unstable, and the outer shock is always stable. The growth/decay rates of perturbations depend only on an effective potential and the incoming--outgoing flow difference at the shock location. We give a prescription of accretion regimes in terms of angular momentum and black hole radius. Accounting for angular momentum dissipation implies unstable outer shocks in much of parameter space, even for realistic viscous Reynolds numbers of the order $\approx 10^{20}$.
△ Less
Submitted 2 December, 2021;
originally announced December 2021.
-
A study of the double pendulum using polynomial optimization
Authors:
Jeremy P Parker,
David Goluskin,
Geoffrey M Vasil
Abstract:
In dynamical systems governed by differential equations, a guarantee that trajectories emanating from a given set of initial conditions do not enter another given set can be obtained by constructing a barrier function that satisfies certain inequalities on phase space. Often these inequalities amount to nonnegativity of polynomials and can be enforced using sum-of-squares conditions, in which case…
▽ More
In dynamical systems governed by differential equations, a guarantee that trajectories emanating from a given set of initial conditions do not enter another given set can be obtained by constructing a barrier function that satisfies certain inequalities on phase space. Often these inequalities amount to nonnegativity of polynomials and can be enforced using sum-of-squares conditions, in which case barrier functions can be constructed computationally using convex optimization over polynomials. To study how well such computations can characterize sets of initial conditions in a chaotic system, we use the undamped double pendulum as an example and ask which stationary initial positions do not lead to flipping of the pendulum within a chosen time window. Computations give semialgebraic sets that are close inner approximations to the fractal set of all such initial positions.
△ Less
Submitted 10 September, 2021; v1 submitted 25 June, 2021;
originally announced June 2021.
-
Improved phase-field models of melting and dissolution in multi-component flows
Authors:
Eric W. Hester,
Louis-Alexandre Couston,
Benjamin Favier,
Keaton J. Burns,
Geoffrey M. Vasil
Abstract:
We develop and analyse the first second-order phase-field model to combine melting and dissolution in multi-component flows. This provides a simple and accurate way to simulate challenging phase-change problems in existing codes. Phase-field models simplify computation by describing separate regions using a smoothed phase field. The phase field eliminates the need for complicated discretisations t…
▽ More
We develop and analyse the first second-order phase-field model to combine melting and dissolution in multi-component flows. This provides a simple and accurate way to simulate challenging phase-change problems in existing codes. Phase-field models simplify computation by describing separate regions using a smoothed phase field. The phase field eliminates the need for complicated discretisations that track the moving phase boundary. However standard phase-field models are only first-order accurate. They often incur an error proportional to the thickness of the diffuse interface. We eliminate this dominant error by developing a general framework for asymptotic analysis of diffuse-interface methods in arbitrary geometries. With this framework we can consistently unify previous second-order phase-field models of melting and dissolution and the volume-penalty method for fluid-solid interaction. We finally validate second-order convergence of our model in two comprehensive benchmark problems using the open-source spectral code Dedalus.
△ Less
Submitted 29 June, 2020;
originally announced June 2020.
-
The "Sphered Cube": A New Method for the Solution of Partial Differential Equations in Cubical Geometry
Authors:
Keaton J. Burns,
Daniel Lecoanet,
Geoffrey M. Vasil,
Jeffrey S. Oishi,
Benjamin P. Brown
Abstract:
A new gridding technique for the solution of partial differential equations in cubical geometry is presented. The method is based on volume penalization, allowing for the imposition of a cubical geometry inside of its circumscribing sphere. By choosing to embed the cube inside of the sphere, one obtains a discretization that is free of any sharp edges or corners. Taking full advantage of the simpl…
▽ More
A new gridding technique for the solution of partial differential equations in cubical geometry is presented. The method is based on volume penalization, allowing for the imposition of a cubical geometry inside of its circumscribing sphere. By choosing to embed the cube inside of the sphere, one obtains a discretization that is free of any sharp edges or corners. Taking full advantage of the simple geometry of the sphere, spectral bases based on spin-weighted spherical harmonics and Jacobi polynomials, which properly capture the regularity of scalar, vector and tensor components in spherical coordinates, can be applied to obtain moderately efficient and accurate numerical solutions of partial differential equations in the cube. This technique demonstrates the advantages of these bases over other methods for solving PDEs in spherical coordinates. We present results for a test case of incompressible hydrodynamics in cubical geometry: Rayleigh-Bénard convection with fully Dirichlet boundary conditions. Analysis of the simulations provides what is, to our knowledge, the first result on the scaling of the heat flux with the thermal forcing for this type of convection in a cube in a sphere.
△ Less
Submitted 29 March, 2019;
originally announced March 2019.
-
Improving convergence of volume penalised fluid-solid interactions
Authors:
Eric W. Hester,
Geoffrey M. Vasil,
Keaton J. Burns
Abstract:
We analyse and improve the volume-penalty method, a simple and versatile way to model objects in fluid flows. The volume-penalty method is a kind of fictitious-domain method that approximates no-slip boundary conditions with rapid linear damping inside the object. The method can then simulate complex, moving objects in general numerical solvers without specialised algorithms or boundary-conforming…
▽ More
We analyse and improve the volume-penalty method, a simple and versatile way to model objects in fluid flows. The volume-penalty method is a kind of fictitious-domain method that approximates no-slip boundary conditions with rapid linear damping inside the object. The method can then simulate complex, moving objects in general numerical solvers without specialised algorithms or boundary-conforming grids. Volume penalisation pays for this simplicity by introducing an equation-level error, the $\textit{model error}$, that is related to the damping time $η\ll 1$. While the model error has been proven to vanish as the damping time tends to zero, previous work suggests convergence at a slow rate of $\mathcal{O}(η^{1/2})$. The stiffness of the damping implies conventional volume penalisation only achieves first order numerical accuracy. We analyse the volume-penalty method using multiple-scales matched-asymptotics with a signed-distance coordinate system valid for arbitrary smooth geometries. We show the dominant model error stems from a displacement length that is proportional to a Reynolds number $\text{Re}$ dependent boundary layer of size $\mathcal{O}(η^{1/2}\text{Re}^{-1/2})$. The relative size of the displacement length and damping time leads to multiple error regimes. Our key finding derives a simple smoothing prescription for the damping that eliminates the displacement length and reduces the model error to $\mathcal{O}(η)$ in all regimes. This translates to second order numerical accuracy. We validate our findings in several comprehensive benchmark problems and finally combine Richardson extrapolation of the model error with our correction to further improve convergence to $\mathcal{O}(η^{2})$.
△ Less
Submitted 9 June, 2020; v1 submitted 28 March, 2019;
originally announced March 2019.
-
A sparse spectral method on triangles
Authors:
Sheehan Olver,
Alex Townsend,
Geoff Vasil
Abstract:
In this paper, we demonstrate that many of the computational tools for univariate orthogonal polynomials have analogues for a family of bivariate orthogonal polynomials on the triangle, including Clenshaw's algorithm and sparse differentiation operators. This allows us to derive a practical spectral method for solving linear partial differential equations on triangles with sparse discretizations.…
▽ More
In this paper, we demonstrate that many of the computational tools for univariate orthogonal polynomials have analogues for a family of bivariate orthogonal polynomials on the triangle, including Clenshaw's algorithm and sparse differentiation operators. This allows us to derive a practical spectral method for solving linear partial differential equations on triangles with sparse discretizations. We can thereby rapidly solve partial differential equations using polynomials with degrees in the thousands, resulting in sparse discretizations with as many as several million degrees of freedom.
△ Less
Submitted 13 February, 2019;
originally announced February 2019.
-
Tensor calculus in spherical coordinates using Jacobi polynomials. Part-I: Mathematical analysis and derivations
Authors:
Geoff Vasil,
Daniel Lecoanet,
Keaton Burns,
Jeff Oishi,
Ben Brown
Abstract:
This paper presents a method for the accurate and efficient computations on scalar, vector and tensor fields in three-dimensional spherical polar coordinates. The methods uses spin-weighted spherical harmonics in the angular directions and rescaled Jacobi polynomials in the radial direction. For the 2-sphere, spin-weighted harmonics allow for automating calculations in a fashion as similar to Four…
▽ More
This paper presents a method for the accurate and efficient computations on scalar, vector and tensor fields in three-dimensional spherical polar coordinates. The methods uses spin-weighted spherical harmonics in the angular directions and rescaled Jacobi polynomials in the radial direction. For the 2-sphere, spin-weighted harmonics allow for automating calculations in a fashion as similar to Fourier series as possible. Derivative operators act as wavenumber multiplication on a set of spectral coefficients. After transforming the angular directions, a set of orthogonal tensor rotations put the radially dependent spectral coefficients into individual spaces each obeying a particular regularity condition at the origin. These regularity spaces have remarkably simple properties under standard vector-calculus operations, such as \textit{grad} and \textit{div}. We use a hierarchy of rescaled Jacobi polynomials for a basis on these regularity spaces. It is possible to select the Jacobi-polynomial parameters such that all relevant operators act in a minimally banded way. Altogether, the geometric structure allows for the accurate and efficient solution of general partial differential equations in the unit ball.
△ Less
Submitted 26 April, 2018;
originally announced April 2018.
-
Recurrence relations for orthogonal polynomials on a triangle
Authors:
Sheehan Olver,
Alex Townsend,
Geoff Vasil
Abstract:
This paper derives sparse recurrence relations between orthogonal polynomials on a triangle and their partial derivatives, which are analogous to recurrence relations for Jacobi polynomials. We derive these recurrences in a systematic fashion by introducing ladder operators that map an orthogonal polynomial to another by incrementing or decrementing its associated parameters by one.
This paper derives sparse recurrence relations between orthogonal polynomials on a triangle and their partial derivatives, which are analogous to recurrence relations for Jacobi polynomials. We derive these recurrences in a systematic fashion by introducing ladder operators that map an orthogonal polynomial to another by incrementing or decrementing its associated parameters by one.
△ Less
Submitted 27 January, 2018;
originally announced January 2018.
-
Tensor calculus in polar coordinates using Jacobi polynomials
Authors:
Geoffrey M. Vasil,
Keaton J. Burns,
Daniel Lecoanet,
Sheehan Olver,
Benjamin P. Brown,
Jeffrey S. Oishi
Abstract:
Spectral methods are an efficient way to solve partial differential equations on domains possessing certain symmetries. The utility of a method depends strongly on the choice of spectral basis. In this paper we describe a set of bases built out of Jacobi polynomials, and associated operators for solving scalar, vector, and tensor partial differential equations in polar coordinates on a unit disk.…
▽ More
Spectral methods are an efficient way to solve partial differential equations on domains possessing certain symmetries. The utility of a method depends strongly on the choice of spectral basis. In this paper we describe a set of bases built out of Jacobi polynomials, and associated operators for solving scalar, vector, and tensor partial differential equations in polar coordinates on a unit disk. By construction, the bases satisfy regularity conditions at r=0 for any tensorial field. The coordinate singularity in a disk is a prototypical case for many coordinate singularities. The work presented here extends to other geometries. The operators represent covariant derivatives, multiplication by azimuthally symmetric functions, and the tensorial relationship between fields. These arise naturally from relations between classical orthogonal polynomials, and form a Heisenberg algebra. Other past work uses more specific polynomial bases for solving equations in polar coordinates. The main innovation in this paper is to use a larger set of possible bases to achieve maximum bandedness of linear operations. We provide a series of applications of the methods, illustrating their ease-of-use and accuracy.
△ Less
Submitted 15 August, 2016; v1 submitted 25 September, 2015;
originally announced September 2015.
