-
Operator learning regularization for macroscopic permeability prediction in dual-scale flow problem
Authors:
Christina Runkel,
Sinan Xiao,
Nicolas Boullé,
Yang Chen
Abstract:
Liquid composites moulding is an important manufacturing technology for fibre reinforced composites, due to its cost-effectiveness. Challenges lie in the optimisation of the process due to the lack of understanding of key characteristic of textile fabrics - permeability. The problem of computing the permeability coefficient can be modelled as the well-known Stokes-Brinkman equation, which introduc…
▽ More
Liquid composites moulding is an important manufacturing technology for fibre reinforced composites, due to its cost-effectiveness. Challenges lie in the optimisation of the process due to the lack of understanding of key characteristic of textile fabrics - permeability. The problem of computing the permeability coefficient can be modelled as the well-known Stokes-Brinkman equation, which introduces a heterogeneous parameter $β$ distinguishing macropore regions and fibre-bundle regions. In the present work, we train a Fourier neural operator to learn the nonlinear map from the heterogeneous coefficient $β$ to the velocity field $u$, and recover the corresponding macroscopic permeability $K$. This is a challenging inverse problem since both the input and output fields span several order of magnitudes, we introduce different regularization techniques for the loss function and perform a quantitative comparison between them.
△ Less
Submitted 30 November, 2024;
originally announced December 2024.
-
Lines of Thought in Large Language Models
Authors:
Raphaël Sarfati,
Toni J. B. Liu,
Nicolas Boullé,
Christopher J. Earls
Abstract:
Large Language Models achieve next-token prediction by transporting a vectorized piece of text (prompt) across an accompanying embedding space under the action of successive transformer layers. The resulting high-dimensional trajectories realize different contextualization, or 'thinking', steps, and fully determine the output probability distribution. We aim to characterize the statistical propert…
▽ More
Large Language Models achieve next-token prediction by transporting a vectorized piece of text (prompt) across an accompanying embedding space under the action of successive transformer layers. The resulting high-dimensional trajectories realize different contextualization, or 'thinking', steps, and fully determine the output probability distribution. We aim to characterize the statistical properties of ensembles of these 'lines of thought.' We observe that independent trajectories cluster along a low-dimensional, non-Euclidean manifold, and that their path can be well approximated by a stochastic equation with few parameters extracted from data. We find it remarkable that the vast complexity of such large models can be reduced to a much simpler form, and we reflect on implications.
△ Less
Submitted 13 February, 2025; v1 submitted 2 October, 2024;
originally announced October 2024.
-
Bifurcation analysis of a two-dimensional magnetic Rayleigh-Bénard problem
Authors:
Fabian Laakmann,
Nicolas Boullé
Abstract:
We perform a bifurcation analysis of a two-dimensional magnetic Rayleigh--Bénard problem using a numerical technique called deflated continuation. Our aim is to study the influence of the magnetic field on the bifurcation diagram as the Chandrasekhar number $Q$ increases and compare it to the standard (non-magnetic) Rayleigh--Bénard problem. We compute steady states at a high Chandrasekhar number…
▽ More
We perform a bifurcation analysis of a two-dimensional magnetic Rayleigh--Bénard problem using a numerical technique called deflated continuation. Our aim is to study the influence of the magnetic field on the bifurcation diagram as the Chandrasekhar number $Q$ increases and compare it to the standard (non-magnetic) Rayleigh--Bénard problem. We compute steady states at a high Chandrasekhar number of $Q=10^3$ over a range of the Rayleigh number $0\leq \Ra\leq 10^5$. These solutions are obtained by combining deflation with a continuation of steady states at low Chandrasekhar number, which allows us to explore the influence of the strength of the magnetic field as $Q$ increases from low coupling, where the magnetic effect is almost negligible, to strong coupling at $Q=10^3$. We discover a large profusion of states with rich dynamics and observe a complex bifurcation structure with several pitchfork, Hopf, and saddle-node bifurcations. Our numerical simulations show that the onset of bifurcations in the problem is delayed when $Q$ increases, while solutions with fluid velocity patterns aligning with the background vertical magnetic field are privileged. Additionally, we report a branch of states that stabilizes at high magnetic coupling, suggesting that one may take advantage of the magnetic field to discriminate solutions.
△ Less
Submitted 18 June, 2024; v1 submitted 22 November, 2022;
originally announced November 2022.
-
Two-Component 3D Atomic Bose-Einstein Condensates Support Complex Stable Patterns
Authors:
N. Boullé,
I. Newell,
P. E. Farrell,
P. G. Kevrekidis
Abstract:
We report the computational discovery of complex, topologically charged, and spectrally stable states in three-dimensional multi-component nonlinear wave systems of nonlinear Schr{ö}dinger type. While our computations relate to two-component atomic Bose-Einstein condensates in parabolic traps, our methods can be broadly applied to high-dimensional, nonlinear systems of partial differential equatio…
▽ More
We report the computational discovery of complex, topologically charged, and spectrally stable states in three-dimensional multi-component nonlinear wave systems of nonlinear Schr{ö}dinger type. While our computations relate to two-component atomic Bose-Einstein condensates in parabolic traps, our methods can be broadly applied to high-dimensional, nonlinear systems of partial differential equations. The combination of the so-called deflation technique with a careful selection of initial guesses enables the computation of an unprecedented breadth of patterns, including ones combining vortex lines, rings, stars, and ``vortex labyrinths''. Despite their complexity, they may be dynamically robust and amenable to experimental observation, as confirmed by Bogolyubov-de Gennes spectral analysis and numerical evolution simulations.
△ Less
Submitted 16 January, 2023; v1 submitted 11 August, 2022;
originally announced August 2022.
-
An optimal complexity spectral method for Navier--Stokes simulations in the ball
Authors:
Nicolas Boullé,
Jonasz Słomka,
Alex Townsend
Abstract:
We develop a spectral method for solving the incompressible generalized Navier--Stokes equations in the ball with no-flux and prescribed slip boundary conditions. The algorithm achieves an optimal complexity per time step of $\mathcal{O}(N\log^2(N))$, where $N$ is the number of spatial degrees of freedom. The method relies on the poloidal-toroidal decomposition of solenoidal vector fields, the dou…
▽ More
We develop a spectral method for solving the incompressible generalized Navier--Stokes equations in the ball with no-flux and prescribed slip boundary conditions. The algorithm achieves an optimal complexity per time step of $\mathcal{O}(N\log^2(N))$, where $N$ is the number of spatial degrees of freedom. The method relies on the poloidal-toroidal decomposition of solenoidal vector fields, the double Fourier sphere method, the Fourier and ultraspherical spectral method, and the spherical harmonics transform to decouple the Navier--Stokes equations and achieve the desired complexity and spectral accuracy.
△ Less
Submitted 20 April, 2021; v1 submitted 30 March, 2021;
originally announced March 2021.
-
Bifurcation analysis of two-dimensional Rayleigh--Bénard convection using deflation
Authors:
Nicolas Boullé,
Vassilios Dallas,
Patrick E. Farrell
Abstract:
We perform a bifurcation analysis of the steady states of Rayleigh--Bénard convection with no-slip boundary conditions in two dimensions using a numerical method called deflated continuation. By combining this method with an initialisation strategy based on the eigenmodes of the conducting state, we are able to discover multiple solutions to this non-linear problem, including disconnected branches…
▽ More
We perform a bifurcation analysis of the steady states of Rayleigh--Bénard convection with no-slip boundary conditions in two dimensions using a numerical method called deflated continuation. By combining this method with an initialisation strategy based on the eigenmodes of the conducting state, we are able to discover multiple solutions to this non-linear problem, including disconnected branches of the bifurcation diagram, without the need for any prior knowledge of the solutions. One of the disconnected branches we find contains an S-shaped curve with hysteresis, which is the origin of a flow pattern that may be related to the dynamics of flow reversals in the turbulent regime. Linear stability analysis is also performed to analyse the steady and unsteady regimes of the solutions in the parameter space and to characterise the type of instabilities.
△ Less
Submitted 22 April, 2022; v1 submitted 21 February, 2021;
originally announced February 2021.
-
Deflation-based Identification of Nonlinear Excitations of the 3D Gross--Pitaevskii equation
Authors:
N. Boullé,
E. G. Charalampidis,
P. E. Farrell,
P. G. Kevrekidis
Abstract:
We present previously unknown solutions to the 3D Gross--Pitaevskii equation describing atomic Bose-Einstein condensates. This model supports elaborate patterns, including excited states bearing vorticity. The discovered coherent structures exhibit striking topological features, involving combinations of vortex rings and multiple, possibly bent vortex lines. Although unstable, many of them persist…
▽ More
We present previously unknown solutions to the 3D Gross--Pitaevskii equation describing atomic Bose-Einstein condensates. This model supports elaborate patterns, including excited states bearing vorticity. The discovered coherent structures exhibit striking topological features, involving combinations of vortex rings and multiple, possibly bent vortex lines. Although unstable, many of them persist for long times in dynamical simulations. These solutions were identified by a state-of-the-art numerical technique called deflation, which is expected to be applicable to many problems from other areas of physics.
△ Less
Submitted 30 September, 2020; v1 submitted 22 April, 2020;
originally announced April 2020.
-
Bifurcation analysis of stationary solutions of two-dimensional coupled Gross-Pitaevskii equations using deflated continuation
Authors:
E. G Charalampidis,
N. Boullé,
P. E. Farrell,
P. G. Kevrekidis
Abstract:
Recently, a novel bifurcation technique known as the deflated continuation method (DCM) was applied to the single-component nonlinear Schrödinger (NLS) equation with a parabolic trap in two spatial dimensions. The bifurcation analysis carried out by a subset of the present authors shed light on the configuration space of solutions of this fundamental problem in the physics of ultracold atoms. In t…
▽ More
Recently, a novel bifurcation technique known as the deflated continuation method (DCM) was applied to the single-component nonlinear Schrödinger (NLS) equation with a parabolic trap in two spatial dimensions. The bifurcation analysis carried out by a subset of the present authors shed light on the configuration space of solutions of this fundamental problem in the physics of ultracold atoms. In the present work, we take this a step further by applying the DCM to two coupled NLS equations in order to elucidate the considerably more complex landscape of solutions of this system. Upon identifying branches of solutions, we construct the relevant bifurcation diagrams and perform spectral stability analysis to identify parametric regimes of stability and instability and to understand the mechanisms by which these branches emerge. The method reveals a remarkable wealth of solutions: these do not only include some of the well-known ones including, e.g., from the Cartesian or polar small amplitude limits of the underlying linear problem but also a significant number of branches that arise through (typically pitchfork) bifurcations. In addition to presenting a ``cartography'' of the landscape of solutions, we comment on the challenging task of identifying {\it all} solutions of such a high-dimensional, nonlinear problem.
△ Less
Submitted 29 November, 2019;
originally announced December 2019.
-
Classification of chaotic time series with deep learning
Authors:
Nicolas Boullé,
Vassilios Dallas,
Yuji Nakatsukasa,
D. Samaddar
Abstract:
We use standard deep neural networks to classify univariate time series generated by discrete and continuous dynamical systems based on their chaotic or non-chaotic behaviour. Our approach to circumvent the lack of precise models for some of the most challenging real-life applications is to train different neural networks on a data set from a dynamical system with a basic or low-dimensional phase…
▽ More
We use standard deep neural networks to classify univariate time series generated by discrete and continuous dynamical systems based on their chaotic or non-chaotic behaviour. Our approach to circumvent the lack of precise models for some of the most challenging real-life applications is to train different neural networks on a data set from a dynamical system with a basic or low-dimensional phase space and then use these networks to classify univariate time series of a dynamical system with more intricate or high-dimensional phase space. We illustrate this generalisation approach using the logistic map, the sine-circle map, the Lorenz system, and the Kuramoto--Sivashinsky equation. We observe that a convolutional neural network without batch normalization layers outperforms state-of-the-art neural networks for time series classification and is able to generalise and classify time series as chaotic or not with high accuracy.
△ Less
Submitted 3 December, 2019; v1 submitted 26 July, 2019;
originally announced August 2019.
