-
PyFR v2.0.3: Towards Industrial Adoption of Scale-Resolving Simulations
Authors:
Freddie D. Witherden,
Peter E. Vincent,
Will Trojak,
Yoshiaki Abe,
Amir Akbarzadeh,
Semih Akkurt,
Mohammad Alhawwary,
Lidia Caros,
Tarik Dzanic,
Giorgio Giangaspero,
Arvind S. Iyer,
Antony Jameson,
Marius Koch,
Niki Loppi,
Sambit Mishra,
Rishit Modi,
Gonzalo Sáez-Mischlich,
Jin Seok Park,
Brian C. Vermeire,
Lai Wang
Abstract:
PyFR is an open-source cross-platform computational fluid dynamics framework based on the high-order Flux Reconstruction approach, specifically designed for undertaking high-accuracy scale-resolving simulations in the vicinity of complex engineering geometries. Since the initial release of PyFR v0.1.0 in 2013, a range of new capabilities have been added to the framework, with a view to enabling in…
▽ More
PyFR is an open-source cross-platform computational fluid dynamics framework based on the high-order Flux Reconstruction approach, specifically designed for undertaking high-accuracy scale-resolving simulations in the vicinity of complex engineering geometries. Since the initial release of PyFR v0.1.0 in 2013, a range of new capabilities have been added to the framework, with a view to enabling industrial adoption of the capability. This paper provides details of those enhancements as released in PyFR v2.0.3, explains efforts to grow an engaged developer and user community, and provides latest performance and scaling results on up to 1024 AMD Instinct MI250X accelerators of Frontier at ORNL (each with two GCDs), and up to 2048 NVIDIA GH200 GPUs on Alps at CSCS.
△ Less
Submitted 29 August, 2024;
originally announced August 2024.
-
An efficient GPU-based h-adaptation framework via linear trees for the flux reconstruction method
Authors:
Lai Wang,
Freddie Witherden,
Antony Jameson
Abstract:
In this paper, we develop the first entirely graphic processing unit (GPU) based h-adaptive flux reconstruction (FR) method with linear trees. The adaptive solver fully operates on the GPU hardware, using a linear quadtree for two dimensional (2D) problems and a linear octree for three dimensional (3D) problems. We articulate how to efficiently perform tree construction, 2:1 balancing, connectivit…
▽ More
In this paper, we develop the first entirely graphic processing unit (GPU) based h-adaptive flux reconstruction (FR) method with linear trees. The adaptive solver fully operates on the GPU hardware, using a linear quadtree for two dimensional (2D) problems and a linear octree for three dimensional (3D) problems. We articulate how to efficiently perform tree construction, 2:1 balancing, connectivity query, and how to perform adaptation for the flux reconstruction method on the GPU hardware. As a proof of concept, we apply the adaptive flux reconstruction method to solve the inviscid isentropic vortex propagation problem on 2D and 3D meshes to demonstrate the efficiency of the developed adaptive FR method on a single GPU card. Depending on the computational domain size, acceleration of one or two orders of magnitude can be achieved compared to uniform meshing. The total computational cost of adaption, including tree manipulations, connectivity query and data transfer, compared to that of the numerical solver, is insignificant. It can be less than 2% of the total wall clock time for 3D problems even if we perform adaptation as frequent as every 10 time steps with an explicit 3-stage Runge--Kutta time integrator.
△ Less
Submitted 11 June, 2023;
originally announced June 2023.
-
Kapchinsky Memorial Book -- English Translation
Authors:
R. A. Jameson,
V. S. Skachkov
Abstract:
English translation of Russian book compiled to honor the memory of Ilya Mikhailovich Kapchinsky - To the 90th Birthday Collection of Memories. The idea for this publication belongs to Nikolai Vladimirovich Lazarev, a close collaborator of Ilya Mikhailovich Kapchinsky, head of one of the laboratories in the ITEP department that Kapchinsky headed. It was through the efforts of N.V. Lazarev that mos…
▽ More
English translation of Russian book compiled to honor the memory of Ilya Mikhailovich Kapchinsky - To the 90th Birthday Collection of Memories. The idea for this publication belongs to Nikolai Vladimirovich Lazarev, a close collaborator of Ilya Mikhailovich Kapchinsky, head of one of the laboratories in the ITEP department that Kapchinsky headed. It was through the efforts of N.V. Lazarev that most of the materials in the collection were gathered. The main headings are: I. Little Known Heritage of I.M. Kapchinsky, II. Documents Joyful and Mournful, III. Memories of Family and Friends, Fragments of our life, IV. Memories of Colleagues of I.M. Kapchinsky, List of Scientific Papers, Afterword, Photos and Documents.
△ Less
Submitted 1 March, 2023;
originally announced March 2023.
-
Elements of Ion Linear Accelerators + Calm in the Resonances -- and Other Tales
Authors:
R. A. Jameson
Abstract:
The main part of this book, Elements of Linear Accelerators, outlines in Part 1 a framework for non-relativistic linear accelerator focusing and accelerating channel design, simulation, optimization and analysis where space charge is an important factor. Part 1 is the most important part of the book; grasping the framework is essential to fully understand and appreciate the elements within it, and…
▽ More
The main part of this book, Elements of Linear Accelerators, outlines in Part 1 a framework for non-relativistic linear accelerator focusing and accelerating channel design, simulation, optimization and analysis where space charge is an important factor. Part 1 is the most important part of the book; grasping the framework is essential to fully understand and appreciate the elements within it, and the myriad application details of the following Parts. The treatment concentrates on all linacs, large or small, intended for high-intensity, very low beam loss, factory-type application. The Radio-Frequency-Quadrupole (RFQ) is especially developed as a representative and the most complicated linac form (from dc to bunched and accelerated beam), extending to practical design of long, high energy linacs, including space charge resonances and beam halo formation, and some challenges for future work. Also a practical method is presented for designing Alternating-Phase- Focused (APF) linacs with long sequences and high energy gain. Full open-source software is available. The following part, Calm in the Resonances and Other Tales, contains eyewitness accounts of nearly 60 years of participation in accelerator technology.
(September 2023) The LINACS codes are released at no cost and, as always, with fully open-source coding. (p.2 & Ch 19.10)
△ Less
Submitted 29 April, 2024; v1 submitted 7 December, 2022;
originally announced December 2022.
-
Improved bunching and longitudinal emittance control in an RFQ
Authors:
Robert A. Jameson,
Bruce Yee-Rendon
Abstract:
A new approach to the longitudinal vane modulation profile in a Radio Frequency Quadrupole (RFQ) has been discovered that significantly improves bunching and longitudinal emittance control. This procedure has been successfully tested in different RFQ models with satisfactory reduction of the longitudinal emittance; thus, this advanced method can be implemented for any RFQ. Highlights:
Advanced l…
▽ More
A new approach to the longitudinal vane modulation profile in a Radio Frequency Quadrupole (RFQ) has been discovered that significantly improves bunching and longitudinal emittance control. This procedure has been successfully tested in different RFQ models with satisfactory reduction of the longitudinal emittance; thus, this advanced method can be implemented for any RFQ. Highlights:
Advanced longitudinal vane modulation profile that improves bunching and longitudinal emittance control.
Vane manipulation to avoid the nonlinear effects of the accelerating field inside the cell.
Analysis in the full time-domain. Keywords: Radiofrequency Quadrupoles, Equipartitioning, Beam bunching.
△ Less
Submitted 12 November, 2022; v1 submitted 9 March, 2022;
originally announced March 2022.
-
Nonlinear p-multigrid preconditioner for implicit time integration of compressible Navier--Stokes equations
Authors:
Lai Wang,
Will Trojak,
Freddie Witherden,
Antony Jameson
Abstract:
Within the framework of $ p $-adaptive flux reconstruction, we aim to construct efficient polynomial multigrid ($p$MG) preconditioners for implicit time integration of the Navier--Stokes equations using Jacobian-free Newton--Krylov (JFNK) methods. We hypothesise that in pseudo transient continuation (PTC), as the residual drops, the frequency of error modes that dictates the convergence rate gets…
▽ More
Within the framework of $ p $-adaptive flux reconstruction, we aim to construct efficient polynomial multigrid ($p$MG) preconditioners for implicit time integration of the Navier--Stokes equations using Jacobian-free Newton--Krylov (JFNK) methods. We hypothesise that in pseudo transient continuation (PTC), as the residual drops, the frequency of error modes that dictates the convergence rate gets higher and higher. We apply nonlinear $p$MG solvers to stiff steady problems at low Mach number ($\mathrm{Ma}=10^{-3}$) to verify our hypothesis. It is demonstrated that once the residual drops by a few orders of magnitude, improved smoothing on intermediate $ p $-sublevels will not only maintain the stability of $ p $MG at large time steps but also improve the convergence rate. For the unsteady Navier--Stokes equations, we elaborate how to construct nonlinear preconditioners using pseudo transient continuation for the matrix-free generalized minimal residual (GMRES) method used in explicit first stage, singly diagonally implicit Runge--Kutta (ESDIRK) methods, and linearly implicit Rosenbrock--Wanner (ROW) methods. Given that at each time step the initial guess in the nonlinear solver is not distant from the converged solution, we recommend a two-level $p\{p_0\text{-}p_0/2\} $ or even $ p\{p_0\text{-}(p_0-1)\} $ $p$-hierarchy for optimal efficiency with a matrix-based smoother on the coarser level based on our hypothesis. It is demonstrated that insufficient smoothing on intermediate $p$-sublevels will deteriorate the performance of $p$MG preconditioner greatly. (See full abstract in the paper.)
△ Less
Submitted 20 February, 2022;
originally announced February 2022.
-
Artificial Compressibility Approaches in Flux Reconstruction for Incompressible Viscous Flow Simulations
Authors:
Will Trojak,
Nagabhushana Rao Vadlamani,
James Tyacke,
Freddie Witherden,
Antony Jameson
Abstract:
Several competing artificial compressibility methods for the incompressible flow equations are examined using the high-order flux reconstruction method. The established artificial compressibility method (ACM) of \citet{Chorin1967} is compared to the alternative entropically damped (EDAC) method of \citet{Clausen2013}, as well as an ACM formulation with hyperbolised diffusion. While the former requ…
▽ More
Several competing artificial compressibility methods for the incompressible flow equations are examined using the high-order flux reconstruction method. The established artificial compressibility method (ACM) of \citet{Chorin1967} is compared to the alternative entropically damped (EDAC) method of \citet{Clausen2013}, as well as an ACM formulation with hyperbolised diffusion. While the former requires the solution to be converged to a divergence free state at each physical time step through pseudo iterations, the latter can be applied explicitly. We examine the sensitivity of both methods to the parameterisation for a series of test cases over a range of Reynolds numbers. As the compressibility is reduced, EDAC is found to give linear improvements in divergence whereas ACM yields diminishing returns. For the Taylor--Green vortex, EDAC is found to perform well; however on the more challenging circular cylinder at $Re=3900$, EDAC gives rise to early transition of the free shear-layer and over-production of the turbulence kinetic energy. This is attributed to the spatial pressure fluctuations of the method. Similar behaviour is observed for an aerofoil at $Re=60,000$ with an attached transitional boundary layer. It is concluded that hyperbolic diffusion of ACM can be beneficial but at the cost of case setup time, and EDAC can be an efficient method for incompressible flow. However, care must be taken as pressure fluctuations can have a significant impact on physics and the remedy causes the governing equation to become overly stiff.
△ Less
Submitted 15 November, 2021;
originally announced November 2021.
-
Accuracy, Stability, and Performance Comparison between the Spectral Difference and Flux Reconstruction Schemes
Authors:
Christopher Cox,
Will Trojak,
Tarik Dzanic,
Freddie Witherden,
Antony Jameson
Abstract:
We report the development of a discontinuous spectral element flow solver that includes the implementation of both spectral difference and flux reconstruction formulations. With this high order framework, we have constructed a foundation upon which to provide a fair and accurate assessment of these two schemes in terms of accuracy, stability, and performance with special attention to the true spec…
▽ More
We report the development of a discontinuous spectral element flow solver that includes the implementation of both spectral difference and flux reconstruction formulations. With this high order framework, we have constructed a foundation upon which to provide a fair and accurate assessment of these two schemes in terms of accuracy, stability, and performance with special attention to the true spectral difference scheme and the modified spectral difference scheme recovered via the flux reconstruction formulation. Building on previous analysis of the spectral difference and flux reconstruction schemes, we provide a novel nonlinear stability analysis of the spectral difference scheme. Through various numerical experiments, we demonstrate the additional stability afforded by the true, baseline spectral difference scheme without explicit filtering or de-aliasing due to its inherent feature of staggered flux points. This arrangement leads to favorable suppression of aliasing errors and improves stability needed for under-resolved simulations of turbulent flows.
△ Less
Submitted 13 September, 2020;
originally announced September 2020.
-
In Memory of Prof. Hidekuni Takekoshi
Authors:
Y. Iwashita,
M. Mizumoto,
T. Igaki,
H. Okamoto,
R. A. Jameson
Abstract:
A memorial to Prof. Hidekuni Hidekoshi, Kyoto University, Japan - an accelerator pioneer in Japan, teacher, mentor, friend, unassuming but knowing his accomplishments and worth, frugal but generous, enjoying life. Japanese contributions given in Japanese and English, English in English.
A memorial to Prof. Hidekuni Hidekoshi, Kyoto University, Japan - an accelerator pioneer in Japan, teacher, mentor, friend, unassuming but knowing his accomplishments and worth, frugal but generous, enjoying life. Japanese contributions given in Japanese and English, English in English.
△ Less
Submitted 6 August, 2020;
originally announced August 2020.
-
Interaction between high intensity beam and structure resonances
Authors:
Chao Li,
R. A. Jameson
Abstract:
With the help of the linearized perturbation theory, the collective beam instability due to the space charge, modelled by the Vlasov-Poisson equation, is well studied in the former research theoretically in a general sense [Chao Li and R. A. Jameson PRAB, 21, 024204 (2018)], where the related instability is depicted by the "structure resonance". As an extension of the theoretical study, this paper…
▽ More
With the help of the linearized perturbation theory, the collective beam instability due to the space charge, modelled by the Vlasov-Poisson equation, is well studied in the former research theoretically in a general sense [Chao Li and R. A. Jameson PRAB, 21, 024204 (2018)], where the related instability is depicted by the "structure resonance". As an extension of the theoretical study, this paper aims to verify the validity of the structure resonance with numerical simulations and to show the basic principles which interpret the interaction between structure resonance and beam in a general sense. It is found that the reaction of beam to the structure resonance ($nσ\approx 180^\circ$) differs for the cases with $n= 0$ and $n\ne 0$ stop bands. The non-resonant "plasma oscillation" is also revisited; the "phase space mixing", lying in the transient plasma oscillation, is the mechanism that ties the resonant effects, non-resonant effects and macroscopic beam phenomena together.
△ Less
Submitted 23 May, 2019;
originally announced May 2019.
-
Recovering missing CFD data for high-order discretizations using deep neural networks and dynamics learning
Authors:
Kevin T. Carlberg,
Antony Jameson,
Mykel J. Kochenderfer,
Jeremy Morton,
Liqian Peng,
Freddie D. Witherden
Abstract:
Data I/O poses a significant bottleneck in large-scale CFD simulations; thus, practitioners would like to significantly reduce the number of times the solution is saved to disk, yet retain the ability to recover any field quantity (at any time instance) a posteriori. The objective of this work is therefore to accurately recover missing CFD data a posteriori at any time instance, given that the sol…
▽ More
Data I/O poses a significant bottleneck in large-scale CFD simulations; thus, practitioners would like to significantly reduce the number of times the solution is saved to disk, yet retain the ability to recover any field quantity (at any time instance) a posteriori. The objective of this work is therefore to accurately recover missing CFD data a posteriori at any time instance, given that the solution has been written to disk at only a relatively small number of time instances. We consider in particular high-order discretizations (e.g., discontinuous Galerkin), as such techniques are becoming increasingly popular for the simulation of highly separated flows. To satisfy this objective, this work proposes a methodology consisting of two stages: 1) dimensionality reduction and 2) dynamics learning. For dimensionality reduction, we propose a novel hierarchical approach. First, the method reduces the number of degrees of freedom within each element of the high-order discretization by applying autoencoders from deep learning. Second, the methodology applies principal component analysis to compress the global vector of encodings. This leads to a low-dimensional state, which associates with a nonlinear embedding of the original CFD data. For dynamics learning, we propose to apply regression techniques (e.g., kernel methods) to learn the discrete-time velocity characterizing the time evolution of this low-dimensional state. A numerical example on a large-scale CFD example characterized by nearly 13 million degrees of freedom illustrates the suitability of the proposed method in an industrial setting.
△ Less
Submitted 28 May, 2019; v1 submitted 30 November, 2018;
originally announced December 2018.
-
A new description of space charge induced beam halo
Authors:
Chao Li,
R. A. Jameson
Abstract:
In particle accelerators, particle losses to surrounding components must be minimized. These particles usually have been driven into an undesired "halo" outside the desired distribution before being lost. The processes involved and physical identification of such halo is an intense research topic especially when the nonlinear space charge effect is taken into account. In order to present a method,…
▽ More
In particle accelerators, particle losses to surrounding components must be minimized. These particles usually have been driven into an undesired "halo" outside the desired distribution before being lost. The processes involved and physical identification of such halo is an intense research topic especially when the nonlinear space charge effect is taken into account. In order to present a method, firmly based on the physics of the transient beam state, for determining when a particle may be defined as being in a halo, the particular example of an initially rms matched beam injected into a resonance of an alternating-gradient (AG) focusing lattice is studied, in which the resonance between the collective mode and single particle motion pushes some particles into a halo defined by extending the halo description to the action-angle frame. In this new frame of description, the halo particles can be physically defined as those with larger actions affected by the outer quasi hyperbolic tori, which contains the halo particles observed in the traditional approaches on projected 2D phase space, as well as some particles still hidden in the core.
△ Less
Submitted 3 July, 2018;
originally announced July 2018.
-
High-Order Computational Fluid Dynamics Simulations of a Spinning Golf Ball
Authors:
Jacob Crabill,
Freddie Witherden,
Antony Jameson
Abstract:
This paper presents the first high-order computational fluid dynamics (CFD) simulations of static and spinning golf balls at realistic flow conditions. The present results are shown to capture the complex fluid dynamics inside the dimples which lead to drag reduction versus a smooth sphere, and compare well to previous experimental and computational studies. The high--order Flux Reconstruction met…
▽ More
This paper presents the first high-order computational fluid dynamics (CFD) simulations of static and spinning golf balls at realistic flow conditions. The present results are shown to capture the complex fluid dynamics inside the dimples which lead to drag reduction versus a smooth sphere, and compare well to previous experimental and computational studies. The high--order Flux Reconstruction method has been paired with the Artificial Boundary overset method to enable simplified mesh generation and grid motion. The compressible Navier--Stokes equations are modeled using a scale--resolving Large Eddy Simulation (LES) approach with no sub--grid models. The codes implementing these methods have been implemented for NVIDIA Graphical Processing Units (GPUs), enabling large speedups over traditional computer hardware. The new method allows for the simulation of golf balls, and other objects at similar moderate Reynolds numbers, to be simulated in a matter of days on large computing clusters. The use of CFD for the design of objects such as golf balls and other sports balls is now within reach.
△ Less
Submitted 29 May, 2018;
originally announced June 2018.
-
A Parallel Direct Cut Algorithm for High-Order Overset Methods with Application to a Spinning Golf Ball
Authors:
Jacob A. Crabill,
Freddie D. Witherden,
Antony Jameson
Abstract:
Overset methods are commonly employed to enable the effective simulation of problems involving complex geometries and moving objects such as rotorcraft. This paper presents a novel overset domain connectivity algorithm based upon the direct cut approach suitable for use with GPU-accelerated solvers on high-order curved grids. In contrast to previous methods it is capable of exploiting the highly d…
▽ More
Overset methods are commonly employed to enable the effective simulation of problems involving complex geometries and moving objects such as rotorcraft. This paper presents a novel overset domain connectivity algorithm based upon the direct cut approach suitable for use with GPU-accelerated solvers on high-order curved grids. In contrast to previous methods it is capable of exploiting the highly data-parallel nature of modern accelerators. Further, the approach is also substantially more efficient at handling the curved grids which arise within the context of high-order methods. An implementation of this new algorithm is presented and combined with a high-order fluid dynamics code. The algorithm is validated against several benchmark problems, including flow over a spinning golf ball at a Reynolds number of 150,000.
△ Less
Submitted 23 May, 2018; v1 submitted 21 November, 2017;
originally announced November 2017.
-
Practical design of alternating-phase-focused linacs
Authors:
R. A. Jameson
Abstract:
Conventional magnetic transverse focusing in conventional linear accelerators represents a high fraction of their cost and complexity. Both transverse and longitudinal focusing can be obtained from the radio frequency field by using the technique known as Alternating Phase Focusing. The design of suitable sequences has been difficult, without direct theoretical support, inhibiting Alternating Phas…
▽ More
Conventional magnetic transverse focusing in conventional linear accelerators represents a high fraction of their cost and complexity. Both transverse and longitudinal focusing can be obtained from the radio frequency field by using the technique known as Alternating Phase Focusing. The design of suitable sequences has been difficult, without direct theoretical support, inhibiting Alternating Phase Focusing adoption. Synthesis of reported details and new physics and technique result in a new, general method for designing practical Alternating Phase Focusing linear accelerators. Very long sequences with high energy gain factors are demonstrated, motivated by the desire to accelerate particles over a factor of 500-600 energy gain. The method is demonstrated with simple dynamics and no space charge, later incorporation of space charge and more accurate elements is straight forward. Alternating Phase Focusing can now be another practical approach in the linear accelerator designer repertoire. Alternating Phase Focusing can be used in addition to conventional magnetic focusing, and could be useful in minimizing the amount of additional magnetic focusing needed to handle a desired amount of beam current.
△ Less
Submitted 21 April, 2014;
originally announced April 2014.
-
Terahertz excitation of a coherent three-level Λ-type exciton-polariton microcavity mode
Authors:
Joseph L. Tomaino,
Andrew D. Jameson,
Yun-Shik Lee,
Galina Khitrova,
Hyatt M. Gibbs,
Andrea C. Klettke,
Mackillo Kira,
Stephan W. Koch
Abstract:
Interactions of few-cycle terahertz pulses with the induced optical polarization in a quantum-well microcavity reveal that the lower and higher exciton-polariton modes together with the optically forbidden 2p-exciton state form a unique Λ-type three-level system. Pronounced nonlinearities are observed via time-resolved strong-terahertz and weak-optical excitation spectroscopy and explained with a…
▽ More
Interactions of few-cycle terahertz pulses with the induced optical polarization in a quantum-well microcavity reveal that the lower and higher exciton-polariton modes together with the optically forbidden 2p-exciton state form a unique Λ-type three-level system. Pronounced nonlinearities are observed via time-resolved strong-terahertz and weak-optical excitation spectroscopy and explained with a fully microscopic theory. The results show that the terahertz pulses strongly couple the exciton-polariton states to the 2p-exciton state while no resonant transition between the two polariton levels is observed.
△ Less
Submitted 9 December, 2011;
originally announced December 2011.
-
Terahertz imaging and spectroscopy of large-area single-layer graphene
Authors:
J. L. Tomaino,
A. D. Jameson,
J. W. Kevek,
M. J. Paul,
A. M. van der Zande,
R. A. Barton,
P. L. McEuen,
E. D. Minot,
Yun-Shik Lee
Abstract:
We demonstrate terahertz (THz) imaging and spectroscopy of a 15x15-mm^2 single-layer graphene film on Si using broadband THz pulses. The THz images clearly map out the THz carrier dynamics of the graphene-on-Si sample, allowing us to measure sheet conductivity with sub-mm resolution without fabricating electrodes. The THz carrier dynamics are dominated by intraband transitions and the THz-induced…
▽ More
We demonstrate terahertz (THz) imaging and spectroscopy of a 15x15-mm^2 single-layer graphene film on Si using broadband THz pulses. The THz images clearly map out the THz carrier dynamics of the graphene-on-Si sample, allowing us to measure sheet conductivity with sub-mm resolution without fabricating electrodes. The THz carrier dynamics are dominated by intraband transitions and the THz-induced electron motion is characterized by a flat spectral response. A theoretical analysis based on the Fresnel coefficients for a metallic thin film shows that the local sheet conductivity varies across the sample from σs = 1.7x10^-3 to 2.4x10^-3 Ω^-1 (sheet resistance, ρs = 420 - 590 Ω/sq).
△ Less
Submitted 17 January, 2011; v1 submitted 6 January, 2011;
originally announced January 2011.
