-
Fourier Learning Machines: Nonharmonic Fourier-Based Neural Networks for Scientific Machine Learning
Authors:
Mominul Rubel,
Adam Meyers,
Gabriel Nicolosi
Abstract:
We introduce the Fourier Learning Machine (FLM), a neural network (NN) architecture designed to represent a multidimensional nonharmonic Fourier series. The FLM uses a simple feedforward structure with cosine activation functions to learn the frequencies, amplitudes, and phase shifts of the series as trainable parameters. This design allows the model to create a problem-specific spectral basis ada…
▽ More
We introduce the Fourier Learning Machine (FLM), a neural network (NN) architecture designed to represent a multidimensional nonharmonic Fourier series. The FLM uses a simple feedforward structure with cosine activation functions to learn the frequencies, amplitudes, and phase shifts of the series as trainable parameters. This design allows the model to create a problem-specific spectral basis adaptable to both periodic and nonperiodic functions. Unlike previous Fourier-inspired NN models, the FLM is the first architecture able to represent a complete, separable Fourier basis in multiple dimensions using a standard Multilayer Perceptron-like architecture. A one-to-one correspondence between the Fourier coefficients and amplitudes and phase-shifts is demonstrated, allowing for the translation between a full, separable basis form and the cosine phase--shifted one. Additionally, we evaluate the performance of FLMs on several scientific computing problems, including benchmark Partial Differential Equations (PDEs) and a family of Optimal Control Problems (OCPs). Computational experiments show that the performance of FLMs is comparable, and often superior, to that of established architectures like SIREN and vanilla feedforward NNs.
△ Less
Submitted 10 September, 2025;
originally announced September 2025.
-
An Initial Condition-Dependent Neural Network Approach for Optimal Control Problems
Authors:
Mominul Rubel,
Gabriel Nicolosi
Abstract:
In this work, we investigate an indirect approach for the numerical solution of optimal control problems via neural networks. A customized neural network is constructed, where optimal state, co-state and control trajectories are approximated by minimizing the underlying parameterized Hamiltonian, relying on Pontryagin's Minimum Principle. Departing from previous results reported in the literature,…
▽ More
In this work, we investigate an indirect approach for the numerical solution of optimal control problems via neural networks. A customized neural network is constructed, where optimal state, co-state and control trajectories are approximated by minimizing the underlying parameterized Hamiltonian, relying on Pontryagin's Minimum Principle. Departing from previous results reported in the literature, we propose novel, modified networks with both time and trajectory initial condition as inputs. Numerical results demonstrate the ability of neural networks to integrate both time and initial condition information in solving optimal control problems. Finally, it is empirically demonstrated that approximation accuracy may be enhanced through a structural modification incorporating an intermediate layer of Fourier coefficients.
△ Less
Submitted 12 February, 2025;
originally announced February 2025.
-
A Multidimensional Fourier Approximation of Optimal Control Surfaces
Authors:
Gabriel Nicolosi,
Terry Friesz,
Christopher Griffin
Abstract:
This work considers the problem of approximating initial condition and time-dependent optimal control and trajectory surfaces using multivariable Fourier series. A modified Augmented Lagrangian algorithm for translating the optimal control problem into an unconstrained optimization one is proposed and two problems are solved: a quadratic control problem in the context of Newtonian mechanics, and a…
▽ More
This work considers the problem of approximating initial condition and time-dependent optimal control and trajectory surfaces using multivariable Fourier series. A modified Augmented Lagrangian algorithm for translating the optimal control problem into an unconstrained optimization one is proposed and two problems are solved: a quadratic control problem in the context of Newtonian mechanics, and a control problem arising from an odd-circulant game ruled by the replicator dynamics. Various computational results are presented. Use of automatic differentiation is explored to circumvent the elaborated gradient computation in the first-order optimization procedure. Furthermore, mean square error bounds are derived for the case of one and two-dimensional Fourier series approximations, inducing a general bound for problems of $n$ dimensions.
△ Less
Submitted 12 December, 2023; v1 submitted 28 June, 2023;
originally announced June 2023.
-
Approximation of Optimal Control Surfaces for the Bass Model with Stochastic Dynamics
Authors:
Gabriel Nicolosi,
Christopher Griffin
Abstract:
The Bass diffusion equation is a well-known and established modeling approach for describing new product adoption in a competitive market. This model also describes diffusion phenomena in various contexts: infectious disease spread modeling and estimation, rumor spread on social networks, prediction of renewable energy technology markets, among others. Most of these models, however, consider a det…
▽ More
The Bass diffusion equation is a well-known and established modeling approach for describing new product adoption in a competitive market. This model also describes diffusion phenomena in various contexts: infectious disease spread modeling and estimation, rumor spread on social networks, prediction of renewable energy technology markets, among others. Most of these models, however, consider a deterministic trajectory of the associated state variable (e.g., market-share). In reality, the diffusion process is subject to noise, and a stochastic component must be added to the state dynamics. The stochastic Bass model has also been studied in many areas, such as energy markets and marketing. Exploring the stochastic version of the Bass diffusion model, we propose in this work an approximation of (stochastic) optimal control surfaces for a continuous-time problem arising from a $2\times2$ skew symmetric evolutionary game, providing the stochastic counter-part of the Fourier-based optimal control approximation already existent in the literature.
△ Less
Submitted 24 April, 2023;
originally announced April 2023.
-
Approximation of Optimal Control Surfaces for $2\times 2$ Skew-Symmetric Evolutionary Game Dynamics
Authors:
Gabriel Nicolosi,
Terry Friesz,
Christopher Griffin
Abstract:
In this paper we study the problem of approximating the general solution to an optimal control problem whose dynamics arise from a $2\times 2$ skew-symmetric evolutionary game with arbitrary initial condition. Our approach uses a Fourier approximation method and generalizes prior work in the use of orthogonal function approximation for optimal control. At the same time we cast the fitting problem…
▽ More
In this paper we study the problem of approximating the general solution to an optimal control problem whose dynamics arise from a $2\times 2$ skew-symmetric evolutionary game with arbitrary initial condition. Our approach uses a Fourier approximation method and generalizes prior work in the use of orthogonal function approximation for optimal control. At the same time we cast the fitting problem in the context of a non-standard feedforward neural network and derive the back-propagation operator in this context. An example of the efficacy of this approach is provided and generalizations are discussed.
△ Less
Submitted 14 July, 2022;
originally announced July 2022.
