-
Splinets -- Orthogonal Splines and FDA for the Classification Problem
Authors:
Rani Basna,
Hiba Nassar,
Krzysztof Podgórski
Abstract:
This study introduces an efficient workflow for functional data analysis in classification problems, utilizing advanced orthogonal spline bases. The methodology is based on the flexible Splinets package, featuring a novel spline representation designed for enhanced data efficiency. Several innovative features contribute to this efficiency: 1)Utilization of Orthonormal Spline Bases 2)Consideration…
▽ More
This study introduces an efficient workflow for functional data analysis in classification problems, utilizing advanced orthogonal spline bases. The methodology is based on the flexible Splinets package, featuring a novel spline representation designed for enhanced data efficiency. Several innovative features contribute to this efficiency: 1)Utilization of Orthonormal Spline Bases 2)Consideration of Spline Support Sets 3)Data-Driven Knot Selection. Illustrating this approach, we applied the workflow to the Fashion MINST dataset. We demonstrate the classification process and highlight significant efficiency gains. Particularly noteworthy are the improvements that can be achieved through the 2D generalization of our methodology, especially in scenarios where data sparsity and dimension reduction are critical factors. A key advantage of our workflow is the projection operation into the space of splines with arbitrarily chosen knots, allowing for versatile functional data analysis associated with classification problems. Moreover, the study explores Splinets package features suited for functional data analysis. The algebra and calculus of splines use Taylor expansions at the knots within the support sets. Various orthonormalization techniques for B-splines are implemented, including the highly recommended dyadic method, which leads to the creation of splinets. Importantly, the locality of B-splines concerning support sets is preserved in the corresponding splinet. Using this locality, along with implemented algorithms, provides a powerful computational tool for functional data analysis.
△ Less
Submitted 28 November, 2023;
originally announced November 2023.
-
Spline Based Methods for Functional Data on Multivariate Domains
Authors:
Rani Basna,
Hiba Nassar,
Krzysztof Podgórski
Abstract:
Functional data analysis is typically performed in two steps: first, functionally representing discrete observations, and then applying functional methods to the so-represented data. The initial choice of a functional representation may have a significant impact on the second phase of the analysis, as shown in recent research, where data-driven spline bases outperformed the predefined rigid choice…
▽ More
Functional data analysis is typically performed in two steps: first, functionally representing discrete observations, and then applying functional methods to the so-represented data. The initial choice of a functional representation may have a significant impact on the second phase of the analysis, as shown in recent research, where data-driven spline bases outperformed the predefined rigid choice of functional representation. The method chooses an initial functional basis by an efficient placement of the knots using a simple machine-learning algorithm. The approach does not apply directly when the data are defined on domains of a higher dimension than one such as, for example, images. The reason is that in higher dimensions the convenient and numerically efficient spline bases are obtained as tensor bases from 1D spline bases that require knots that are located on a lattice. This does not allow for a flexible knot placement that was fundamental for the 1D approach. The goal of this research is to propose two modified approaches that circumvent the problem by coding the irregular knot selection into their densities and utilizing these densities through the topology of the spaces of splines. This allows for regular grids for the knots and thus facilitates using the spline tensor bases. It is tested on 1D data showing that its performance is comparable to or better than the previous methods.
△ Less
Submitted 14 May, 2024; v1 submitted 28 September, 2023;
originally announced September 2023.
-
Machine Learning Assisted Orthonormal Basis Selection for Functional Data Analysis
Authors:
Rani Basna,
Hiba Nassar,
Krzysztof Podgórski
Abstract:
In implementations of the functional data methods, the effect of the initial choice of an orthonormal basis has not gained much attention in the past. Typically, several standard bases such as Fourier, wavelets, splines, etc. are considered to transform observed functional data and a choice is made without any formal criteria indicating which of the bases is preferable for the initial transformati…
▽ More
In implementations of the functional data methods, the effect of the initial choice of an orthonormal basis has not gained much attention in the past. Typically, several standard bases such as Fourier, wavelets, splines, etc. are considered to transform observed functional data and a choice is made without any formal criteria indicating which of the bases is preferable for the initial transformation of the data into functions. In an attempt to address this issue, we propose a strictly data-driven method of orthogonal basis selection. The method uses recently introduced orthogonal spline bases called the splinets obtained by efficient orthogonalization of the B-splines. The algorithm learns from the data in the machine learning style to efficiently place knots. The optimality criterion is based on the average (per functional data point) mean square error and is utilized both in the learning algorithms and in comparison studies. The latter indicates efficiency that is particularly evident for the sparse functional data and to a lesser degree in analyses of responses to complex physical systems.
△ Less
Submitted 12 March, 2021;
originally announced March 2021.
-
An Approximate Nash Equilibrium for Pure Jump Markov Games of Mean-field-type on Continuous State Space
Authors:
Rani Basna,
Astrid Hilbert,
Vassili N. Kolokoltsov
Abstract:
We investigate mean-field games from the point of view of a large number of indistinguishable players which eventually converges to infinity. The players are weakly coupled via their empirical measure. The dynamics of the states of the individual players is governed by a non-autonomous pure jump type semi group in a Euclidean space, which is not necessarily smoothing. Investigations are conducted…
▽ More
We investigate mean-field games from the point of view of a large number of indistinguishable players which eventually converges to infinity. The players are weakly coupled via their empirical measure. The dynamics of the states of the individual players is governed by a non-autonomous pure jump type semi group in a Euclidean space, which is not necessarily smoothing. Investigations are conducted in the framework of non-linear Markov processes. We show that the individual optimal strategy results from a consistent coupling of an optimal control problem with a forward non-autonomous dynamics. In the limit as the number $N$ of players goes to infinity this leads to a jump-type analog of the well-known non-linear McKean-Vlasov dynamics. The case where one player has an individual preference different from the ones of the remaining players is also covered. The two results combined reveal an epsilon-Nash Equilibrium for the $N$-player games.
△ Less
Submitted 20 February, 2017; v1 submitted 17 May, 2016;
originally announced May 2016.
-
A 1/n Nash equilibrium for non-linear Markov games of mean-field-type on finite state space
Authors:
Rani Basna,
Astrid Hilbert,
Vassili N. Kolokoltsov
Abstract:
We investigate mean field games for players, who are weakly coupled via their empirical measure. To this end we investigate time-dependent pure jump type propagators over a finite space in the framework of non-linear Markov processes. We show that the individual optimal strategy results from a consistent coupling of an optimal control problem with a forward non-autonomous dynamics which leads to t…
▽ More
We investigate mean field games for players, who are weakly coupled via their empirical measure. To this end we investigate time-dependent pure jump type propagators over a finite space in the framework of non-linear Markov processes. We show that the individual optimal strategy results from a consistent coupling of an optimal control problem with a forward non-autonomous dynamics which leads to the well-known Mckean-Vlasov dynamics in the limit as the number N of players goes to infinity. The case where one player has an individual preference different to the ones of the remaining players is also covered. The limiting system represents a 1/N-Nash Equilibrium for the approximating system of N players.
△ Less
Submitted 24 March, 2015; v1 submitted 3 March, 2014;
originally announced March 2014.
