-
Explainable and Class-Revealing Signal Feature Extraction via Scattering Transform and Constrained Zeroth-Order Optimization
Authors:
Naoki Saito,
David Weber
Abstract:
We propose a new method to extract discriminant and explainable features from a particular machine learning model, i.e., a combination of the scattering transform and the multiclass logistic regression. Although this model is well-known for its ability to learn various signal classes with high classification rate, it remains elusive to understand why it can generate such successful classification,…
▽ More
We propose a new method to extract discriminant and explainable features from a particular machine learning model, i.e., a combination of the scattering transform and the multiclass logistic regression. Although this model is well-known for its ability to learn various signal classes with high classification rate, it remains elusive to understand why it can generate such successful classification, mainly due to the nonlinearity of the scattering transform. In order to uncover the meaning of the scattering transform coefficients selected by the multiclass logistic regression (with the Lasso penalty), we adopt zeroth-order optimization algorithms to search an input pattern that maximizes the class probability of a class of interest given the learned model. In order to do so, it turns out that imposing sparsity and smoothness of input patterns is important. We demonstrate the effectiveness of our proposed method using a couple of synthetic time-series classification problems.
△ Less
Submitted 14 April, 2025; v1 submitted 8 February, 2025;
originally announced February 2025.
-
Bounded confidence dynamics and graph control: enforcing consensus
Authors:
Dylan Weber,
Sebastien Motsch,
GuanLin Li
Abstract:
A generic feature of bounded confidence type models is the formation of clusters of agents. We propose and study a variant of bounded confidence dynamics with the goal of inducing unconditional convergence to a consensus. The defining feature of these dynamics, which we name the No one left behind dynamics, is the introduction of a local control on the agents which preserves the connectivity of th…
▽ More
A generic feature of bounded confidence type models is the formation of clusters of agents. We propose and study a variant of bounded confidence dynamics with the goal of inducing unconditional convergence to a consensus. The defining feature of these dynamics, which we name the No one left behind dynamics, is the introduction of a local control on the agents which preserves the connectivity of the interaction network. We rigorously demonstrate that these dynamics result in unconditional convergence to a consensus. The qualitative nature of our argument prevents us quantifying how fast a consensus emerges, however we present numerical evidence that sharp convergence rates would be challenging to obtain for such dynamics. Finally, we propose a relaxed version of the control. The dynamics that result maintain many of the qualitative features of the bounded confidence dynamics yet ultimately still converge to a consensus as the control still maintains connectivity of the interaction network.
△ Less
Submitted 18 June, 2020;
originally announced June 2020.
-
The food seeking behavior of slime mold: a macroscopic approach
Authors:
Simone Göttlich,
Stephen Knapp,
Dylan Weber
Abstract:
Starting from a particle model we derive a macroscopic aggregation-diffusion equation for the evolution of slime mold under the assumption of propagation of chaos in the large particle limit. We analyze properties of the macroscopic model in the stationary case and study the behavior of the slime mold between food sources. The efficient numerical simulation of the aggregation-diffusion equation al…
▽ More
Starting from a particle model we derive a macroscopic aggregation-diffusion equation for the evolution of slime mold under the assumption of propagation of chaos in the large particle limit. We analyze properties of the macroscopic model in the stationary case and study the behavior of the slime mold between food sources. The efficient numerical simulation of the aggregation-diffusion equation allows for a detailed analysis of the interplay between the different regimes drift, interaction and diffusion.
△ Less
Submitted 6 June, 2020;
originally announced June 2020.
-
Stochastic versus deterministic consensus dynamics on graphs
Authors:
Dylan Weber,
Ryan Theisen,
Sebastien Motsch
Abstract:
We study two agent based models of opinion formation - one stochastic in nature and one deterministic. Both models are defined in terms of an underlying graph; we study how the structure of the graph affects the long time behavior of the models in all possible cases of graph topology. We are especially interested in the emergence of a consensus among the agents and provide a condition on the graph…
▽ More
We study two agent based models of opinion formation - one stochastic in nature and one deterministic. Both models are defined in terms of an underlying graph; we study how the structure of the graph affects the long time behavior of the models in all possible cases of graph topology. We are especially interested in the emergence of a consensus among the agents and provide a condition on the graph that is necessary and sufficient for convergence to a consensus in both models. This investigation reveals several contrasts between the models - notably the convergence rates - which are explored through analytical arguments and several numerical experiments.
△ Less
Submitted 30 January, 2019;
originally announced January 2019.
-
Existence and non-existence of transition fronts in mixed ignition-monostable media
Authors:
Cole Graham,
Tau Shean Lim,
Andrew Ma,
David Weber
Abstract:
We study transition fronts for one-dimensional reaction-diffusion equations with compactly perturbed ignition-monostable reactions. We establish an almost sharp condition on reactions which characterizes the existence and non-existence of fronts. In particular, we prove that a strong inhomogeneity in the reaction prevents formation of transition fronts, while a weak inhomogeneity gives rise to a f…
▽ More
We study transition fronts for one-dimensional reaction-diffusion equations with compactly perturbed ignition-monostable reactions. We establish an almost sharp condition on reactions which characterizes the existence and non-existence of fronts. In particular, we prove that a strong inhomogeneity in the reaction prevents formation of transition fronts, while a weak inhomogeneity gives rise to a front. Our work extends results and methods introduced by J. Nolen, J.M. Roquejoffre, L. Ryzhik, and A. Zlatoš.
△ Less
Submitted 9 May, 2017;
originally announced May 2017.