Showing 1–7 of 7 results for author: Venkatasubramanian, V

Arbitrage equilibria in active matter systems

Authors: Venkat Venkatasubramanian, Abhishek Sivaram, N. Sanjeevrajan, Arun Sankar

Abstract: The motility-induced phase separation (MIPS) phenomenon in active matter has been of great interest for the past decade or so. A central conceptual puzzle is that this behavior, which is generally characterized as a nonequilibrium phenomenon, can yet be explained using simple equilibrium models of thermodynamics. Here, we address this problem using a new theory, statistical teleodynamics, which is… ▽ More The motility-induced phase separation (MIPS) phenomenon in active matter has been of great interest for the past decade or so. A central conceptual puzzle is that this behavior, which is generally characterized as a nonequilibrium phenomenon, can yet be explained using simple equilibrium models of thermodynamics. Here, we address this problem using a new theory, statistical teleodynamics, which is a conceptual synthesis of game theory and statistical mechanics. In this framework, active agents compete in their pursuit of maximum effective utility, and this self-organizing dynamics results in an arbitrage equilibrium in which all agents have the same effective utility. We show that MIPS is an example of arbitrage equilibrium and that it is mathematically equivalent to other phase-separation phenomena in entirely different domains, such as sociology and economics. As examples, we present the behavior of Janus particles in a potential trap and the effect of chemotaxis on MIPS. △ Less

Submitted 18 May, 2024; originally announced May 2024.

Comments: arXiv admin note: substantial text overlap with arXiv:2312.05765

Arbitrage equilibrium and the emergence of universal microstructure in deep neural networks

Authors: Venkat Venkatasubramanian, N Sanjeevrajan, Manasi Khandekar, Abhishek Sivaram, Collin Szczepanski

Abstract: Despite the stunning progress recently in large-scale deep neural network applications, our understanding of their microstructure, 'energy' functions, and optimal design remains incomplete. Here, we present a new game-theoretic framework, called statistical teleodynamics, that reveals important insights into these key properties. The optimally robust design of such networks inherently involves com… ▽ More Despite the stunning progress recently in large-scale deep neural network applications, our understanding of their microstructure, 'energy' functions, and optimal design remains incomplete. Here, we present a new game-theoretic framework, called statistical teleodynamics, that reveals important insights into these key properties. The optimally robust design of such networks inherently involves computational benefit-cost trade-offs that are not adequately captured by physics-inspired models. These trade-offs occur as neurons and connections compete to increase their effective utilities under resource constraints during training. In a fully trained network, this results in a state of arbitrage equilibrium, where all neurons in a given layer have the same effective utility, and all connections to a given layer have the same effective utility. The equilibrium is characterized by the emergence of two lognormal distributions of connection weights and neuronal output as the universal microstructure of large deep neural networks. We call such a network the Jaynes Machine. Our theoretical predictions are shown to be supported by empirical data from seven large-scale deep neural networks. We also show that the Hopfield network and the Boltzmann Machine are the same special case of the Jaynes Machine. △ Less

Submitted 5 June, 2024; v1 submitted 29 March, 2024; originally announced May 2024.

Comments: arXiv admin note: text overlap with arXiv:2310.06960

Jaynes Machine: The universal microstructure of deep neural networks

Authors: Venkat Venkatasubramanian, N. Sanjeevrajan, Manasi Khandekar

Abstract: We present a novel theory of the microstructure of deep neural networks. Using a theoretical framework called statistical teleodynamics, which is a conceptual synthesis of statistical thermodynamics and potential game theory, we predict that all highly connected layers of deep neural networks have a universal microstructure of connection strengths that is distributed lognormally ($LN(μ, σ)$). Furt… ▽ More We present a novel theory of the microstructure of deep neural networks. Using a theoretical framework called statistical teleodynamics, which is a conceptual synthesis of statistical thermodynamics and potential game theory, we predict that all highly connected layers of deep neural networks have a universal microstructure of connection strengths that is distributed lognormally ($LN(μ, σ)$). Furthermore, under ideal conditions, the theory predicts that $μ$ and $σ$ are the same for all layers in all networks. This is shown to be the result of an arbitrage equilibrium where all connections compete and contribute the same effective utility towards the minimization of the overall loss function. These surprising predictions are shown to be supported by empirical data from six large-scale deep neural networks in real life. We also discuss how these results can be exploited to reduce the amount of data, time, and computational resources needed to train large deep neural networks. △ Less

Submitted 10 October, 2023; originally announced October 2023.

A unified theory of emergent equilibrium phenomena in active and passive matter

Authors: Venkat Venkatasubramanian, Abhishek Sivaram, Laya Das

Abstract: Recent attempts towards a theory of active matter utilize concepts and methods from hydrodynamics, kinetic theory, and non-equilibrium statistical physics. However, such approaches typically do not seem to recognize the critical feature of some kinds of active matter (particularly the biological ones), namely, the role of purpose, and the naturally attendant concept of the pursuit of maximum utili… ▽ More Recent attempts towards a theory of active matter utilize concepts and methods from hydrodynamics, kinetic theory, and non-equilibrium statistical physics. However, such approaches typically do not seem to recognize the critical feature of some kinds of active matter (particularly the biological ones), namely, the role of purpose, and the naturally attendant concept of the pursuit of maximum utility, which we believe is the crucial difference between active and passive matter. Here we introduce a novel game-theoretic framework, statistical teleodynamics, that accounts for this feature explicitly and show how it can be integrated with conventional statistical mechanics to develop a unified theory of arbitrage equilibrium in active and passive matter. We propose a spectrum of self-actualizing capabilities, going from none to completely strategic decision-making, and envision the various examples of active matter systems occupying someplace in this spectrum. We show how statistical teleodynamics reduces to familiar results in statistical mechanics in the limit of zero self-actualization. At the other extreme, in an economic setting, it provides novel insights about the emergence of income distributions and their fairness in an ideal free-market society. As examples of agents in between these limits, we show how our theory predicts the behavior of active Brownian particles, the emergence of ant craters, and phase equilibria in social segregation dynamics. We suggest that our theory offers a novel systems theoretic perspective of emergent phenomena that could serve as the starting point for a more comprehensive theory of design, control, and optimization through self-organization. △ Less

Submitted 17 June, 2022; originally announced June 2022.

Fairness Is an Emergent Self-Organized Property of the Free Market for Labor

Authors: Venkat Venkatasubramanian

Abstract: The excessive compensation packages of CEOs of U.S. corporations in recent years have brought to the foreground the issue of fairness in economics. The conventional wisdom is that the free market for labor, which determines the pay packages, cares only about efficiency and not fairness. We present an alternative theory that shows that an ideal free market environment also promotes fairness, as an… ▽ More The excessive compensation packages of CEOs of U.S. corporations in recent years have brought to the foreground the issue of fairness in economics. The conventional wisdom is that the free market for labor, which determines the pay packages, cares only about efficiency and not fairness. We present an alternative theory that shows that an ideal free market environment also promotes fairness, as an emergent property resulting from the self-organizing market dynamics. Even though an individual employee may care only about his or her salary and no one else's, the collective actions of all the employees, combined with the profit maximizing actions of all the companies, in a free market environment under budgetary constraints, lead towards a more fair allocation of wages, guided by Adam Smith's invisible hand of self-organization. By exploring deep connections with statistical thermodynamics, we show that entropy is the appropriate measure of fairness in a free market environment which is maximized at equilibrium to yield the lognormal distribution of salaries as the fairest inequality of pay in an organization under ideal conditions. △ Less

Submitted 22 June, 2010; originally announced June 2010.

Journal ref: Entropy 2010, 12(6), 1514-1531

Entropy Maximization as a Holistic Design Principle for Complex Optimal Networks and the Emergence of Power Laws

Authors: Venkat Venkatasubramanian, Dimitris N. Politis, Priyan R. Patkar

Abstract: We present a general holistic theory for the organization of complex networks, both human-engineered and naturally-evolved. Introducing concepts of value of interactions and satisfaction as generic network performance measures, we show that the underlying organizing principle is to meet an overall performance target for wide-ranging operating or environmental conditions. This design or survival… ▽ More We present a general holistic theory for the organization of complex networks, both human-engineered and naturally-evolved. Introducing concepts of value of interactions and satisfaction as generic network performance measures, we show that the underlying organizing principle is to meet an overall performance target for wide-ranging operating or environmental conditions. This design or survival requirement of reliable performance under uncertainty leads, via the maximum entropy principle, to the emergence of a power law vertex degree distribution. The theory also predicts exponential or Poisson degree distributions depending on network redundancy, thus explaining all three regimes as different manifestations of a common underlying phenomenon within a unified theoretical framework. △ Less

Submitted 3 August, 2004; originally announced August 2004.

Comments: CIPAC Tech Report 2004-1 delivered as a seminar in Feb 2004 in the LIPS Seminar Series, School of Chemical Engineering, Purdue University

Spontaneous Emergence of Complex Optimal Networks through Evolutionary Adaptation

Authors: Venkat Venkatasubramanian, Santhoji Katare, Priyan R. Patkar, Fangping Mu

Abstract: An important feature of many complex systems, both natural and artificial, is the structure and organization of their interaction networks with interesting properties. Here we present a theory of self-organization by evolutionary adaptation in which we show how the structure and organization of a network is related to the survival, or in general the performance, objectives of the system. We prop… ▽ More An important feature of many complex systems, both natural and artificial, is the structure and organization of their interaction networks with interesting properties. Here we present a theory of self-organization by evolutionary adaptation in which we show how the structure and organization of a network is related to the survival, or in general the performance, objectives of the system. We propose that a complex system optimizes its network structure in order to maximize its overall survival fitness which is composed of short-term and long-term survival components. These in turn depend on three critical measures of the network, namely, efficiency, robustness and cost, and the environmental selection pressure. Using a graph theoretical case study, we show that when efficiency is paramount the "Star" topology emerges and when robustness is important the "Circle" topology is found. When efficiency and robustness requirements are both important to varying degrees, other classes of networks such as the "Hub" emerge. Our assumptions and results are consistent with observations across a wide variety of applications. △ Less

Submitted 24 February, 2004; originally announced February 2004.

Comments: In press, Computers and Chemical Engg., 2004, 21 pages, 12 figures, 1 table