-
Linear Extensions of Rotor-Routing in Directed Graphs: Reachability Problems
Authors:
David Auger,
Pierre Coucheney,
Kossi Roland Etse
Abstract:
We introduce a linear extension of the rotor-routing model in directed graphs, akin to the sandpile model and vector addition systems, together with new rotor mechanisms that extend standard cyclic rotors. In this framework, rotor-routing is interpreted as the simultaneous movement of particles accross two coupled graphs, involving both vertex and arc-based particles. The standard, combinatorial r…
▽ More
We introduce a linear extension of the rotor-routing model in directed graphs, akin to the sandpile model and vector addition systems, together with new rotor mechanisms that extend standard cyclic rotors. In this framework, rotor-routing is interpreted as the simultaneous movement of particles accross two coupled graphs, involving both vertex and arc-based particles. The standard, combinatorial rotor-routing of positive particles (legal routing) based on rotor-configurations, then becomes a special case of a linear equivalence. We give comprehensive reachability results characterizing legal routings among linear equivalences, expanding on previous results, and settle the algorithmic complexities associated with these problems.
△ Less
Submitted 27 November, 2024;
originally announced November 2024.
-
Generalized ARRIVAL Problem for Rotor Walks in Path Multigraphs
Authors:
David Auger,
Pierre Coucheney,
Loric Duhazé,
Kossi Roland Etse
Abstract:
Rotor walks are cellular automata that determine deterministic traversals of particles in a directed multigraph using simple local rules, yet they can generate complex behaviors. Furthermore, these trajectories exhibit statistical properties similar to random walks.
In this study, we investigate a generalized version of the reachability problem known as ARRIVAL in Path Multigraphs, which involve…
▽ More
Rotor walks are cellular automata that determine deterministic traversals of particles in a directed multigraph using simple local rules, yet they can generate complex behaviors. Furthermore, these trajectories exhibit statistical properties similar to random walks.
In this study, we investigate a generalized version of the reachability problem known as ARRIVAL in Path Multigraphs, which involves predicting the number of particles that will reach designated target vertices. We show that this problem is in NP and co-NP in the general case. However, we exhibit algebraic invariants for Path Multigraphs that allow us to solve the problem efficiently, even for an exponential configuration of particles. These invariants are based on harmonic functions and are connected to the decomposition of integers in rational bases.
△ Less
Submitted 4 July, 2023;
originally announced July 2023.
-
Polynomial Time Algorithm for ARRIVAL on Tree-like Multigraphs
Authors:
David Auger,
Pierre Coucheney,
Loric Duhaze
Abstract:
A rotor walk in a directed graph can be thought of as a deterministic version of a Markov Chain, where a pebble moves from vertex to vertex following a simple rule until a terminal vertex, or sink, is reached. The ARRIVAL problem, as defined by Dohrau and al., consists in determining which sink will be reached. While the walk itself can take an exponential number of steps, this problem belongs to…
▽ More
A rotor walk in a directed graph can be thought of as a deterministic version of a Markov Chain, where a pebble moves from vertex to vertex following a simple rule until a terminal vertex, or sink, is reached. The ARRIVAL problem, as defined by Dohrau and al., consists in determining which sink will be reached. While the walk itself can take an exponential number of steps, this problem belongs to the complexity class NP$\cap$co-NP without being known to be in P. Several variants have been studied where we add one or two players to the model, defining deterministic analogs of stochastic models (e.g., Markovian decision processes, Stochastic Games) with rotor-routing rules instead of random transitions. The corresponding decision problem address the existence of strategies for players that ensure some condition on the reached sink. These problems are known to be $NP$-complete for one player and $PSPACE$-complete for two players. In this work, we define a class of directed graphs, namely tree-like multigraphs, which are multigraphs having the global shape of an undirected tree. We prove that the different variants of the reachability problem with zero, one, or two players can be solved in linear time, while the number of steps of rotor walks can still be exponential. To achieve this, we define a notion of return flow, which counts the number of times the pebble will bounce back in subtrees of the graph.
△ Less
Submitted 30 April, 2022; v1 submitted 27 April, 2022;
originally announced April 2022.
-
Solving Simple Stochastic Games with few Random Nodes faster using Bland's Rule
Authors:
David Auger,
Pierre Coucheney,
Yann Strozecki
Abstract:
The best algorithm so far for solving Simple Stochastic Games is Ludwig's randomized algorithm which works in expected $2^{O(\sqrt{n})}$ time. We first give a simpler iterative variant of this algorithm, using Bland's rule from the simplex algorithm, which uses exponentially less random bits than Ludwig's version. Then, we show how to adapt this method to the algorithm of Gimbert and Horn whose wo…
▽ More
The best algorithm so far for solving Simple Stochastic Games is Ludwig's randomized algorithm which works in expected $2^{O(\sqrt{n})}$ time. We first give a simpler iterative variant of this algorithm, using Bland's rule from the simplex algorithm, which uses exponentially less random bits than Ludwig's version. Then, we show how to adapt this method to the algorithm of Gimbert and Horn whose worst case complexity is $O(k!)$, where $k$ is the number of random nodes. Our algorithm has an expected running time of $2^{O(k)}$, and works for general random nodes with arbitrary outdegree and probability distribution on outgoing arcs.
△ Less
Submitted 16 January, 2019;
originally announced January 2019.
-
Optimal Distributed Channel Assignment in D2D Networks Using Learning in Noisy Potential Games
Authors:
Mohd. Shabbir Ali,
Pierre Coucheney,
Marceau Coupechoux
Abstract:
We present a novel solution for Channel Assignment Problem (CAP) in Device-to-Device (D2D) wireless networks that takes into account the throughput estimation noise. CAP is known to be NP-hard in the literature and there is no practical optimal learning algorithm that takes into account the estimation noise. In this paper, we first formulate the CAP as a stochastic optimization problem to maximize…
▽ More
We present a novel solution for Channel Assignment Problem (CAP) in Device-to-Device (D2D) wireless networks that takes into account the throughput estimation noise. CAP is known to be NP-hard in the literature and there is no practical optimal learning algorithm that takes into account the estimation noise. In this paper, we first formulate the CAP as a stochastic optimization problem to maximize the expected sum data rate. To capture the estimation noise, CAP is modeled as a noisy potential game, a novel notion we introduce in this paper. Then, we propose a distributed Binary Log-linear Learning Algorithm (BLLA) that converges to the optimal channel assignments. Convergence of BLLA is proved for bounded and unbounded noise. Proofs for fixed and decreasing temperature parameter of BLLA are provided. A sufficient number of estimation samples is given that guarantees the convergence to the optimal state. We assess the performance of BLLA by extensive simulations, which show that the sum data rate increases with the number of channels and users. Contrary to the better response algorithm, the proposed algorithm achieves the optimal channel assignments distributively even in presence of estimation noise.
△ Less
Submitted 17 January, 2017;
originally announced January 2017.
-
Finding Optimal Strategies of Almost Acyclic Simple Stochatic Games
Authors:
David Auger,
Pierre COUCHENEY,
Yann Strozecki
Abstract:
The optimal value computation for turned-based stochastic games with reachability objectives, also known as simple stochastic games, is one of the few problems in $NP \cap coNP$ which are not known to be in $P$. However, there are some cases where these games can be easily solved, as for instance when the underlying graph is acyclic. In this work, we try to extend this tractability to several cl…
▽ More
The optimal value computation for turned-based stochastic games with reachability objectives, also known as simple stochastic games, is one of the few problems in $NP \cap coNP$ which are not known to be in $P$. However, there are some cases where these games can be easily solved, as for instance when the underlying graph is acyclic. In this work, we try to extend this tractability to several classes of games that can be thought as "almost" acyclic. We give some fixed-parameter tractable or polynomial algorithms in terms of different parameters such as the number of cycles or the size of the minimal feedback vertex set.
△ Less
Submitted 3 February, 2014;
originally announced February 2014.
-
Penalty-regulated dynamics and robust learning procedures in games
Authors:
Pierre Coucheney,
Bruno Gaujal,
Panayotis Mertikopoulos
Abstract:
Starting from a heuristic learning scheme for N-person games, we derive a new class of continuous-time learning dynamics consisting of a replicator-like drift adjusted by a penalty term that renders the boundary of the game's strategy space repelling. These penalty-regulated dynamics are equivalent to players keeping an exponentially discounted aggregate of their on-going payoffs and then using a…
▽ More
Starting from a heuristic learning scheme for N-person games, we derive a new class of continuous-time learning dynamics consisting of a replicator-like drift adjusted by a penalty term that renders the boundary of the game's strategy space repelling. These penalty-regulated dynamics are equivalent to players keeping an exponentially discounted aggregate of their on-going payoffs and then using a smooth best response to pick an action based on these performance scores. Owing to this inherent duality, the proposed dynamics satisfy a variant of the folk theorem of evolutionary game theory and they converge to (arbitrarily precise) approximations of Nash equilibria in potential games. Motivated by applications to traffic engineering, we exploit this duality further to design a discrete-time, payoff-based learning algorithm which retains these convergence properties and only requires players to observe their in-game payoffs: moreover, the algorithm remains robust in the presence of stochastic perturbations and observation errors, and it does not require any synchronization between players.
△ Less
Submitted 6 April, 2014; v1 submitted 9 March, 2013;
originally announced March 2013.
-
A Distributed Algorithm for Fair and Efficient User-Network Association in Multi-Technology Wireless Networks
Authors:
Pierre Coucheney,
Corinne Touati,
Bruno Gaujal
Abstract:
Recent mobile equipment (as well as the norm IEEE 802.21) now offers the possibility for users to switch from one technology to another (vertical handover). This allows flexibility in resource assignments and, consequently, increases the potential throughput allocated to each user. In this paper, we design a fully distributed algorithm based on trial and error mechanisms that exploits the benefi…
▽ More
Recent mobile equipment (as well as the norm IEEE 802.21) now offers the possibility for users to switch from one technology to another (vertical handover). This allows flexibility in resource assignments and, consequently, increases the potential throughput allocated to each user. In this paper, we design a fully distributed algorithm based on trial and error mechanisms that exploits the benefits of vertical handover by finding fair and efficient assignment schemes. On the one hand, mobiles gradually update the fraction of data packets they send to each network based on the rewards they receive from the stations. On the other hand, network stations send rewards to each mobile that represent the impact each mobile has on the cell throughput. This reward function is closely related to the concept of marginal cost in the pricing literature. Both the station and the mobile algorithms are simple enough to be implemented in current standard equipment. Based on tools from evolutionary games, potential games and replicator dynamics, we analytically show the convergence of the algorithm to solutions that are efficient and fair in terms of throughput. Moreover, we show that after convergence, each user is connected to a single network cell which avoids costly repeated vertical handovers. Several simple heuristics based on this algorithm are proposed to achieve fast convergence. Indeed, for implementation purposes, the number of iterations should remain in the order of a few tens. We also compare, for different loads, the quality of their solutions.
△ Less
Submitted 7 September, 2009; v1 submitted 18 September, 2008;
originally announced September 2008.
