-
A Ring Topology-based Communication-Efficient Scheme for D2D Wireless Federated Learning
Authors:
Zimu Xu,
Wei Tian,
Yingxin Liu,
Wanjun Ning,
Jingjin Wu
Abstract:
Federated learning (FL) is an emerging technique aiming at improving communication efficiency in distributed networks, where many clients often request to transmit their calculated parameters to an FL server simultaneously. However, in wireless networks, the above mechanism may lead to prolonged transmission time due to unreliable wireless transmission and limited bandwidth. This paper proposes a…
▽ More
Federated learning (FL) is an emerging technique aiming at improving communication efficiency in distributed networks, where many clients often request to transmit their calculated parameters to an FL server simultaneously. However, in wireless networks, the above mechanism may lead to prolonged transmission time due to unreliable wireless transmission and limited bandwidth. This paper proposes a communication scheme to minimize the uplink transmission time for FL in wireless networks. The proposed approach consists of two major elements, namely a modified Ring All-reduce (MRAR) architecture that integrates D2D wireless communications to facilitate the communication process in FL, and a modified Ant Colony Optimization algorithm to identify the optimal composition of the MRAR architecture. Numerical results show that our proposed approach is robust and can significantly reduce the transmission time compared to the conventional star topology. Notably, the reduction in uplink transmission time compared to baseline policies can be substantial in scenarios applicable to large-scale FL, where client devices are densely distributed.
△ Less
Submitted 17 February, 2023; v1 submitted 6 December, 2022;
originally announced December 2022.
-
Sequence Q-Learning Algorithm for Optimal Mobility-Aware User Association
Authors:
Wanjun Ning,
Zimu Xu,
Jingjin Wu,
Tiejun Tong
Abstract:
We consider a wireless network scenario applicable to metropolitan areas with developed public transport networks and high commute demands, where the mobile user equipments (UEs) move along fixed and predetermined trajectories and request to associate with millimeter-wave (mmWave) base stations (BSs). An effective and efficient algorithm, called the Sequence Q-learning Algorithm (SQA), is proposed…
▽ More
We consider a wireless network scenario applicable to metropolitan areas with developed public transport networks and high commute demands, where the mobile user equipments (UEs) move along fixed and predetermined trajectories and request to associate with millimeter-wave (mmWave) base stations (BSs). An effective and efficient algorithm, called the Sequence Q-learning Algorithm (SQA), is proposed to maximize the long-run average transmission rate of the network, which is an NP-hard problem. Furthermore, the SQA tackles the complexity issue by only allowing possible re-associations (handover of a UE from one BS to another) at a discrete set of decision epochs and has polynomial time complexity. This feature of the SQA also restricts too frequent handovers, which are considered highly undesirable in mmWave networks. Moreover, we demonstrate by extensive numerical results that the SQA can significantly outperform the benchmark algorithms proposed in existing research by taking all UEs' future trajectories and possible decisions into account at every decision epoch.
△ Less
Submitted 21 February, 2022; v1 submitted 16 January, 2022;
originally announced January 2022.
-
Deep Semi-Martingale Optimal Transport
Authors:
Ivan Guo,
Nicolas Langrené,
Grégoire Loeper,
Wei Ning
Abstract:
We propose two deep neural network-based methods for solving semi-martingale optimal transport problems. The first method is based on a relaxation/penalization of the terminal constraint, and is solved using deep neural networks. The second method is based on the dual formulation of the problem, which we express as a saddle point problem, and is solved using adversarial networks. Both methods are…
▽ More
We propose two deep neural network-based methods for solving semi-martingale optimal transport problems. The first method is based on a relaxation/penalization of the terminal constraint, and is solved using deep neural networks. The second method is based on the dual formulation of the problem, which we express as a saddle point problem, and is solved using adversarial networks. Both methods are mesh-free and therefore mitigate the curse of dimensionality. We test the performance and accuracy of our methods on several examples up to dimension 10. We also apply the first algorithm to a portfolio optimization problem where the goal is, given an initial wealth distribution, to find an investment strategy leading to a prescribed terminal wealth distribution.
△ Less
Submitted 5 March, 2021;
originally announced March 2021.
-
Portfolio optimization with a prescribed terminal wealth distribution
Authors:
Ivan Guo,
Nicolas Langrené,
Grégoire Loeper,
Wei Ning
Abstract:
This paper studies a portfolio allocation problem, where the goal is to prescribe the wealth distribution at the final time. We study this problem with the tools of optimal mass transport. We provide a dual formulation which we solve by a gradient descent algorithm. This involves solving an associated HJB and Fokker--Planck equation by a finite difference method. Numerical examples for various pre…
▽ More
This paper studies a portfolio allocation problem, where the goal is to prescribe the wealth distribution at the final time. We study this problem with the tools of optimal mass transport. We provide a dual formulation which we solve by a gradient descent algorithm. This involves solving an associated HJB and Fokker--Planck equation by a finite difference method. Numerical examples for various prescribed terminal distributions are given, showing that we can successfully reach attainable targets. We next consider adding consumption during the investment process, to take into account distribution that either not attainable, or sub-optimal.
△ Less
Submitted 18 October, 2020; v1 submitted 27 September, 2020;
originally announced September 2020.
-
Robust utility maximization under model uncertainty via a penalization approach
Authors:
Ivan Guo,
Nicolas Langrené,
Grégoire Loeper,
Wei Ning
Abstract:
This paper addresses the problem of utility maximization under uncertain parameters. In contrast with the classical approach, where the parameters of the model evolve freely within a given range, we constrain them via a penalty function. We show that this robust optimization process can be interpreted as a two-player zero-sum stochastic differential game. We prove that the value function satisfies…
▽ More
This paper addresses the problem of utility maximization under uncertain parameters. In contrast with the classical approach, where the parameters of the model evolve freely within a given range, we constrain them via a penalty function. We show that this robust optimization process can be interpreted as a two-player zero-sum stochastic differential game. We prove that the value function satisfies the Dynamic Programming Principle and that it is the unique viscosity solution of an associated Hamilton-Jacobi-Bellman-Isaacs equation. We test this robust algorithm on real market data. The results show that robust portfolios generally have higher expected utilities and are more stable under strong market downturns. To solve for the value function, we derive an analytical solution in the logarithmic utility case and obtain accurate numerical approximations in the general case by three methods: finite difference method, Monte Carlo simulation, and Generative Adversarial Networks.
△ Less
Submitted 5 July, 2020; v1 submitted 31 July, 2019;
originally announced July 2019.
-
Existence theorem on spectral function for singular nonsymmetric first order differential operators
Authors:
Wuqing Ning
Abstract:
In this paper we study spectral function for a nonsymmetric differential operator on the half line. Two cases of the coefficient matrix are considered, and for each case we prove by Marchenko's method that, to the boundary value problem, there corresponds a spectral function related to which a Marchenko-Parseval equality and an expansion formula are established. Our results extend the classical sp…
▽ More
In this paper we study spectral function for a nonsymmetric differential operator on the half line. Two cases of the coefficient matrix are considered, and for each case we prove by Marchenko's method that, to the boundary value problem, there corresponds a spectral function related to which a Marchenko-Parseval equality and an expansion formula are established. Our results extend the classical spectral theory for self-adjoint Sturm-Liouville operators and Dirac operators.
△ Less
Submitted 31 December, 2014;
originally announced January 2015.
-
A Reconstruction Algorithm for a Semilinear Parabolic Inverse Problem
Authors:
Wuqing Ning,
Xue Qin,
Yunxia Shang
Abstract:
In this paper, we consider an inverse problem to determine a semilinear term of a parabolic equation from a single boundary measurement of Neumann type. For this problem, a reconstruction algorithm is established by the spectral representation for the fundamental solution of heat equation with homogeneous Neumann boundary condition and the Whitney extension theorem.
In this paper, we consider an inverse problem to determine a semilinear term of a parabolic equation from a single boundary measurement of Neumann type. For this problem, a reconstruction algorithm is established by the spectral representation for the fundamental solution of heat equation with homogeneous Neumann boundary condition and the Whitney extension theorem.
△ Less
Submitted 22 December, 2014;
originally announced December 2014.
-
Mixing time of the Card-Cyclic-to-Random shuffle
Authors:
Ben Morris,
Weiyang Ning,
Yuval Peres
Abstract:
The Card-Cyclic-to-Random shuffle on $n$ cards is defined as follows: at time $t$ remove the card with label $t$ mod $n$ and randomly reinsert it back into the deck. Pinsky introduced this shuffle and asked how many steps are needed to mix the deck. He showed $n$ steps do not suffice. Here we show that the mixing time is on the order of $Θ(n \log n)$.
The Card-Cyclic-to-Random shuffle on $n$ cards is defined as follows: at time $t$ remove the card with label $t$ mod $n$ and randomly reinsert it back into the deck. Pinsky introduced this shuffle and asked how many steps are needed to mix the deck. He showed $n$ steps do not suffice. Here we show that the mixing time is on the order of $Θ(n \log n)$.
△ Less
Submitted 14 July, 2012;
originally announced July 2012.
-
A power law of order 1/4 for critical mean-field Swendsen-Wang dynamics
Authors:
Yun Long,
Asaf Nachmias,
Weiyang Ning,
Yuval Peres
Abstract:
The Swendsen-Wang dynamics is a Markov chain widely used by physicists to sample from the Boltzmann-Gibbs distribution of the Ising model. Cooper, Dyer, Frieze and Rue proved that on the complete graph K_n the mixing time of the chain is at most O(n^{1/2}) for all non-critical temperatures. In this paper we show that the mixing time is Theta(1) in high temperatures, Theta(log n) in low temperature…
▽ More
The Swendsen-Wang dynamics is a Markov chain widely used by physicists to sample from the Boltzmann-Gibbs distribution of the Ising model. Cooper, Dyer, Frieze and Rue proved that on the complete graph K_n the mixing time of the chain is at most O(n^{1/2}) for all non-critical temperatures. In this paper we show that the mixing time is Theta(1) in high temperatures, Theta(log n) in low temperatures and Theta(n^{1/4}) at criticality. We also provide an upper bound of O(log n) for Swendsen-Wang dynamics for the q-state ferromagnetic Potts model on any tree with n vertices.
△ Less
Submitted 14 July, 2011;
originally announced July 2011.
