Skip to main content

Showing 1–19 of 19 results for author: Bai, B

Searching in archive math. Search in all archives.
.
  1. arXiv:2408.08681  [pdf, other

    cs.LG math.NA math.PR

    A Mean Field Ansatz for Zero-Shot Weight Transfer

    Authors: Xingyuan Chen, Wenwei Kuang, Lei Deng, Wei Han, Bo Bai, Goncalo dos Reis

    Abstract: The pre-training cost of large language models (LLMs) is prohibitive. One cutting-edge approach to reduce the cost is zero-shot weight transfer, also known as model growth for some cases, which magically transfers the weights trained in a small model to a large model. However, there are still some theoretical mysteries behind the weight transfer. In this paper, inspired by prior applications of me… ▽ More

    Submitted 16 August, 2024; originally announced August 2024.

    Comments: 40 pages, 6 Figures, 1 table

  2. arXiv:2307.08266  [pdf, other

    math.CO cs.IT

    Phase Transitions of Structured Codes of Graphs

    Authors: Bo Bai, Yu Gao, Jie Ma, Yuze Wu

    Abstract: We consider the symmetric difference of two graphs on the same vertex set $[n]$, which is the graph on $[n]$ whose edge set consists of all edges that belong to exactly one of the two graphs. Let $\mathcal{F}$ be a class of graphs, and let $M_{\mathcal{F}}(n)$ denote the maximum possible cardinality of a family $\mathcal{G}$ of graphs on $[n]$ such that the symmetric difference of any two members… ▽ More

    Submitted 17 July, 2023; originally announced July 2023.

  3. Matroidal Entropy Functions: Constructions, Characterizations and Representations

    Authors: Qi Chen, Minquan Cheng, Baoming Bai

    Abstract: Matroidal entropy functions are entropy functions in the form $\mathbf{h} = \log v \cdot \mathbf{r}_M$ , where $v \ge 2$ is an integer and $\mathbf{r}_M$ is the rank function of a matroid $M$. They can be applied into capacity characterization and code construction of information theory problems such as network coding, secret sharing, index coding and locally repairable code. In this paper, by con… ▽ More

    Submitted 30 January, 2024; v1 submitted 29 June, 2023; originally announced June 2023.

    Comments: 13 pages, 3 figures, accepted by IEEE Transactions on Information Theory

  4. The Double Regularization Method for Capacity Constrained Optimal Transport

    Authors: Tianhao Wu, Qihao Cheng, Zihao Wang, Chaorui Zhang, Bo Bai, Zhongyi Huang, Hao Wu

    Abstract: Capacity constrained optimal transport is a variant of optimal transport, which adds extra constraints on the set of feasible couplings in the original optimal transport problem to limit the mass transported between each pair of source and sink. Based on this setting, constrained optimal transport has numerous applications, e.g., finance, network flow. However, due to the large number of constrain… ▽ More

    Submitted 1 December, 2022; originally announced December 2022.

    Comments: 17 pages, 3 figures

    MSC Class: 49M25; 65K10

    Journal ref: CSIAM Transactions on Applied Mathematics, Volume 4, Number 4, 2023, pp. 776--796

  5. arXiv:2209.13217  [pdf, other

    math.OC eess.SY

    Improving Primal Heuristics for Mixed Integer Programming Problems based on Problem Reduction: A Learning-based Approach

    Authors: Lingying Huang, Xiaomeng Chen, Wei Huo, Jiazheng Wang, Fan Zhang, Bo Bai, Ling Shi

    Abstract: In this paper, we propose a Bi-layer Predictionbased Reduction Branch (BP-RB) framework to speed up the process of finding a high-quality feasible solution for Mixed Integer Programming (MIP) problems. A graph convolutional network (GCN) is employed to predict binary variables' values. After that, a subset of binary variables is fixed to the predicted value by a greedy method conditioned on the pr… ▽ More

    Submitted 27 September, 2022; originally announced September 2022.

    Comments: This paper has been accepted for the publication of ICARCV 2022

  6. arXiv:2209.00283  [pdf, other

    cs.IT math.CO

    Conditional graph entropy as an alternating minimization problem

    Authors: Viktor Harangi, Xueyan Niu, Bo Bai

    Abstract: Conditional graph entropy is known to be the minimal rate for a natural functional compression problem with side information at the receiver. In this paper we show that it can be formulated as an alternating minimization problem, which gives rise to a simple iterative algorithm for numerically computing (conditional) graph entropy. This also leads to a new formula which shows that conditional grap… ▽ More

    Submitted 11 September, 2023; v1 submitted 1 September, 2022; originally announced September 2022.

    MSC Class: 94A17; 94A29; 05C69

  7. Generalizing Körner's graph entropy to graphons

    Authors: Viktor Harangi, Xueyan Niu, Bo Bai

    Abstract: Körner introduced the notion of graph entropy in 1973 as the minimal code rate of a natural coding problem where not all pairs of letters can be distinguished in the alphabet. Later it turned out that it can be expressed as the solution of a minimization problem over the so-called vertex-packing polytope. In this paper we generalize this notion to graphons. We show that the analogous minimizatio… ▽ More

    Submitted 18 August, 2023; v1 submitted 31 August, 2022; originally announced August 2022.

    MSC Class: 94A29; 05C69; 05C80

    Journal ref: European Journal of Combinatorics, Volume 114, December 2023, 103779

  8. arXiv:2207.03760  [pdf, other

    math.PR

    Tail Quantile Estimation for Non-preemptive Priority Queues

    Authors: Jin Guang, Guiyu Hong, Xinyun Chen, Xi Peng, Li Chen, Bo Bai, Gong Zhang

    Abstract: Motivated by applications in computing and telecommunication systems, we investigate the problem of estimating p-quantile of steady-state sojourn times in a single-server multi-class queueing system with non-preemptive priorities for p close to 1. The main challenge in this problem lies in efficient sampling from the tail event. To address this issue, we develop a regenerative simulation algorithm… ▽ More

    Submitted 8 July, 2022; originally announced July 2022.

  9. arXiv:2206.09049  [pdf, other

    math.OC

    Fast Sinkhorn II: Collinear Triangular Matrix and Linear Time Accurate Computation of Optimal Transport

    Authors: Qichen Liao, Zihao Wang, Jing Chen, Bo Bai, Shi Jin, Hao Wu

    Abstract: In our previous work [arXiv:2202.10042], the complexity of Sinkhorn iteration is reduced from $O(N^2)$ to the optimal $O(N)$ by leveraging the special structure of the kernel matrix. In this paper, we explore the special structure of kernel matrices by defining and utilizing the properties of the Lower-ColLinear Triangular Matrix (L-CoLT matrix) and Upper-ColLinear Triangular Matrix (U-CoLT matrix… ▽ More

    Submitted 17 June, 2022; originally announced June 2022.

    Comments: 18 pages, 6 figures

    MSC Class: 49M25; 65K10

  10. arXiv:2202.10042  [pdf, other

    math.OC

    Fast Sinkhorn I: An O(N) algorithm for the Wasserstein-1 metric

    Authors: Qichen Liao, Jing Chen, Zihao Wang, Bo Bai, Shi Jin, Hao Wu

    Abstract: The Wasserstein metric is broadly used in optimal transport for comparing two probabilistic distributions, with successful applications in various fields such as machine learning, signal processing, seismic inversion, etc. Nevertheless, the high computational complexity is an obstacle for its practical applications. The Sinkhorn algorithm, one of the main methods in computing the Wasserstein metri… ▽ More

    Submitted 21 February, 2022; originally announced February 2022.

    Comments: 15 pages, 4 figures

    MSC Class: 49M25; 49M30; 65K10

  11. arXiv:2112.02629  [pdf, other

    eess.SP math.OC

    A Tensor-BTD-based Modulation for Massive Unsourced Random Access

    Authors: Zhenting Luan, Yuchi Wu, Shansuo Liang, Liping Zhang, Wei Han, Bo Bai

    Abstract: In this letter, we propose a novel tensor-based modulation scheme for massive unsourced random access. The proposed modulation can be deemed as a summation of third-order tensors, of which the factors are representatives of subspaces. A constellation design based on high-dimensional Grassmann manifold is presented for information encoding. The uniqueness of tensor decomposition provides theoretica… ▽ More

    Submitted 5 December, 2021; originally announced December 2021.

  12. arXiv:2111.14780  [pdf, ps, other

    eess.SP math.OC

    Harmonic Retrieval with $L_1$-Tucker Tensor Decomposition

    Authors: Zhenting Luan, Zhenyu Ming, Yuchi Wu, Wei Han, Xiang Chen, Bo Bai, Liping Zhang

    Abstract: Harmonic retrieval (HR) has a wide range of applications in the scenes where signals are modelled as a summation of sinusoids. Past works have developed a number of approaches to recover the original signals. Most of them rely on classical singular value decomposition, which are vulnerable to unexpected outliers. In this paper, we present new decomposition algorithms of third-order complex-valued… ▽ More

    Submitted 30 November, 2021; v1 submitted 29 November, 2021; originally announced November 2021.

  13. arXiv:2111.06257  [pdf, other

    cs.LG eess.SY math.OC

    Branch and Bound in Mixed Integer Linear Programming Problems: A Survey of Techniques and Trends

    Authors: Lingying Huang, Xiaomeng Chen, Wei Huo, Jiazheng Wang, Fan Zhang, Bo Bai, Ling Shi

    Abstract: In this paper, we surveyed the existing literature studying different approaches and algorithms for the four critical components in the general branch and bound (B&B) algorithm, namely, branching variable selection, node selection, node pruning, and cutting-plane selection. However, the complexity of the B&B algorithm always grows exponentially with respect to the increase of the decision variable… ▽ More

    Submitted 5 November, 2021; originally announced November 2021.

    Comments: Preprint submitted to Discrete Optimization

  14. arXiv:2111.03376  [pdf, other

    math.OC

    Simplex Initialization: A Survey of Techniques and Trends

    Authors: Mengyu Huang, Yuxing Zhong, Huiwen Yang, Jiazheng Wang, Fan Zhang, Bo Bai, Ling Shi

    Abstract: The simplex method is one of the most fundamental technologies for solving linear programming (LP) problems and has been widely applied to different practical applications. In the past literature, how to improve and accelerate the simplex method has attracted plenty of research. One important way to achieve this goal is to find a better initialization method for the simplex. In this survey, we aim… ▽ More

    Submitted 5 November, 2021; originally announced November 2021.

  15. arXiv:2111.00885  [pdf, other

    cs.SI cs.IT math.CO

    Algorithms for Interference Minimization in Future Wireless Network Decomposition

    Authors: Péter L. Erdős, Tamás Róbert Mezei, Yiding Yu, Xiang Chen, Wei Han, Bo Bai

    Abstract: We propose a simple and fast method for providing a high quality solution for the sum-interference minimization problem. As future networks are deployed in high density urban areas, improved clustering methods are needed to provide low interference network connectivity. The proposed algorithm applies straightforward similarity based clustering and optionally stable matchings to outperform state of… ▽ More

    Submitted 1 November, 2021; originally announced November 2021.

    MSC Class: 05C70; 90C35; 90C59; 90B80; 91C20

  16. arXiv:2102.03358  [pdf, ps, other

    math.OC

    A Convergent Semi-Proximal Alternating Direction Method of Multipliers for Recovering Internet Traffics from Link Measurements

    Authors: Zhenyu Ming, Liping Zhang, Hao Wu, Yanwei Xu, Mayank Bakshi, Bo Bai, Gong Zhang

    Abstract: It is challenging to recover the large-scale internet traffic data purely from the link measurements. With the rapid growth of the problem scale, it will be extremely difficult to sustain the recovery accuracy and the computational cost. In this work, we propose a new Sparsity Low-Rank Recovery (SLRR) model and its Schur Complement Based semi-proximal Alternating Direction Method of Multipliers (S… ▽ More

    Submitted 5 February, 2021; originally announced February 2021.

  17. arXiv:2009.12003   

    math.CO

    Cut Bounds for Some Weighted Graphs

    Authors: Chicheng Ma, Yucong Tang, Guanghui Wang, Guiying Yan, Bo Bai

    Abstract: In communication field, an important issue is to group users and base stations to as many as possible subnetworks satisfying certain interference constraints. These problems are usually formulated as a graph partition problems which minimize some forms of graph cut. Previous research already gave some results about the cut bounds for unweighted regular graph. In this paper, we prove a result about… ▽ More

    Submitted 28 September, 2020; v1 submitted 24 September, 2020; originally announced September 2020.

    Comments: In section 1, two results(theorem 5 and theorem) can be improved and there is some work to be done

  18. Uniform tight frames as optimal signals

    Authors: Gergely Ambrus, Bo Bai, Jianfeng Hou

    Abstract: Non-orthogonal communication is a promising technique for future wireless networks (e.g., 6G and Wi-Fi 7). In the vector channel model, designing efficient non-orthogonal communication schemes amounts to the following extremum problem: \[ \max \min_k \frac{|v_k|^2}{σ^2 + \sum_{l \neq k} \langle v_k, v_l \rangle^2} \] where the maximum is taken among vector systems $(v_k)_1^N \subset \mathbb{R}^d$… ▽ More

    Submitted 26 April, 2021; v1 submitted 10 February, 2020; originally announced February 2020.

    Comments: 14 pages. Accepted for publication in Advances in Applied Mathematics

    MSC Class: 42C40; 52C35

    Journal ref: Advances in Applied Mathematics 129 (2021), 102219

  19. arXiv:1007.4263  [pdf, ps, other

    math.CO

    Vertex-deleted subgraphs and regular factors from regular graph

    Authors: Hongliang Lu, Bing Bai, Wei Wang

    Abstract: Let $k$, $m$ and $r$ be three integers such that $2\leq k\leq m\leq r$. Let $G$ be a $2r$-regular, $2m$-edge-connected graph of odd order. We obtain some sufficient conditions, which guarantee $G-v$ contains a $k$-factor for all $v\in V(G)$.

    Submitted 24 July, 2010; originally announced July 2010.