-
Conformal Prediction for Deep Classifier via Label Ranking
Authors:
Jianguo Huang,
Huajun Xi,
Linjun Zhang,
Huaxiu Yao,
Yue Qiu,
Hongxin Wei
Abstract:
Conformal prediction is a statistical framework that generates prediction sets containing ground-truth labels with a desired coverage guarantee. The predicted probabilities produced by machine learning models are generally miscalibrated, leading to large prediction sets in conformal prediction. To address this issue, we propose a novel algorithm named $\textit{Sorted Adaptive Prediction Sets}$ (SA…
▽ More
Conformal prediction is a statistical framework that generates prediction sets containing ground-truth labels with a desired coverage guarantee. The predicted probabilities produced by machine learning models are generally miscalibrated, leading to large prediction sets in conformal prediction. To address this issue, we propose a novel algorithm named $\textit{Sorted Adaptive Prediction Sets}$ (SAPS), which discards all the probability values except for the maximum softmax probability. The key idea behind SAPS is to minimize the dependence of the non-conformity score on the probability values while retaining the uncertainty information. In this manner, SAPS can produce compact prediction sets and communicate instance-wise uncertainty. Extensive experiments validate that SAPS not only lessens the prediction sets but also broadly enhances the conditional coverage rate of prediction sets.
△ Less
Submitted 6 June, 2024; v1 submitted 10 October, 2023;
originally announced October 2023.
-
Long-distance migration with minimal energy consumption in a thermal turbulent environment
Authors:
Ao Xu,
Hua-Lin Wu,
Heng-Dong Xi
Abstract:
We adopt the reinforcement learning algorithm to train the self-propelling agent migrating long-distance in a thermal turbulent environment. We choose the Rayleigh-Bénard turbulent convection cell with an aspect ratio ($Γ$, which is defined as the ratio between cell length and cell height) of 2 as the training environment. Our results showed that, compared to a naive agent that moves straight from…
▽ More
We adopt the reinforcement learning algorithm to train the self-propelling agent migrating long-distance in a thermal turbulent environment. We choose the Rayleigh-Bénard turbulent convection cell with an aspect ratio ($Γ$, which is defined as the ratio between cell length and cell height) of 2 as the training environment. Our results showed that, compared to a naive agent that moves straight from the origin to the destination, the smart agent can learn to utilize the carrier flow currents to save propelling energy. We then apply the optimal policy obtained from the $Γ=2$ cell and test the smart agent migrating in convection cells with $Γ$ up to 32. In a larger $Γ$ cell, the dominant flow modes of horizontally stacked rolls are less stable, and the energy contained in higher-order flow modes increases. We found that the optimized policy can be successfully extended to convection cells with a larger $Γ$. In addition, the ratio of propelling energy consumed by the smart agent to that of the naive agent decreases with the increase of $Γ$, indicating more propelling energy can be saved by the smart agent in a larger $Γ$ cell. We also evaluate the optimized policy when the agents are being released from the randomly chosen origin, which aims to test the robustness of the learning framework, and possible solutions to improve the success rate are suggested. This work has implications for long-distance migration problems, such as unmanned aerial vehicles patrolling in a turbulent convective environment, where planning energy-efficient trajectories can be beneficial to increase their endurance.
△ Less
Submitted 8 February, 2023; v1 submitted 11 January, 2023;
originally announced January 2023.
-
Migration of self-propelling agent in a turbulent environment with minimal energy consumption
Authors:
Ao Xu,
Hua-Lin Wu,
Heng-Dong Xi
Abstract:
We present a numerical study of training a self-propelling agent to migrate in the unsteady flow environment. We control the agent to utilize the background flow structure by adopting the reinforcement learning algorithm to minimize energy consumption. We considered the agent migrating in two types of flows: one is simple periodical double-gyre flow as a proof-of-concept example, while the other i…
▽ More
We present a numerical study of training a self-propelling agent to migrate in the unsteady flow environment. We control the agent to utilize the background flow structure by adopting the reinforcement learning algorithm to minimize energy consumption. We considered the agent migrating in two types of flows: one is simple periodical double-gyre flow as a proof-of-concept example, while the other is complex turbulent Rayleigh-Bénard convection as a paradigm for migrating in the convective atmosphere or the ocean. The results show that the smart agent in both flows can learn to migrate from one position to another while utilizing background flow currents as much as possible to minimize the energy consumption, which is evident by comparing the smart agent with a naive agent that moves straight from the origin to the destination. In addition, we found that compared to the double-gyre flow, the flow field in the turbulent Rayleigh-Bénard convection exhibits more substantial fluctuations, and the training agent is more likely to explore different migration strategies; thus, the training process is more difficult to converge. Nevertheless, we can still identify an energy-efficient trajectory that corresponds to the strategy with the highest reward received by the agent. These results have important implications for many migration problems such as unmanned aerial vehicles flying in a turbulent convective environment, where planning energy-efficient trajectories are often involved.
△ Less
Submitted 15 March, 2022; v1 submitted 24 January, 2022;
originally announced January 2022.
-
Single-leader multi-follower games for the regulation of two-sided Mobility-as-a-Service markets
Authors:
Haoning Xi,
Didier Aussel,
Wei Liu,
S Travis Waller,
David Rey
Abstract:
Mobility-as-a-Service (MaaS) is an emerging business model driven by the concept of "Everything-as-a-Service" and enabled through mobile internet technologies. In the context of economic deregulation, a MaaS system consists of a typical two-sided market, where travelers and transportation service providers (TSPs) are two groups of agents interacting with each other through a MaaS platform. In this…
▽ More
Mobility-as-a-Service (MaaS) is an emerging business model driven by the concept of "Everything-as-a-Service" and enabled through mobile internet technologies. In the context of economic deregulation, a MaaS system consists of a typical two-sided market, where travelers and transportation service providers (TSPs) are two groups of agents interacting with each other through a MaaS platform. In this study, we propose a modeling and optimization framework for the regulation of two-sided MaaS markets. We consider a name-your-own-price (NYOP)-auction mechanism where travelers submit purchase-bids to accommodate their travel demand via MaaS platform, and TSPs submit sell-bids to supply mobility resources for the MaaS platform in exchange for payments. We cast this problem as a single-leader multi-follower game (SLMFG) where the leader is the MaaS regulator and two groups of follower problems represent the travelers and the TSPs. The MaaS regulator aims to maximize its profits by optimizing operations. In response to the MaaS regulator's decisions, travelers (resp. TSPs) adjust their participation level in the MaaS platform to minimize their travel costs (resp. maximize their profits). We analyze cross-group network effects in the MaaS market, and formulate SLMFGs without and with network effects leading to mixed-integer linear bilevel programming and mixed-integer quadratic bilevel programming problems, respectively. We propose customized branch-and-bound algorithms based on strong duality reformulations to solve these SLMFGs. Extensive numerical experiments conducted on large scale simulation instances generated from realistic mobility data highlight that the performance of the proposed algorithms is significantly superior to a benchmarking approach, and provide meaningful managerial insights for the regulation of two-sided MaaS markets in practice.
△ Less
Submitted 17 September, 2021; v1 submitted 3 June, 2021;
originally announced June 2021.
-
Incentive-compatible mechanisms for online resource allocation in mobility-as-a-service systems
Authors:
Haoning Xi,
Wei Liu,
David Rey,
S. Travis Waller,
Philip Kilby
Abstract:
In the context of `Everything-as-a-Service', the transportation sector has been evolving towards user-centric business models in which customized services and mode-agnostic mobility resources are priced in a unified framework. Yet, in the vast majority of studies on Mobility as a Service (MaaS) systems, mobility resource pricing is based on segmented travel modes, e.g. private vehicle, public tran…
▽ More
In the context of `Everything-as-a-Service', the transportation sector has been evolving towards user-centric business models in which customized services and mode-agnostic mobility resources are priced in a unified framework. Yet, in the vast majority of studies on Mobility as a Service (MaaS) systems, mobility resource pricing is based on segmented travel modes, e.g. private vehicle, public transit and shared mobility services. This study attempts to address this research gap by introducing innovative auction-based online MaaS mechanisms where users can bid for any amount of mode-agnostic mobility resources based on their willingness to pay and preferences. We take the perspective of a MaaS regulator which aims to maximize social welfare by allocating mobility resources to users. We propose two mechanisms which allow users to either pay for the immediate use of mobility service (pay-as-you-go), or to subscribe to mobility service packages (pay-as-a-package). We cast the proposed auction-based mechanisms as online resource allocation problems where users compete for MaaS resources and bid for travel time per trip. We propose (integer-) linear programming formulations to accommodate user bids based on available mobility resources in an online optimization approach. We show that the proposed MaaS mechanisms are incentive-compatible, develop customized online algorithms and derive performance bounds based on competitive analysis. Extensive numerical simulations are conducted on large scale instances generated from realistic mobility data, which highlight the benefits of the proposed MaaS mechanisms and the effectiveness of the proposed online optimization approaches.
△ Less
Submitted 28 March, 2021; v1 submitted 14 September, 2020;
originally announced September 2020.
-
Convergence of eigenvector empirical spectral distribution of sample covariance matrices
Authors:
Haokai Xi,
Fan Yang,
Jun Yin
Abstract:
The eigenvector empirical spectral distribution (VESD) is a useful tool in studying the limiting behavior of eigenvalues and eigenvectors of covariance matrices. In this paper, we study the convergence rate of the VESD of sample covariance matrices to the deformed Marčenko-Pastur (MP) distribution. Consider sample covariance matrices of the form $Σ^{1/2} X X^* Σ^{1/2}$, where $X=(x_{ij})$ is an…
▽ More
The eigenvector empirical spectral distribution (VESD) is a useful tool in studying the limiting behavior of eigenvalues and eigenvectors of covariance matrices. In this paper, we study the convergence rate of the VESD of sample covariance matrices to the deformed Marčenko-Pastur (MP) distribution. Consider sample covariance matrices of the form $Σ^{1/2} X X^* Σ^{1/2}$, where $X=(x_{ij})$ is an $M\times N$ random matrix whose entries are independent random variables with mean zero and variance $N^{-1}$, and $Σ$ is a deterministic positive-definite matrix. We prove that the Kolmogorov distance between the expected VESD and the deformed MP distribution is bounded by $N^{-1+ε}$ for any fixed $ε>0$, provided that the entries $\sqrt{N}x_{ij}$ have uniformly bounded 6th moments and $|N/M-1|\ge τ$ for some constant $τ>0$. This result improves the previous one obtained in \cite{XYZ2013}, which gave the convergence rate $O(N^{-1/2})$ assuming $i.i.d.$ $X$ entries, bounded 10th moment, $Σ=I$ and $M<N$. Moreover, we also prove that under the finite $8$th moment assumption, the convergence rate of the VESD is $O(N^{-1/2+ε})$ almost surely for any fixed $ε>0$, which improves the previous bound $N^{-1/4+ε}$ in \cite{XYZ2013}.
△ Less
Submitted 21 January, 2020; v1 submitted 10 May, 2017;
originally announced May 2017.
-
Multirole Logic (Extended Abstract)
Authors:
Hongwei Xi,
Hanwen Wu
Abstract:
We identify multirole logic as a new form of logic in which conjunction/disjunction is interpreted as an ultrafilter on the power set of some underlying set (of roles) and the notion of negation is generalized to endomorphisms on this underlying set. We formalize both multirole logic (MRL) and linear multirole logic (LMRL) as natural generalizations of classical logic (CL) and classical linear log…
▽ More
We identify multirole logic as a new form of logic in which conjunction/disjunction is interpreted as an ultrafilter on the power set of some underlying set (of roles) and the notion of negation is generalized to endomorphisms on this underlying set. We formalize both multirole logic (MRL) and linear multirole logic (LMRL) as natural generalizations of classical logic (CL) and classical linear logic (CLL), respectively, and also present a filter-based interpretation for intuitionism in multirole logic. Among various meta-properties established for MRL and LMRL, we obtain one named multiparty cut-elimination stating that every cut involving one or more sequents (as a generalization of a (binary) cut involving exactly two sequents) can be eliminated, thus extending the celebrated result of cut-elimination by Gentzen.
△ Less
Submitted 19 March, 2017;
originally announced March 2017.
-
Local circular law for the product of a deterministic matrix with a random matrix
Authors:
Haokai Xi,
Fan Yang,
Jun Yin
Abstract:
It is well known that the spectral measure of eigenvalues of a rescaled square non-Hermitian random matrix with independent entries satisfies the circular law. We consider the product $TX$, where $T$ is a deterministic $N\times M$ matrix and $X$ is a random $M\times N$ matrix with independent entries having zero mean and variance $(N\wedge M)^{-1}$. We prove a general local circular law for the em…
▽ More
It is well known that the spectral measure of eigenvalues of a rescaled square non-Hermitian random matrix with independent entries satisfies the circular law. We consider the product $TX$, where $T$ is a deterministic $N\times M$ matrix and $X$ is a random $M\times N$ matrix with independent entries having zero mean and variance $(N\wedge M)^{-1}$. We prove a general local circular law for the empirical spectral distribution (ESD) of $TX$ at any point $z$ away from the unit circle under the assumptions that $N\sim M$, and the matrix entries $X_{ij}$ have sufficiently high moments. More precisely, if $z$ satisfies $||z|-1|\ge τ$ for arbitrarily small $τ>0$, the ESD of $TX$ converges to $\tilde χ_{\mathbb D}(z) dA(z)$, where $\tilde χ_{\mathbb D}$ is a rotation-invariant function determined by the singular values of $T$ and $dA$ denotes the Lebesgue measure on $\mathbb C$. The local circular law is valid around $z$ up to scale $(N\wedge M)^{-1/4+ε}$ for any $ε>0$. Moreover, if $|z|>1$ or the matrix entries of $X$ have vanishing third moments, the local circular law is valid around $z$ up to scale $(N\wedge M)^{-1/2+ε}$ for any $ε>0$.
△ Less
Submitted 4 June, 2016; v1 submitted 13 March, 2016;
originally announced March 2016.
