-
Distributed Control Strategy for Layered Barrier Coverage of Multi-Agent Systems in Uncertain Environments
Authors:
Pengyang Fan,
Chao Zhai
Abstract:
This paper presents a distributed multi-layer ring barrier coverage algorithm. In order to achieve single-layer ring barrier coverage, a distributed single-layer ring barrier coverage algorithm that maximises the probability of monitoring is proposed. Considering the security risks of single-layer barrier coverage, a distributed adjustment mechanism between multiple layers of barriers is designed…
▽ More
This paper presents a distributed multi-layer ring barrier coverage algorithm. In order to achieve single-layer ring barrier coverage, a distributed single-layer ring barrier coverage algorithm that maximises the probability of monitoring is proposed. Considering the security risks of single-layer barrier coverage, a distributed adjustment mechanism between multiple layers of barriers is designed and combined with the single-layer ring barrier coverage algorithm to propose a distributed multi-layer ring barrier coverage algorithm. Furthermore, we present a theoretical analysis of the proposed algorithm to demonstrate its effectiveness and necessity. Finally, our algorithm is verified by numerical simulation and experiment.
△ Less
Submitted 5 January, 2023;
originally announced January 2023.
-
EXK-SC: A Semantic Communication Model Based on Information Framework Expansion and Knowledge Collision
Authors:
Gangtao Xin,
Pingyi Fan
Abstract:
Semantic communication is not focused on improving the accuracy of transmitted symbols, but is concerned with expressing the expected meaning that the symbol sequence exactly carries. However, the measurement of semantic messages and their corresponding codebook generation are still open issues. Expansion, which integrates simple things into a complex system and even generates intelligence, is tru…
▽ More
Semantic communication is not focused on improving the accuracy of transmitted symbols, but is concerned with expressing the expected meaning that the symbol sequence exactly carries. However, the measurement of semantic messages and their corresponding codebook generation are still open issues. Expansion, which integrates simple things into a complex system and even generates intelligence, is truly consistent with the evolution of the human language system. We apply this idea to the semantic communication system, quantifying semantic transmission by symbol sequences and investigating the semantic information system in a similar way as Shannon's method for digital communication systems. This work is the first to discuss semantic expansion and knowledge collision in the semantic information framework. Some important theoretical results are presented, including the relationship between semantic expansion and the transmission information rate. We believe such a semantic information framework may provide a new paradigm for semantic communications, and semantic expansion and knowledge collision will be the cornerstone of semantic information theory.
△ Less
Submitted 21 December, 2022; v1 submitted 24 October, 2022;
originally announced October 2022.
-
New Spectrally Constrained Sequence Sets with Optimal {Periodic} Cross-Correlation
Authors:
Zhifan Ye,
Zhengchun Zhou,
Zilong Liu,
Xiaohu Tang,
Pingzhi Fan
Abstract:
Spectrally constrained sequences (SCSs) play an important role in modern communication and radar systems operating over non-contiguous spectrum. Despite numerous research attempts over the past years, very few works are known on the constructions of optimal SCSs with low cross-correlations. In this paper, we address such a major problem by introducing a unifying framework to construct unimodular S…
▽ More
Spectrally constrained sequences (SCSs) play an important role in modern communication and radar systems operating over non-contiguous spectrum. Despite numerous research attempts over the past years, very few works are known on the constructions of optimal SCSs with low cross-correlations. In this paper, we address such a major problem by introducing a unifying framework to construct unimodular SCS families using circular Florentine rectangles (CFRs) and interleaving techniques. By leveraging the uniform power allocation in the frequency domain for all the admissible carriers (a necessary condition for beating the existing periodic correlation lower bound of SCSs), we present a tighter correlation lower bound and show that it is achievable by our proposed SCS families including multiple SCS sets with zero correlation zone properties.
△ Less
Submitted 26 September, 2022;
originally announced September 2022.
-
Distributed Coverage Control of Multi-Agent Systems with Load Balancing in Non-convex Environments
Authors:
Chao Zhai,
Pengyang Fan
Abstract:
It is always a challenging task to service sudden events in non-convex and uncertain environments, and multi-agent coverage control provides a powerful theoretical framework to investigate the deployment problem of mobile robotic networks for minimizing the cost of handling random events. Inspired by the divide-and-conquer methodology, this paper proposes a novel coverage formulation to control mu…
▽ More
It is always a challenging task to service sudden events in non-convex and uncertain environments, and multi-agent coverage control provides a powerful theoretical framework to investigate the deployment problem of mobile robotic networks for minimizing the cost of handling random events. Inspired by the divide-and-conquer methodology, this paper proposes a novel coverage formulation to control multi-agent systems in the non-convex region while equalizing the workload among subregions. Thereby, a distributed coverage controller is designed to drive each agent towards the desired configurations that minimize the service cost by integrating with the rotational partition strategy. In addition, a circular search algorithm is proposed to identify optimal solutions to the problem of lowering service cost. Moreover, it is proved that this search algorithm enables to approximate the optimal configuration of multi-agent systems with the arbitrary small tolerance. Finally, numerical simulations are implemented to substantiate the efficacy of proposed coverage control approach.
△ Less
Submitted 4 September, 2022;
originally announced September 2022.
-
Why Shape Coding? Asymptotic Analysis of the Entropy Rate for Digital Images
Authors:
Gangtao Xin,
Pingyi Fan,
Khaled B. Letaief
Abstract:
This paper focuses on the ultimate limit theory of image compression. It proves that for an image source, there exists a coding method with shapes that can achieve the entropy rate under a certain condition where the shape-pixel ratio in the encoder/decoder is $O({1 \over {\log t}})$. Based on the new finding, an image coding framework with shapes is proposed and proved to be asymptotically optima…
▽ More
This paper focuses on the ultimate limit theory of image compression. It proves that for an image source, there exists a coding method with shapes that can achieve the entropy rate under a certain condition where the shape-pixel ratio in the encoder/decoder is $O({1 \over {\log t}})$. Based on the new finding, an image coding framework with shapes is proposed and proved to be asymptotically optimal for stationary and ergodic processes. Moreover, the condition $O({1 \over {\log t}})$ of shape-pixel ratio in the encoder/decoder has been confirmed in the image database MNIST, which illustrates the soft compression with shape coding is a near-optimal scheme for lossless compression of images.
△ Less
Submitted 27 December, 2022; v1 submitted 10 April, 2022;
originally announced April 2022.
-
New-Type Hoeffding's Inequalities and Application in Tail Bounds
Authors:
Pingyi Fan
Abstract:
It is well known that Hoeffding's inequality has a lot of applications in the signal and information processing fields. How to improve Hoeffding's inequality and find the refinements of its applications have always attracted much attentions. An improvement of Hoeffding inequality was recently given by Hertz \cite{r1}. Eventhough such an improvement is not so big, it still can be used to update man…
▽ More
It is well known that Hoeffding's inequality has a lot of applications in the signal and information processing fields. How to improve Hoeffding's inequality and find the refinements of its applications have always attracted much attentions. An improvement of Hoeffding inequality was recently given by Hertz \cite{r1}. Eventhough such an improvement is not so big, it still can be used to update many known results with original Hoeffding's inequality, especially for Hoeffding-Azuma inequality for martingales. However, the results in original Hoeffding's inequality and its refinement one by Hertz only considered the first order moment of random variables. In this paper, we present a new type of Hoeffding's inequalities, where the high order moments of random variables are taken into account. It can get some considerable improvements in the tail bounds evaluation compared with the known results. It is expected that the developed new type Hoeffding's inequalities could get more interesting applications in some related fields that use Hoeffding's results.
△ Less
Submitted 1 January, 2021;
originally announced January 2021.
-
Importance of Small Probability Events in Big Data: Information Measures, Applications, and Challenges
Authors:
Rui She,
Shanyun Liu,
Shuo Wan,
Ke Xiong,
Pingyi Fan
Abstract:
In many applications (e.g., anomaly detection and security systems) of smart cities, rare events dominate the importance of the total information of big data collected by Internet of Things (IoTs). That is, it is pretty crucial to explore the valuable information associated with the rare events involved in minority subsets of the voluminous amounts of data. To do so, how to effectively measure the…
▽ More
In many applications (e.g., anomaly detection and security systems) of smart cities, rare events dominate the importance of the total information of big data collected by Internet of Things (IoTs). That is, it is pretty crucial to explore the valuable information associated with the rare events involved in minority subsets of the voluminous amounts of data. To do so, how to effectively measure the information with importance of the small probability events from the perspective of information theory is a fundamental question. This paper first makes a survey of some theories and models with respect to importance measures and investigates the relationship between subjective or semantic importance and rare events in big data. Moreover, some applications for message processing and data analysis are discussed in the viewpoint of information measures. In addition, based on rare events detection, some open challenges related to information measures, such as smart cities, autonomous driving, and anomaly detection in IoTs, are introduced which can be considered as future research directions.
△ Less
Submitted 7 July, 2019; v1 submitted 4 July, 2019;
originally announced July 2019.
-
Information Measure Similarity Theory: Message Importance Measure via Shannon Entropy
Authors:
Rui She,
Shanyun Liu,
Pingyi Fan
Abstract:
Rare events attract more attention and interests in many scenarios of big data such as anomaly detection and security systems. To characterize the rare events importance from probabilistic perspective, the message importance measure (MIM) is proposed as a kind of semantics analysis tool. Similar to Shannon entropy, the MIM has its special functional on information processing, in which the paramete…
▽ More
Rare events attract more attention and interests in many scenarios of big data such as anomaly detection and security systems. To characterize the rare events importance from probabilistic perspective, the message importance measure (MIM) is proposed as a kind of semantics analysis tool. Similar to Shannon entropy, the MIM has its special functional on information processing, in which the parameter $\varpi$ of MIM plays a vital role. Actually, the parameter $\varpi$ dominates the properties of MIM, based on which the MIM has three work regions where the corresponding parameters satisfy $ 0 \le \varpi \le 2/\max\{p(x_i)\}$, $\varpi > 2/\max\{p(x_i)\}$ and $\varpi < 0$ respectively. Furthermore, in the case $ 0 \le \varpi \le 2/\max\{p(x_i)\}$, there are some similarity between the MIM and Shannon entropy in the information compression and transmission, which provide a new viewpoint for information theory. This paper first constructs a system model with message importance measure and proposes the message importance loss to enrich the information processing strategies. Moreover, we propose the message importance loss capacity to measure the information importance harvest in a transmission. Furthermore, the message importance distortion function is presented to give an upper bound of information compression based on message importance measure. Additionally, the bitrate transmission constrained by the message importance loss is investigated to broaden the scope for Shannon information theory.
△ Less
Submitted 4 January, 2019;
originally announced January 2019.
-
Admissible Coalgebras and Non-cosemisimple Hopf Algebras
Authors:
Z. P. Fan
Abstract:
In this paper, we give several necessary conditions for non-cosemisimple coalgebras being admissible. The implications simplify the classification problems for Hopf algebras of dimension 45, 105 and a few others.
In this paper, we give several necessary conditions for non-cosemisimple coalgebras being admissible. The implications simplify the classification problems for Hopf algebras of dimension 45, 105 and a few others.
△ Less
Submitted 7 September, 2018;
originally announced September 2018.
-
A Switch to the Concern of User: Importance Coefficient in Utility Distribution and Message Importance Measure
Authors:
Shanyun Liu,
Rui She,
Shuo Wan,
Pingyi Fan,
Yunquan Dong
Abstract:
This paper mainly focuses on the utilization frequency in receiving end of communication systems, which shows the inclination of the user about different symbols. When the average number of use is limited, a specific utility distribution is proposed on the best effort in term of fairness, which is also the closest one to occurring probability in the relative entropy. Similar to a switch, its param…
▽ More
This paper mainly focuses on the utilization frequency in receiving end of communication systems, which shows the inclination of the user about different symbols. When the average number of use is limited, a specific utility distribution is proposed on the best effort in term of fairness, which is also the closest one to occurring probability in the relative entropy. Similar to a switch, its parameter can be selected to make it satisfy different users' requirements: negative parameter means the user focus on high-probability events and positive parameter means the user is interested in small-probability events. In fact, the utility distribution is a measure of message importance in essence. It illustrates the meaning of message importance measure (MIM), and extend it to the general case by selecting the parameter. Numerical results show that this utility distribution characterizes the message importance like MIM and its parameter determines the concern of users.
△ Less
Submitted 26 March, 2018;
originally announced March 2018.
-
Differential Message Importance Measure: A New Approach to the Required Sampling Number in Big Data Structure Characterization
Authors:
Shanyun Liu,
Rui She,
Pingyi Fan
Abstract:
Data collection is a fundamental problem in the scenario of big data, where the size of sampling sets plays a very important role, especially in the characterization of data structure. This paper considers the information collection process by taking message importance into account, and gives a distribution-free criterion to determine how many samples are required in big data structure characteriz…
▽ More
Data collection is a fundamental problem in the scenario of big data, where the size of sampling sets plays a very important role, especially in the characterization of data structure. This paper considers the information collection process by taking message importance into account, and gives a distribution-free criterion to determine how many samples are required in big data structure characterization. Similar to differential entropy, we define differential message importance measure (DMIM) as a measure of message importance for continuous random variable. The DMIM for many common densities is discussed, and high-precision approximate values for normal distribution are given. Moreover, it is proved that the change of DMIM can describe the gap between the distribution of a set of sample values and a theoretical distribution. In fact, the deviation of DMIM is equivalent to Kolmogorov-Smirnov statistic, but it offers a new way to characterize the distribution goodness-of-fit. Numerical results show some basic properties of DMIM and the accuracy of the proposed approximate values. Furthermore, it is also obtained that the empirical distribution approaches the real distribution with decreasing of the DMIM deviation, which contributes to the selection of suitable sampling points in actual system.
△ Less
Submitted 22 January, 2018;
originally announced January 2018.
-
State Variation Mining: On Information Divergence with Message Importance in Big Data
Authors:
Rui She,
Shanyun Liu,
Pingyi Fan
Abstract:
Information transfer which reveals the state variation of variables usually plays a vital role in big data analytics and processing. In fact, the measures for information transfer could reflect the system change by use of the variable distributions, similar to KL divergence and Renyi divergence. Furthermore, in terms of the information transfer in big data, small probability events usually dominat…
▽ More
Information transfer which reveals the state variation of variables usually plays a vital role in big data analytics and processing. In fact, the measures for information transfer could reflect the system change by use of the variable distributions, similar to KL divergence and Renyi divergence. Furthermore, in terms of the information transfer in big data, small probability events usually dominate the importance of the total message to some degree. Therefore, it is significant to design an information transfer measure based on the message importance which emphasizes the small probability events. In this paper, we propose a message importance transfer measure (MITM) and investigate its characteristics and applications on three aspects. First, the message importance transfer capacity based on MITM is presented to offer an upper bound for the information transfer process with disturbance. Then, we extend the MITM to the continuous case and discuss the robustness by using it to measuring information distance. Finally, we utilize the MITM to guide the queue length selection in the caching operation of mobile edge computing.
△ Less
Submitted 10 November, 2018; v1 submitted 12 January, 2018;
originally announced January 2018.
-
How Many Samples Required in Big Data Collection: A Differential Message Importance Measure
Authors:
Shanyun Liu,
Rui She,
Pingyi Fan
Abstract:
Information collection is a fundamental problem in big data, where the size of sampling sets plays a very important role. This work considers the information collection process by taking message importance into account. Similar to differential entropy, we define differential message importance measure (DMIM) as a measure of message importance for continuous random variable. It is proved that the c…
▽ More
Information collection is a fundamental problem in big data, where the size of sampling sets plays a very important role. This work considers the information collection process by taking message importance into account. Similar to differential entropy, we define differential message importance measure (DMIM) as a measure of message importance for continuous random variable. It is proved that the change of DMIM can describe the gap between the distribution of a set of sample values and a theoretical distribution. In fact, the deviation of DMIM is equivalent to Kolmogorov-Smirnov statistic, but it offers a new way to characterize the distribution goodness-of-fit. Numerical results show some basic properties of DMIM and the accuracy of the proposed approximate values. Furthermore, it is also obtained that the empirical distribution approaches the real distribution with decreasing of the DMIM deviation, which contributes to the selection of suitable sampling points in actual system.
△ Less
Submitted 12 January, 2018;
originally announced January 2018.
-
Non-parametric Message Important Measure: Storage Code Design and Transmission Planning for Big Data
Authors:
Shanyun Liu,
Rui She,
Pingyi Fan,
Khaled B. Letaief
Abstract:
Storage and transmission in big data are discussed in this paper, where message importance is taken into account. Similar to Shannon Entropy and Renyi Entropy, we define non-parametric message important measure (NMIM) as a measure for the message importance in the scenario of big data, which can characterize the uncertainty of random events. It is proved that the proposed NMIM can sufficiently des…
▽ More
Storage and transmission in big data are discussed in this paper, where message importance is taken into account. Similar to Shannon Entropy and Renyi Entropy, we define non-parametric message important measure (NMIM) as a measure for the message importance in the scenario of big data, which can characterize the uncertainty of random events. It is proved that the proposed NMIM can sufficiently describe two key characters of big data: rare events finding and large diversities of events. Based on NMIM, we first propose an effective compressed encoding mode for data storage, and then discuss the channel transmission over some typical channel models. Numerical simulation results show that using our proposed strategy occupies less storage space without losing too much message importance, and there are growth region and saturation region for the maximum transmission, which contributes to designing of better practical communication system.
△ Less
Submitted 29 September, 2017;
originally announced September 2017.
-
New inequalities of Mill's ratio and Its Application to The Inverse Q-function Approximation
Authors:
Pingyi Fan
Abstract:
In this paper, we investigate the Mill's ratio estimation problem and get two new inequalities. Compared to the well known results obtained by Gordon, they becomes tighter. Furthermore, we also discuss the inverse Q-function approximation problem and present some useful results on the inverse solution. Numerical results confirm the validness of our theoretical analysis. In addition, we also presen…
▽ More
In this paper, we investigate the Mill's ratio estimation problem and get two new inequalities. Compared to the well known results obtained by Gordon, they becomes tighter. Furthermore, we also discuss the inverse Q-function approximation problem and present some useful results on the inverse solution. Numerical results confirm the validness of our theoretical analysis. In addition, we also present a conjecture on the bounds of inverse solution on Q-function.
△ Less
Submitted 19 December, 2012;
originally announced December 2012.
