-
RDD: Pareto Analysis of the Rate-Distortion-Distinguishability Trade-off
Authors:
Andriy Enttsel,
Alex Marchioni,
Andrea Zanellini,
Mauro Mangia,
Gianluca Setti,
Riccardo Rovatti
Abstract:
Extensive monitoring systems generate data that is usually compressed for network transmission. This compressed data might then be processed in the cloud for tasks such as anomaly detection. However, compression can potentially impair the detector's ability to distinguish between regular and irregular patterns due to information loss. Here we extend the information-theoretic framework introduced i…
▽ More
Extensive monitoring systems generate data that is usually compressed for network transmission. This compressed data might then be processed in the cloud for tasks such as anomaly detection. However, compression can potentially impair the detector's ability to distinguish between regular and irregular patterns due to information loss. Here we extend the information-theoretic framework introduced in [1] to simultaneously address the trade-off between the three features on which the effectiveness of the system depends: the effectiveness of compression, the amount of distortion it introduces, and the distinguishability between compressed normal signals and compressed anomalous signals. We leverage a Gaussian assumption to draw curves showing how moving on a Pareto surface helps administer such a trade-off better than simply relying on optimal rate-distortion compression and hoping that compressed signals can be distinguished from each other.
△ Less
Submitted 29 September, 2025;
originally announced September 2025.
-
Goal-Oriented Joint Source-Channel Coding: Distortion-Classification-Power Trade-off
Authors:
Andriy Enttsel,
Weichen Wang,
Mauro Mangia,
Riccardo Rovatti,
Deniz Gündüz
Abstract:
Joint source-channel coding is a compelling paradigm when low-latency and low-complexity communication is required. This work proposes a theoretical framework that integrates classification and anomaly detection within the conventional signal reconstruction objective. Assuming a Gaussian scalar source and constraining the encoder to piecewise linear mappings, we derive tractable design rules and e…
▽ More
Joint source-channel coding is a compelling paradigm when low-latency and low-complexity communication is required. This work proposes a theoretical framework that integrates classification and anomaly detection within the conventional signal reconstruction objective. Assuming a Gaussian scalar source and constraining the encoder to piecewise linear mappings, we derive tractable design rules and explicitly characterize the trade-offs between distortion, classification error, and transmission power.
△ Less
Submitted 17 September, 2025;
originally announced September 2025.
-
Anomaly Detection based on Compressed Data: an Information Theoretic Characterization
Authors:
Alex Marchioni,
Andriy Enttsel,
Mauro Mangia,
Riccardo Rovatti,
Gianluca Setti
Abstract:
We analyze the effect of lossy compression in the processing of sensor signals that must be used to detect anomalous events in the system under observation. The intuitive relationship between the quality loss at higher compression and the possibility of telling anomalous behaviours from normal ones is formalized in terms of information-theoretic quantities. Some analytic derivations are made withi…
▽ More
We analyze the effect of lossy compression in the processing of sensor signals that must be used to detect anomalous events in the system under observation. The intuitive relationship between the quality loss at higher compression and the possibility of telling anomalous behaviours from normal ones is formalized in terms of information-theoretic quantities. Some analytic derivations are made within the Gaussian framework and possibly in the asymptotic regime for what concerns the stretch of signals considered. Analytical conclusions are matched with the performance of practical detectors in a toy case allowing the assessment of different compression/detector configurations.
△ Less
Submitted 30 April, 2022; v1 submitted 6 October, 2021;
originally announced October 2021.
