-
I2CKD : Intra- and Inter-Class Knowledge Distillation for Semantic Segmentation
Authors:
Ayoub Karine,
Thibault Napoléon,
Maher Jridi
Abstract:
This paper proposes a new knowledge distillation method tailored for image semantic segmentation, termed Intra- and Inter-Class Knowledge Distillation (I2CKD). The focus of this method is on capturing and transferring knowledge between the intermediate layers of teacher (cumbersome model) and student (compact model). For knowledge extraction, we exploit class prototypes derived from feature maps.…
▽ More
This paper proposes a new knowledge distillation method tailored for image semantic segmentation, termed Intra- and Inter-Class Knowledge Distillation (I2CKD). The focus of this method is on capturing and transferring knowledge between the intermediate layers of teacher (cumbersome model) and student (compact model). For knowledge extraction, we exploit class prototypes derived from feature maps. To facilitate knowledge transfer, we employ a triplet loss in order to minimize intra-class variances and maximize inter-class variances between teacher and student prototypes. Consequently, I2CKD enables the student to better mimic the feature representation of the teacher for each class, thereby enhancing the segmentation performance of the compact network. Extensive experiments on three segmentation datasets, i.e., Cityscapes, Pascal VOC and CamVid, using various teacher-student network pairs demonstrate the effectiveness of the proposed method.
△ Less
Submitted 21 February, 2025; v1 submitted 27 March, 2024;
originally announced March 2024.
-
A Multi-task convolutional neural network for blind stereoscopic image quality assessment using naturalness analysis
Authors:
Salima Bourbia,
Ayoub Karine,
Aladine Chetouani,
Mohammed El Hassouni
Abstract:
This paper addresses the problem of blind stereoscopic image quality assessment (NR-SIQA) using a new multi-task deep learning based-method. In the field of stereoscopic vision, the information is fairly distributed between the left and right views as well as the binocular phenomenon. In this work, we propose to integrate these characteristics to estimate the quality of stereoscopic images without…
▽ More
This paper addresses the problem of blind stereoscopic image quality assessment (NR-SIQA) using a new multi-task deep learning based-method. In the field of stereoscopic vision, the information is fairly distributed between the left and right views as well as the binocular phenomenon. In this work, we propose to integrate these characteristics to estimate the quality of stereoscopic images without reference through a convolutional neural network. Our method is based on two main tasks: the first task predicts naturalness analysis based features adapted to stereo images, while the second task predicts the quality of such images. The former, so-called auxiliary task, aims to find more robust and relevant features to improve the quality prediction. To do this, we compute naturalness-based features using a Natural Scene Statistics (NSS) model in the complex wavelet domain. It allows to capture the statistical dependency between pairs of the stereoscopic images. Experiments are conducted on the well known LIVE PHASE I and LIVE PHASE II databases. The results obtained show the relevance of our method when comparing with those of the state-of-the-art. Our code is available online on https://github.com/Bourbia-Salima/multitask-cnn-nrsiqa_2021.
△ Less
Submitted 21 June, 2021; v1 submitted 17 June, 2021;
originally announced June 2021.
-
Binary Continuous Phase Modulations Robust to a Modulation Index Mismatch
Authors:
Malek Messai,
Colavolpe Giulio,
Amis Karine,
Guilloud Frederic
Abstract:
We consider binary continuous phase modulation (CPM) signals used in some recent low-cost and low-power consumption telecommunications standard. When these signals are generated through a low-cost transmitter, the real modulation index can end up being quite different from the nominal value employed at the receiver and a significant performance degradation is observed, unless proper techniques for…
▽ More
We consider binary continuous phase modulation (CPM) signals used in some recent low-cost and low-power consumption telecommunications standard. When these signals are generated through a low-cost transmitter, the real modulation index can end up being quite different from the nominal value employed at the receiver and a significant performance degradation is observed, unless proper techniques for the estimation and compensation are employed. For this reason, we design new binary schemes with a much higher robustness. They are based on the concatenation of a suitable precoder with binary input and a ternary CPM format. The result is a family of CPM formats whose phase state is constrained to follow a specific evolution. Two of these precoders are considered. We will discuss many aspects related to these schemes, such as the power spectral density, the spectral efficiency, simplified detection, the minimum distance, and the uncoded performance. The adopted precoders do not change the recursive nature of CPM schemes. So these schemes are still suited for serial concatenation, through a pseudo-random interleaver, with an outer channel encoder.
△ Less
Submitted 10 September, 2015;
originally announced September 2015.