Showing 1–4 of 4 results for author: Khalid, S S

NPT-Loss: A Metric Loss with Implicit Mining for Face Recognition

Authors: Syed Safwan Khalid, Muhammad Awais, Chi-Ho Chan, Zhenhua Feng, Ammarah Farooq, Ali Akbari, Josef Kittler

Abstract: Face recognition (FR) using deep convolutional neural networks (DCNNs) has seen remarkable success in recent years. One key ingredient of DCNN-based FR is the appropriate design of a loss function that ensures discrimination between various identities. The state-of-the-art (SOTA) solutions utilise normalised Softmax loss with additive and/or multiplicative margins. Despite being popular, these Sof… ▽ More Face recognition (FR) using deep convolutional neural networks (DCNNs) has seen remarkable success in recent years. One key ingredient of DCNN-based FR is the appropriate design of a loss function that ensures discrimination between various identities. The state-of-the-art (SOTA) solutions utilise normalised Softmax loss with additive and/or multiplicative margins. Despite being popular, these Softmax+margin based losses are not theoretically motivated and the effectiveness of a margin is justified only intuitively. In this work, we utilise an alternative framework that offers a more direct mechanism of achieving discrimination among the features of various identities. We propose a novel loss that is equivalent to a triplet loss with proxies and an implicit mechanism of hard-negative mining. We give theoretical justification that minimising the proposed loss ensures a minimum separability between all identities. The proposed loss is simple to implement and does not require heavy hyper-parameter tuning as in the SOTA solutions. We give empirical evidence that despite its simplicity, the proposed loss consistently achieves SOTA performance in various benchmarks for both high-resolution and low-resolution FR tasks. △ Less

Submitted 5 March, 2021; originally announced March 2021.

AXM-Net: Implicit Cross-Modal Feature Alignment for Person Re-identification

Authors: Ammarah Farooq, Muhammad Awais, Josef Kittler, Syed Safwan Khalid

Abstract: Cross-modal person re-identification (Re-ID) is critical for modern video surveillance systems. The key challenge is to align cross-modality representations induced by the semantic information present for a person and ignore background information. This work presents a novel convolutional neural network (CNN) based architecture designed to learn semantically aligned cross-modal visual and textual… ▽ More Cross-modal person re-identification (Re-ID) is critical for modern video surveillance systems. The key challenge is to align cross-modality representations induced by the semantic information present for a person and ignore background information. This work presents a novel convolutional neural network (CNN) based architecture designed to learn semantically aligned cross-modal visual and textual representations. The underlying building block, named AXM-Block, is a unified multi-layer network that dynamically exploits the multi-scale knowledge from both modalities and re-calibrates each modality according to shared semantics. To complement the convolutional design, contextual attention is applied in the text branch to manipulate long-term dependencies. Moreover, we propose a unique design to enhance visual part-based feature coherence and locality information. Our framework is novel in its ability to implicitly learn aligned semantics between modalities during the feature learning stage. The unified feature learning effectively utilizes textual data as a super-annotation signal for visual representation learning and automatically rejects irrelevant information. The entire AXM-Net is trained end-to-end on CUHK-PEDES data. We report results on two tasks, person search and cross-modal Re-ID. The AXM-Net outperforms the current state-of-the-art (SOTA) methods and achieves 64.44\% Rank@1 on the CUHK-PEDES test set. It also outperforms its competitors by $>$10\% in cross-viewpoint text-to-image Re-ID scenarios on CrossRe-ID and CUHK-SYSU datasets. △ Less

Submitted 20 July, 2022; v1 submitted 19 January, 2021; originally announced January 2021.

Comments: AAAI-2022 (Oral Paper)

A Convolutional Baseline for Person Re-Identification Using Vision and Language Descriptions

Authors: Ammarah Farooq, Muhammad Awais, Fei Yan, Josef Kittler, Ali Akbari, Syed Safwan Khalid

Abstract: Classical person re-identification approaches assume that a person of interest has appeared across different cameras and can be queried by one of the existing images. However, in real-world surveillance scenarios, frequently no visual information will be available about the queried person. In such scenarios, a natural language description of the person by a witness will provide the only source of… ▽ More Classical person re-identification approaches assume that a person of interest has appeared across different cameras and can be queried by one of the existing images. However, in real-world surveillance scenarios, frequently no visual information will be available about the queried person. In such scenarios, a natural language description of the person by a witness will provide the only source of information for retrieval. In this work, person re-identification using both vision and language information is addressed under all possible gallery and query scenarios. A two stream deep convolutional neural network framework supervised by cross entropy loss is presented. The weights connecting the second last layer to the last layer with class probabilities, i.e., logits of softmax layer are shared in both networks. Canonical Correlation Analysis is performed to enhance the correlation between the two modalities in a joint latent embedding space. To investigate the benefits of the proposed approach, a new testing protocol under a multi modal ReID setting is proposed for the test split of the CUHK-PEDES and CUHK-SYSU benchmarks. The experimental results verify the merits of the proposed system. The learnt visual representations are more robust and perform 22\% better during retrieval as compared to a single modality system. The retrieval with a multi modal query greatly enhances the re-identification capability of the system quantitatively as well as qualitatively. △ Less

Submitted 20 February, 2020; originally announced March 2020.

Comments: 12 pages including references, currently under review in IEEE transactions on Image Processing

Higher-Degree Stochastic Integration Filtering

Authors: Syed Safwan Khalid, Naveed Ur Rehman, Shafayat Abrar

Abstract: We obtain a class of higher-degree stochastic integration filters (SIF) for nonlinear filtering applications. SIF are based on stochastic spherical-radial integration rules that achieve asymptotically exact evaluations of Gaussian weighted multivariate integrals found in nonlinear Bayesian filtering. The superiority of the proposed scheme is demonstrated by comparing the performance of the propose… ▽ More We obtain a class of higher-degree stochastic integration filters (SIF) for nonlinear filtering applications. SIF are based on stochastic spherical-radial integration rules that achieve asymptotically exact evaluations of Gaussian weighted multivariate integrals found in nonlinear Bayesian filtering. The superiority of the proposed scheme is demonstrated by comparing the performance of the proposed fifth-degree SIF against a number of existing stochastic, quasi-stochastic and cubature (Kalman) filters. The proposed filter is demonstrated to outperform existing filters in all cases. △ Less

Submitted 1 August, 2016; originally announced August 2016.

Comments: Submitted to IEEE Signal Processing Letters on 17th July 2016