Feature Affinity based Pseudo Labeling for Semi-supervised Person Re-identification

IEEE Transactions on Multimedia (TMM) 2019 · Conference version: Center based Pseudo-labeling for Semi-supervised Person Re-identification, ICME Workshops 2018

Guodong Ding¹, Shanshan Zhang¹, Salman Khan², Zhenmin Tang¹, Jian Zhang³ and Fatih Porikli²

¹Nanjing University of Science and Technology   ²Australian National University   ³University of Technology Sydney

Abstract

Vision-based person re-identification aims to match a person’s identity across multiple images, which is a fundamental task in multimedia content analysis and retrieval. Deep neural networks have recently manifested great potential in this task. However, a major bottleneck of existing supervised deep networks is their reliance on large amounts of annotated training data. Manual labeling for person identities in large-scale surveillance camera systems is quite challenging and incurs significant costs. Some recent studies adopt generative model outputs as training data augmentation.

To more effectively use this synthetic data for improved feature learning and re-identification performance, this work proposes a novel Feature Affinity based Pseudo Labeling (FAPL) method with two possible label encodings. To the best of our knowledge, this is the first study that employs pseudo-labeling by measuring the affinity of unlabeled samples with the underlying clusters of labeled data samples using the intermediate feature representations from deep networks. We propose to train the network with the joint supervision of cross-entropy loss together with a center regularization term, which not only ensures discriminative feature representation learning but also simultaneously predicts pseudo labels for unlabeled data. We show that both label encodings can be learned in a unified manner and help improve the overall performance. Our extensive experiments on three person re-identification datasets, Market-1501, DukeMTMC-reID and CUHK03, demonstrate a significant performance boost over the state-of-the-art person re-identification approaches.

Citation

@article{ding2019feature_affinity,
  title   = {Feature Affinity based Pseudo Labeling for Semi-supervised Person Re-identification},
  author  = {Ding, Guodong and Zhang, Shanshan and Khan, Salman and Tang, Zhenmin and Zhang, Jian and Porikli, Fatih},
  journal = {IEEE Transactions on Multimedia},
  volume  = {21},
  number  = {11},
  pages   = {2891--2902},
  year    = {2019}
}

@inproceedings{ding2018center,
  title     = {Center based Pseudo-Labeling for Semi-supervised Person Re-identification},
  author    = {Ding, Guodong and Zhang, Shanshan and Khan, Salman and Tang, Zhenmin},
  booktitle = {IEEE International Conference on Multimedia and Expo Workshops},
  year      = {2018}
}