Visible-infrared person re-identification has attracted extensive attention from the community due to its potential great application prospects in video surveillance.There are huge modality discrepancies between visib...Visible-infrared person re-identification has attracted extensive attention from the community due to its potential great application prospects in video surveillance.There are huge modality discrepancies between visible and infrared images caused by different imaging mechanisms.Existing studies alleviate modality discrepancies by aligning modality distribution or extracting modality-shared features on the original image.However,they ignore a key solution,i.e.,converting visible images to gray images directly,which is efficient and effective to reduce modality discrepancies.In this paper,we transform the cross-modality person re-identification task from visible-infrared images to gray-infrared images,which is named as the minimal modality discrepancy.In addition,we propose a pyramid feature integration network(PFINet)which mines the discriminative refined features of pedestrian images and fuses high-level and semantically strong features to build a robust pedestrian representation.Specifically,PFINet first performs the feature extraction from concrete to abstract and the top-down semantic transfer to obtain multi-scale feature maps.Second,the multi-scale feature maps are inputted to the discriminative-region response module to emphasize the identity-discriminative regions by the spatial attention mechanism.Finally,the pedestrian representation is obtained by the feature integration.Extensive experiments demonstrate the effectiveness of PFINet which achieves the rank-1 accuracy of 81.95%and mAP of 74.49%on the multi-all evaluation mode of the SYSU-MM01 dataset.展开更多
The original version of this article unfortunately contained some mistakes.(1)In the“Abstract”section,the text“However,integrating the results of multimodal single-cell data to identify cell-to-cell correspondences...The original version of this article unfortunately contained some mistakes.(1)In the“Abstract”section,the text“However,integrating the results of multimodal single-cell data to identify cell-to-cell correspondences remains a challenging task.Our viewpoint emphasizes the importance of data integration at a biologically relevant level of granularity.Furthermore,it is crucial to take into account the inherent discrepancies between different modalities in order to achieve a balance between biological discovery and noise removal.”was incorrect.This should have read:“Despite providing unprecedented insights into cellular heterogeneity,integrating multimodal single-cell data to find cell-to-cell correspondences remains challenging,primarily due to the need for biologically granular integration and the management of technical and biological discrepancies between modalities.”展开更多
基金the National Key Research and Development Program of China under Grant No.2019YFF0301800the National Natural Science Foundation of China under Grant No.61379106the Shandong Provincial Natural Science Foundation under Grant Nos.ZR2013FM036 and ZR2015FM011.
文摘Visible-infrared person re-identification has attracted extensive attention from the community due to its potential great application prospects in video surveillance.There are huge modality discrepancies between visible and infrared images caused by different imaging mechanisms.Existing studies alleviate modality discrepancies by aligning modality distribution or extracting modality-shared features on the original image.However,they ignore a key solution,i.e.,converting visible images to gray images directly,which is efficient and effective to reduce modality discrepancies.In this paper,we transform the cross-modality person re-identification task from visible-infrared images to gray-infrared images,which is named as the minimal modality discrepancy.In addition,we propose a pyramid feature integration network(PFINet)which mines the discriminative refined features of pedestrian images and fuses high-level and semantically strong features to build a robust pedestrian representation.Specifically,PFINet first performs the feature extraction from concrete to abstract and the top-down semantic transfer to obtain multi-scale feature maps.Second,the multi-scale feature maps are inputted to the discriminative-region response module to emphasize the identity-discriminative regions by the spatial attention mechanism.Finally,the pedestrian representation is obtained by the feature integration.Extensive experiments demonstrate the effectiveness of PFINet which achieves the rank-1 accuracy of 81.95%and mAP of 74.49%on the multi-all evaluation mode of the SYSU-MM01 dataset.
文摘The original version of this article unfortunately contained some mistakes.(1)In the“Abstract”section,the text“However,integrating the results of multimodal single-cell data to identify cell-to-cell correspondences remains a challenging task.Our viewpoint emphasizes the importance of data integration at a biologically relevant level of granularity.Furthermore,it is crucial to take into account the inherent discrepancies between different modalities in order to achieve a balance between biological discovery and noise removal.”was incorrect.This should have read:“Despite providing unprecedented insights into cellular heterogeneity,integrating multimodal single-cell data to find cell-to-cell correspondences remains challenging,primarily due to the need for biologically granular integration and the management of technical and biological discrepancies between modalities.”
