Datasets and Representation Learning

Transcription

1 Datasets and Representation Learning

2 2

3 Person Detection Re-Identification Tracking.. 3

4 4

5 5

6 Image database return Query Time: 9:00am Place: 2nd Building Person search Event/action detection Person counting by tracking Behavior analysis 6

7 Representations Variable images: Low quality, part misalignment, Matching Graph matching, Euclidean distance, Attributes Mid-level information: Long sleeve, short hair, Loss Pairwise loss, triplet loss, classification loss, 7

8 Representations Variable images: Low quality, part misalignment, Matching Graph matching, Euclidean distance, Attributes Mid-level information: Long sleeve, short hair, Loss Pairwise loss, triplet loss, classification loss, 8

9 Large-scale re-identification datasets

10 Large scale Coverage/diverse Weather/season Scene Time 11

11 Camera 2 Camera 1 Camera 3 Camera 3 12

12 13

13 14

14 Datasets Market PRID 450S RAiD CUHK03 CUHK02 CUHK01 WARD PRID 2011 CAVIA R GRID i-lids VIPeR time #id 1, ,360 1, #boxes 32, ,920 13,164 7,264 1,942 4, ,264 #distractors 2, k #cam label DPM Hand Hand DPM Hand Hand Hand hand Hand Hand Hand Hand evaluation map+cmc CMC CMC CMC CMC CMC CMC CMC CMC CMC CMC CMC Enlarge the dataset 15

15 Datasets DukeMTMC- ReID Market PRID 450S RAiD CUHK03 CUHK02 CUHK01 WARD PRID 2011 CAVIA R GRID i-lids VIPeR time #id , ,360 1, #boxes 36,003 32, ,920 13,164 7,264 1,942 4, ,264 #distractors 408 2, k #cam label Hand DPM Hand Hand DPM Hand Hand Hand hand Hand Hand Hand Hand evaluation map+cmc map+cmc CMC CMC CMC CMC CMC CMC CMC CMC CMC CMC CMC Enlarge the dataset 16

16 Camera 2 Camera 1 Camera 3 Camera 3 17

17 Extension of Market-1501; 2009 queries, 3.7 groundgruths 18

18 Datasets MARS ilids-vid PRID DPES ETHZ year #id 1, #tracklets 20, , #Boxes 1,067,516 43,800 40, k 8,580 #distractors 3, #cam Label DPM+GMMCP Hand Hand Hand Hand Evaluation map+cmc CMC CMC CMC CMC Enlarge the dataset 19

19 Leaderboard 430+ citations 20

20 Leaderboard 150+ citations Homepage: 21

21 Large scale #Identities #Box for each person #Cameras Coverage/diverse Weather/season Scene Time 22

22 Part-Aligned Representation Learning

23 26

24 Face Frontal? Enough resolution? 27

25 Appearance Deep learning CNN 28

26 29

27 30

28 Attention Part feature extractor CNN Attention Part feature extractor 31

29 Attention Part feature extractor CNN Attention Part feature extractor x Attention Part feature extractor 32

30 x + x 33

31 x x + x + x + x x 34

32 36

33 37

34 38

35 39

36 41

37 42

38 43

39 rank-1 rank-5 rank-10 map BoW (ICCV 2015) PersonNet (Arxiv 2016) Deep Attributes (ECCV 2016) LOMO Feature(CVPR 2015) WARCA Metric (ECCV 2016) Bilinear CNN (Arxiv 2015) Null Space (CVPR 2016) Gated Siamese CNN (ECCV 2016) Our Method

40 rank-1 rank-5 rank-10 rank-20 DeepReID (CVPR 2014) LOMO Feature (CVPR 2015) Improved Deep (CVPR 2015) Null Space (CVPR 2016) Bilinear CNN (Arxiv 2015) PersonNet (Arxiv 2016) Gated Siamese CNN (ECCV 2016) WARCA Metric (ECCV 2016) Our Method

41 rank-1 rank-5 rank-10 rank-20 Salience Matching (ICCV 2013) Improved Deep (CVPR2015) LOMO Feature (CVPR 2015) Null Space (CVPR 2016) WARCA Metric (ECCV 2016) Our Method

42 Attention maps w/o pose Chi Su, Jianing Li, Shiliang Zhang, Junliang Xing, Wen Gao, Qi Tian: Pose-Driven Deep Convolutional Model for Person Re-identification. ICCV 2017: Longhui Wei, Shiliang Zhang, Hantao Yao, Wen Gao, Qi Tian: GLAD: Global-Local-Alignment Descriptor for Pedestrian Retrieval. ACM Multimedia 2017: Liang Zheng, Yujia Huang, Huchuan Lu, Yi Yang: Pose Invariant Embedding for Deep Person Re-identification. CoRR abs/ (2017) Yumin Suh, Jingdong Wang, Siyu Tang, Tao Mei, Kyoung Mu Lee: Part-Aligned Bilinear Representations for Person Reidentification. ECCV

43 Attention maps w/o pose Part boxes Chi Su, Jianing Li, Shiliang Zhang, Junliang Xing, Wen Gao, Qi Tian: Pose-Driven Deep Convolutional Model for Person Re-identification. ICCV 2017: Longhui Wei, Shiliang Zhang, Hantao Yao, Wen Gao, Qi Tian: GLAD: Global-Local-Alignment Descriptor for Pedestrian Retrieval. ACM Multimedia 2017: Liang Zheng, Yujia Huang, Huchuan Lu, Yi Yang: Pose Invariant Embedding for Deep Person Re-identification. CoRR abs/ (2017) Yumin Suh, Jingdong Wang, Siyu Tang, Tao Mei, Kyoung Mu Lee: Part-Aligned Bilinear Representations for Person Reidentification. ECCV

44 Attention maps w/o pose part maps Part boxes Chi Su, Jianing Li, Shiliang Zhang, Junliang Xing, Wen Gao, Qi Tian: Pose-Driven Deep Convolutional Model for Person Re-identification. ICCV 2017: Longhui Wei, Shiliang Zhang, Hantao Yao, Wen Gao, Qi Tian: GLAD: Global-Local-Alignment Descriptor for Pedestrian Retrieval. ACM Multimedia 2017: Liang Zheng, Yujia Huang, Huchuan Lu, Yi Yang: Pose Invariant Embedding for Deep Person Re-identification. CoRR abs/ (2017) Ours: Part maps Yumin Suh, Jingdong Wang, Siyu Tang, Tao Mei, Kyoung Mu Lee: Part-Aligned Bilinear Representations for Person Reidentification. ECCV

45 Attention Part feature extractor CNN Attention Part feature extractor x Attention Part feature extractor 52

46 Attention Attention Attention CNN 53

47 Attention Attention Attention CNN x 54

48 Pose Appearance (CNN) x Pose estimator pretrained on COCO, and re-trained only with the re-id loss 55

49 56

50 57

51 59

52 60

53 61

54 62

55 63

56 64

57 65

58 66

59 67

60 w/o pose w/ pose Scan QR codes to download datasets and codes 68

61 69

62 70

63 Thanks! QA 71