-
Abstract:
Gait energy image (GEI) is composed of static body silhouette and dynamic frequency information of human gait. To achieve fast and efficient gait recognition, combined with the accurate description of the information of details and directions in image by Curvelet transform, a gait recognition method using GEI and Curvelet (GEIC) is presented. Firstly, to gain the gait energy images, the gait cycle is selected according to the aspect ratio. Secondly, Curvelet energy coefficients of the GEI, which are used as gait feature vector, are extracted by Curvelet transform in different scales and different directions. Finally, the gait recognition is accomplished by the K nearest neighbor (KNN) classifier. The experimental results demonstrate that GEIC performs well on CASIA(B) database, with the average accuracy of 86.83%. Compared with GEI+KPCA, GEI+W(2D)2PCA and GEI+(2D)2PCA, the algorithm GEIC achieves better robustness in the condition of the person wearing or packaging.
-
Key words:
- gait recognition /
- GEI /
- curvelet decomposition /
- curvelet feature extraction /
- KNN
-
Abstract:International and domestic academics are attracted by biometric features recognition, because the intelligent monitoring, which is the basis of social security, is more and more required by people. Compared with other biometric features (face, iris fingerprint and so on), gait feature has its advantages, such as acceptability, noninvasiveness, hard to hide and easy to be collected. Gait recognition, recognizing different persons by the way of his/her walking, which has some advantages such as non-contact, low demand in image quality and difficult disguise, is the most potentially biological recognition technology by the way of one’s walking. Recently, the research of gait recognition is a hot topic in the field of computer vision, entrance guard system and medical diagnose, which has extensive realistic significance and wide applying foreground.
Gait feature, which is extracted to describe the motion of a cycle gait, is the key step of gait recognition to our way of thinking. Gait energy image (GEI), which contains both the static silhouette feature and the dynamic frequency of each part of human body in the process of walking, is demonstrated to be an effective feature for identity recognition. GEI reflecting gait characteristic is gained from gait images of one cycle by using weighted average method. Compared with using all the gait images of one cycle as the gait feature, computation complexity is decreased in a large part by using GEI. Curvelet transformation is a multi-scale pyramid decomposition, which reflects one image at different directions and scales. However, this pyramid is nonstandard because the length and width which is the square of length in each Curvelet are variable. On account of the accurate description of the detail and direction information of gait frequency by Curvelet transform, GEI is analyzed in the view of texture analysis by the extracted Curvelet features.
To achieve fast and efficient gait recognition, combined with the accurate description of the information of details and directions in image by Curvelet transform, a gait recognition method using GEI and Curvelet (GEIC) is presented. Firstly, the gait cycle is selected through analyzing the aspect ratio of a gait sequence and one cycle gait images are normalized and centralized to reduce redundant information computation complexity. Secondly, gait energy image is extracted by weighted average method from those gait images after preprocessing. Thirdly, Curvelet energy coefficients of the GEI, which were used as gait feature vector, were extracted by Curvelet transform in different scales and different directions. Finally, the gait recognition was accomplished by the K nearest neighbor (KNN) classifier. The experimental results demonstrate that GEIC performs well on CASIA (B) database, with the average accuracy as 86.83%. Compared with GEI+KPCA, GEI+W(2D)2PCA and GEI+(2D)2PCA , the proposed algorithm based on GEI and Curvelet for gait recognition gets higher performance. Thus, the information of human body silhouette and motion frequency in GEI can be expressed accurately by Curvelet with less energy coefficients in the multi-scale, considering the view of the edge and texture. Using the energy coefficients of Curvelet transform as gait feature vector can not only improve the recognition efficiency, but also reduce the dimension of gait feature which basically satisfies the real-time requirement.
-
Table 1. The Curvelet feature of GEI.
Feature 1 2 3 4 5 6 7 8 9 10 Value 12247.9 140.705 326.293 349.155 216.235 251.192 446.521 617.081 345.962 140.705 Feature 11 12 13 14 15 16 17 18 19 20 Value 326.293 349.155 216.235 251.192 446.521 617.081 345.962 56.89389 100.066 111.513 Feature 21 22 23 24 25 26 27 28 29 30 Value 151.409 138.979 131.168 60.783 49.7588 61.3174 80.2487 91.9216 135.123 223.940 Feature 31 32 33 34 35 36 37 38 39 40 Value 178.354 70.7249 77.8300 56.8939 100.066 111.513 151.409 138.979 131.168 60.7834 Feature 41 42 43 44 45 46 47 48 49 50 Value 49.7588 61.3174 91.9216 91.9216 135.123 223.940 178.354 70.7249 77.8300 210.850 Table 2. Training and testing selection of Sets1, Sets2 and Sets3.
Number of people Sequence number of one person Total Set 1 Set 2 Set 3 Set 1 Set 2 Set 3 Training 124 1 1 1 124 124 124 Testing 124 5 1 1 620 124 124 Table 3. The recognition rate of different algorithms.
CEI+KPCA GEI+(2D)2PCA GEI+W(2D)2PCA GEIC Normal gait/% 75.5 79.4 80.2 85.5 Packaging gait/% 79.0 81.5 83.0 87.1 Wearing gait/% 78.2 84.6 86.2 87.9 Average/% 77.57 81.83 83.13 86.83 -
[1] Lv Zhuowen, Xing Xianglei, Wang Kejun, et al. Class energy image analysis for video sensor-based gait recognition: a review[J]. Sensors, 2015, 15(1): 932-964. doi: 10.3390/s150100932 http://cn.bing.com/academic/profile?id=ee9db5aa6ba40aeb1c604bca9777d498&encoded=0&v=paper_preview&mkt=zh-cn
[2] Choudhury S D, Tjahjadi T. Silhouette-based gait recognition using Procrustes shape analysis and elliptic Fourier descriptors[J]. Pattern Recognition, 2012, 45(9): 3414-3426. doi: 10.1016/j.patcog.2012.02.032 http://cn.bing.com/academic/profile?id=c767ea6f1d3b19e23e3e0fc0c182f2ce&encoded=0&v=paper_preview&mkt=zh-cn
[3] Luo Jing, Zhang Jianliang, Zi Chunyuan, et al. Gait recognition using GEI and AFDEI[J]. International Journal of Optics, 2015, 2015: 763908. http://cn.bing.com/academic/profile?id=71dfd5e4030954e911536e753ef5a1b2&encoded=0&v=paper_preview&mkt=zh-cn
[4] Zeng Wei, Wang Cong. Human gait recognition via deterministic learning[J]. Neural Networks, 2012, 35: 92-102. doi: 10.1016/j.neunet.2012.07.012 http://cn.bing.com/academic/profile?id=282f7b5d6e0a3ccfa1d2293077776e11&encoded=0&v=paper_preview&mkt=zh-cn
[5] Tafazzoli F, Safabakhsh R. Model-based human gait recognition using leg and arm movements[J]. Engineering Applications of Artificial Intelligence, 2010, 23(8): 1237-1246. doi: 10.1016/j.engappai.2010.07.004 https://www.researchgate.net/profile/Md_Jan_Nordin/publication/236009384_Human_Gait_Recognition_A_Silhouette_Based_Approach/links/0c96051b802056ccbc000000.pdf?inViewer=true&disableCoverPage=true&origin=publication_detail
[6] Kovač J, Peer P. Human skeleton model based dynamic features for walking speed invariant gait recognition[J]. Mathematical Problems in Engineering, 2014, 2014: 484320. http://cn.bing.com/academic/profile?id=b60ccb83451533b5b552c645680a5e24&encoded=0&v=paper_preview&mkt=zh-cn
[7] Ben Xianye, Xu Sin, Wang Kejun, et al. Review on pedestrian gait feature expression and recognition[J]. Pattern Recognition and Artificial Intelligence, 2012, 25(1): 71-81.(in Chinese) https://www.researchgate.net/publication/286716404_Review_on_pedestrian_gait_feature_expression_and_recognition
[8] Zeng Wei, Wang Cong, Yang Feifei. Silhouette-based gait recognition via deterministic learning[J]. Pattern Recognition, 2014, 47(11): 3568-3584. doi: 10.1016/j.patcog.2014.04.014 https://dl.acm.org/citation.cfm?id=2524938.2524939
[9] Lee C P, Tan A W C, Tan S C. Time-sliced averaged motion history image for gait recognition[J]. Journal of Visual Communication and Image Representation, 2014, 25(5): 822-826. doi: 10.1016/j.jvcir.2014.01.012 https://www.researchgate.net/publication/224316576_Recognition_of_Human_Movement_Based_on_Fourier_Descriptors
[10] Man J, Bhanu B. Individual recognition using gait energy image[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2006, 28(2): 316-322. doi: 10.1109/TPAMI.2006.38 http://cn.bing.com/academic/profile?id=3f31e8e660bbb41d51392f6c1086329c&encoded=0&v=paper_preview&mkt=zh-cn
[11] Sharma P, Yadav R N, Arya K V. Pose-invariant face recognition using curvelet neural network[J]. IET Biometrics, 2014, 3(3): 128-138. doi: 10.1049/iet-bmt.2013.0019 http://cn.bing.com/academic/profile?id=33800975b096d25abc7a95f34fc10221&encoded=0&v=paper_preview&mkt=zh-cn
[12] Elaiwat S, Bennamoun M, Boussaid F, et al. A curvelet-based approach for textured 3D face recognition[J]. Pattern Recognition, 2015, 48(4): 1235-1246. doi: 10.1016/j.patcog.2014.10.013 https://www.researchgate.net/publication/270053101_A_Curvelet-based_approach_for_textured_3D_face_recognition
[13] Song Dan, Luo Jing, Zi Chunyuan, et al. 3D face recognition using anthropometric and curvelet features fusion[J]. Journal of Sensors, 2016, 2016: 6859364. http://cn.bing.com/academic/profile?id=45653194df7865a817a5ff7e7f994c66&encoded=0&v=paper_preview&mkt=zh-cn
[14] Li Linfu, Zhang Xiangchao, Zhang Hao, et al. Feature extraction of non-stochastic surfaces using curvelets[J]. Precision Engineering, 2015, 39: 212-219. doi: 10.1016/j.precisioneng.2014.09.003 https://www.researchgate.net/publication/266082058_Feature_Extraction_of_Non-Stochastic_Surfaces_using_Curvelets
[15] Luo Jing, Song Dan, Xiu Chunbo, et al. Fingerprint classification combining curvelet transform and gray-level cooccurrence matrix[J]. Mathematical Problems in Engineering, 2014, 2014: 592928. http://cn.bing.com/academic/profile?id=48c8deb3498065d4b461089ff0c6145c&encoded=0&v=paper_preview&mkt=zh-cn
[16] Liang Shaocong, Zhou Ming, Li An'an, et al. GEI based gait recognition by using KPCA and SVM[J]. Application Research of Computers, 2010, 27(7): 2798-2800. (in Chinese) http://cn.bing.com/academic/profile?id=c3e0b29fafac47783ca0f2ccec24561b&encoded=0&v=paper_preview&mkt=zh-cn
[17] Wang Kejun, Liu Lili, Ben Xianye, et al. Gait recognition based on gait energy image and two dimensional principal component analysis[J]. Journal of Image and Graphics, 2009, 14(12): 2503-2509. (in Chinese) http://cn.bing.com/academic/profile?id=3f31e8e660bbb41d51392f6c1086329c&encoded=0&v=paper_preview&mkt=zh-cn