本研究提出一個多模態掌紋身分識別方法，本系統透過智慧型手機拍攝手掌影像，採用基於最大內切圓的方法擷取感興趣的掌紋區域，再使用灰度共生矩陣( GLCM)、灰度梯度共生矩陣(GGCM)、局部二值模式(LBP)，三種紋理特徵提取方式提取掌紋紋理特徵向量，分別將三組特徵向量結合機率神經網路分類器(PNN)，以得到三組最佳的推論機率，最後我們將每一個模組的推論機率進行加權融合，得到辨識結果。針對自建的手掌影像資料庫實驗結果顯示，在訓練資料為10筆的情況下，GLCM、GGCM、LBP三種模態各自的準確率分別為82%、86%及89%，結合決策融合PNN的準確率則提升為96%。我們還使用穆塔大學(Mutah University)提供的公開掌紋資料庫所進行比較實驗，準確率可達99.5%，相較於VGG-19和AlexNet，我們的多模態掌紋身分識別系統具有良好的辨識性能。

This study proposes a multimodal palm tattoo recognition method. This system captures palm images through a smartphone, using the method based on the largest inscribed circle to capture the area of interest palm print, and then uses the gray level co-occurrence matrix (GLCM), gray scale Gradient co-occurrence matrix (GGCM) and local binary pattern (LBP), three texture feature extraction methods to extract palmprint texture feature vectors respectively, and three sets of feature vectors are combined with a probabilistic neural network classifier (PNN) to obtain the three sets of best inferences probability. Finally, we weighted and fused the inference probabilities of each module to obtain the recognition result. The experimental results of the self-built palm image database show that with 10 training data, the accuracy of the three modalities of GLCM, GGCM, and LBP are 82%, 86%, and 89%, respectively. The accuracy was increased to 96%. We also use the public palm print database provided by Mutah University for comparative experiments, and the accuracy can reach 99.5%. Compared with VGG-19 and AlexNet, our multi-modal palm tattoo sub-recognition system has good recognition performance.

[1] A. Kumar, ''Toward More Accurate Matching of Contactless Palmprint Images Under Less Constrained Environments," IEEE Transactions on Information Forensics and Security, vol. 14, no. 1, pp. 34-47, 2018.
[2] A. Negi, B. Panigrahi, M. V. N. K. Prasad, M. Das, "A Palmprint Classification Scheme using Heart Line Feature Extraction," in Information Technology (ICIT'06), 9th International Conference on, IEEE, 2007.
[3] A. K. Jain, A. Ross and S. Prabhakar, "An introduction to biometric recognition," IEEE Transaction on Circuits and Systems for Vieo Technology, vol. 14, no. 1, pp. 4-20, 2004.
[4] M. Rafael Diaz, C. M. Travieso , J. B. Alonso , M. A. Ferrer, "Biometric system based in the feature of hand palm," in Security Technology, 38th Annual 2004 International Carnahan Conference on, IEEE, 2004.
[5] Miguel A. Ferrer, Carlos M. Travieso, Jesus B. Alonso, "Multimodal Biometric System based on Hand Geometry and Palm Print Texture, " in Security Technology, Proceedings 40th Annual 2006 International Carnahan Conference on, IEEE, 2007.
[6] N. Srinivasan, E. Micheli-Tzanakou, "Palm Print Recognition: A New Algorithm For Corner Detection Using Palm Anatomy Features," in Measurement Systems for Homeland Security, Contraband Detection and Personal Safety, 2006 IEEE International Workshop on, 2007.
[7] H. Javidnia, A. Ungureanu, P. Corcoran, "Palm-print recognition for authentication on smartphones," in Technology and Society (ISTAS), 2015 IEEE International Symposium on, 2016.
[8] S. Lin, Y. Bai, Y. Tang, "Design of online non-contact palmprint recognition simulation system," in Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), 2016 9th International Congress on, IEEE, 2017.
[9] J. R. Jasmine Roopa, S. Veluchamy, "Person Validation System Using Hand Based Biometric Modalities," in Communication, Computing and Internet of Things (IC3IoT), 2018 International Conference on, IEEE, 2019.
[10] 紀佩妤, "狗鼻紋理特徵擷取和犬隻身分識別," 國立中央大學通訊工程學系學位論文, 2020.
[11] Ahmed S. El Sayed, Hala M. Ebeid, Mohamed Roushdy, Zaki T. Fayed, "A method for contactless palm ROI extraction," in Computer Engineering & Systems (ICCES), 2016 11th International Conference on, IEEE, 2017.
[12] D. Zhang, W.-K. Kong, J. You, M. Wong, "Online palmprint identification," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 9, pp. 1041-1050, 2003.
[13] P. Dubey, T. Kanumuri, R. Vyas, "Palmprint recognition using binary wavelet transform and LBP representation," in Recent Innovations in Signal processing and Embedded Systems (RISE), 2017 International Conference on, IEEE, 2018.
[14] C.-L. Lin, T. C. Chuang, K.-C. Fan, "Palmprint verification using hierarchical decomposition," Pattern Recognition, vol. 38, no. 12, pp. 2639-2652, 2005.
[15] S. Lin, T. Xu and X. Yin, "Region of interest extraction for palmprint and palm vein recognition," in Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), 2016 9th International Congress on, IEEE, 2017.
[16] R. M. Haralick, K. Shanmugam, I. Dinstein, "Textural features for image classification," IEEE Transactions on Systems, Man, and Cybernetics, vol. SMC-3, no. 6, pp. 610-621, 1973.
[17] S. W.-C. Lam, "Texture feature extraction using gray level gradient based co-occurence matrices," in Systems, Man and Cybernetics. Information Intelligence and Systems, 1996 IEEE International Conference on, 2002.
[18] T. Ojala, M. Pietikainen, T. Maenpaa, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 971-987, 2002.
[19] D. F. Specht, "Probabilistic neural networks," Neural networks, vol. 3, no. 1, pp. 109-118, 1990.
[20] A. Hassanat, M. Al-Awadi, E. Btoush, A. Al-Btoush, E. Alhasanat, G. Altarawneh, "New Mobile phone and Webcam Hand Images Databases for Personal Authentication and Identification," vol. 3, no. 1, 2015.
[21] A. S. Tarawneh, D. Chetverikov, A. B. Hassanat, "Pilot Comparative Study of Different Deep Featuresfor Palmprint Identification in Low-Quality Images," in Computer Graphics and Geometry, Ninth Hungarian Conference on, Budapest, 2018.