Multi-Object Face Recognition Using Local Binary Pattern Histogram and Haar Cascade Classifier on Low-Resolution Images

Authors

  • R. Rizal Isnanto Department of Computer Engineering, Diponegoro University, Semarang, Indonesia
  • Adian Fatchur Rochim Department of Computer Engineering, Diponegoro University, Semarang, Indonesia
  • Dania Eridani Department of Computer Engineering, Diponegoro University, Semarang, Indonesia
  • Guntur Dwi Cahyono Department of Computer Engineering, Diponegoro University, Semarang, Indonesia

DOI:

https://doi.org/10.46604/ijeti.2021.6174

Keywords:

face recognition, linear binary pattern histogram, low resolution, histogram equalization

Abstract

This study aims to build a face recognition prototype that can recognize multiple face objects within one frame. The proposed method uses a local binary pattern histogram and Haar cascade classifier on low-resolution images. The lowest data resolution used in this study was 76 × 76 pixels and the highest was 156 × 156 pixels. The face images were preprocessed using the histogram equalization and median filtering. The face recognition prototype proposed successfully recognized four face objects in one frame. The results obtained were comparable for local and real-time stream video data for testing. The RR obtained with the local data test was 99.67%, which indicates better performance in recognizing 75 frames for each object, compared to the 92.67% RR for the real-time data stream. In comparison to the results obtained in previous works, it can be concluded that the proposed method yields the highest RR of 99.67%.

Author Biographies

Adian Fatchur Rochim, Department of Computer Engineering, Diponegoro University, Semarang, Indonesia

Dr. Adian Fatchur Rochim

Departement of Computer Engineering
Diponegoro University
Semarang, Indonesia
email: adian@ce.undip.ac.id

Dania Eridani, Department of Computer Engineering, Diponegoro University, Semarang, Indonesia

Dania Eridani
Departement of Computer Engineering
Diponegoro University
Semarang, Indonesia
email: dania@ce.undip.ac.id

 

Guntur Dwi Cahyono, Department of Computer Engineering, Diponegoro University, Semarang, Indonesia

Guntur Dwi Cahyono
Departement of Computer Engineering
Diponegoro University
Semarang, Indonesia
email: guntur@ce.undip.ac.id

References

H. Chen, “A Kind of Effective Method of Removing Compound Noise in Image,” 9th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), October 2016, pp. 157-161.

J. Azzeh, B. Zahran, and Z. Alqadi, “Salt and Pepper Noise: Effects and Removal,” JOIV: International Journal on Informatics Visualization, vol. 2, no. 4, pp. 252-256, 2018.

M. Taskiran, N. Kahraman, and C. E. Erdem, “Face Recognition: Past, Present and Future (A Review),” Digital Signal Processing, vol. 106, November 2020.

D. Wei, T. Chen, S. Li, D. Jiang, Y. Zhao, and T. Li, “Adaptive Dictionary Learning Based on Local Configuration Pattern for Face Recognition,” EURASIP Journal on Advances in Signal Processing, pp. 1-12, May 2020.

A. Ahmed, J. Guo, F. Ali, F. Deeba, and A. Ahmed, “LBPH Based Improved Face Recognition at Low Resolution,” International Conference on Artificial Intelligence and Big Data (ICAIBD), May 2018, pp. 144-147.

M. I. Younis and R. S. Muhammad, “IFRS: An Indexed Face Recognition System Based on Face Recognition and RFID Technologies,” Wireless Personal Communications, vol. 101, no. 4, pp. 1939-1966, May 2018.

R. J. Niaraki and A. Shahbahrami, “Accuracy Improvement of Face Recognition System Based on Co-occurrence Matrix of Local Median Binary Pattern,” 4th International Conference on Pattern Recognition and Image Analysis (IPRIA), March 2019, pp. 141-144.

R. Angulu, J. R. Tapamo, and A. O. Adewumi, “Age Estimation via Face Images: A Survey,” EURASIP Journal on Image and Video Processing, June 2018.

J. Meng, Y. Gao, X. Wang, T. Lin, and J. Zhang, “Face Recognition Based on Local Binary Patterns with Threshold,” International Conference on Granular Computing, IEEE Press, August 2010, pp. 352-356.

G. Anbarjafari, “Face Recognition Using Color Local Binary Pattern from Mutually Independent Color Channels,” EURASIP Journal on Image and Video Processing, January 2013.

B. Yang and Q. Z. Li, “Local Binary Pattern-Based Discriminant Graph Construction for Dimensionality Reduction with Application to Face Recognition,” Multimedia Tools and Applications, vol. 78, no. 16, pp. 22445-22462, April 2019.

C. Singh, N. Mittal, and E. Walia, “Complementary Feature Sets for Optimal Face Recognition,” EURASIP Journal on Image and Video Processing, July 2014.

R. P. Holder and J. R. Tapamo, “Improved Gradient Local Ternary Patterns for Facial Expression Recognition,” EURASIP Journal on Image and Video Processing, June 2017.

W. Louis and K. N. Plataniotis, “Co-Occurrence of Local Binary Patterns Features for Frontal Face Detection in Surveillance Applications,” EURASIP Journal on Image and Video Processing, January 2011.

G. Mahalingam and K. Ricanek, “LBP-Based Periocular Recognition on Challenging Face Datasets,” EURASIP Journal on Image and Video Processing, July 2013.

A. Sapkota and T. E. Boult, “GRAB: Generalized Region Assigned to Binary,” EURASIP Journal on Image and Video Processing, June 2013

J. Tang. Q. Su, B. Su, S. Fong, W. Cao, and X. Gong, “Parallel Ensemble Learning of Convolutional Neural Networks and Local Binary Patterns for Face Recognition,” Computer Methods and Programs in Biomedicine, vol. 197, December 2020.

N. Zhou, A. G. Constantinides, G. Huang, and S. Zhang, “Face Recognition Based on an Improved Center Symmetric Local Binary Pattern,” Neural Computing and Applications, vol. 30, no. 12, pp. 3791-3797, 2018.

L. Zhou, H. Wang, S. Lin, S. Hao, and Z. M. Lu, “Face Recognition Based on Local Binary Pattern and Improved Pairwise-Constrained Multiple Metric Learning,” Multimedia Tools and Applications, Vol. 79, no. 1-2, pp. 675-691, 2020.

O. García-Olalla, E. Alegre, L. Fernández-Robles, M. T. García-Ordás, and D. García-Ordás, “Adaptive Local Binary Pattern with Oriented Standard Deviation (ALBPS) for Texture Classification,” EURASIP Journal on Image and Video Processing, vol. 2013, no. 1, May 2013.

M. A. Muqeet and R. S. Holambe, “Local Binary Patterns Based on Directional Wavelet Transform for Expression and Pose-Invariant Face Recognition,” Applied Computing and Informatics, vol. 15, no. 2, pp. 163-171, July 2019.

C. H. Yoo, S. W. Kim, J. Y. Jung, and S. J. Ko, “High-Dimensional Feature Extraction Using Bit-Plane Decomposition of Local Binary Patterns for Robust Face Recognition,” Journal of Visual Communication and Image Representation, vol. 45, pp. 11-19, May 2017.

X. Zhao and S. Zhang, “Facial Expression Recognition Using Local Binary Patterns and Discriminant Kernel Locally Linear Embedding,” EURASIP Journal on Advances in Signal Processing, vol. 2012, no. 1, January 2012.

Z. Chai, H. Mendez-Vazquez, R. He, Z. Sun, and T. Tan, “Explore Semantic Pixel Sets Based Local Patterns with Information Entropy for Face Recognition,” EURASIP Journal on Image and Video Processing, vol. 2014, no. 1, May 2014.

F. V. Massoli, G. Amato, and F. Falchi, “Cross-Resolution Learning for Race Recognition,” Image and Vision Computing, vol. 99, July 2020.

A. Dahmouni, K. El Moutaouakil, and K. Satori, “Face Description Using Electric Virtual Binary Pattern (EVBP): Application to Face Recognition,” Multimedia Tools and Applications, vol. 77, no. 20, pp. 27471-27489, April 2018.

L. Zhou, H. Wang, W. Liu, and Z. M. Lu, “Face Feature Extraction and Recognition via Local Binary Pattern and Two-Dimensional Locality Preserving Projection,” Multimedia Tools and Applications, vol. 78, no. 11, pp. 14971-14987, 2019.

J. Liang, H. Tu, F. Liu, Q. Zhao, and A. K. Jain, “3D Face Reconstruction from Mugshots: Application to Arbitrary View Face Recognition,” Neurocomputing, vol. 410, pp. 12-27, October 2020.

C. C. Chude-Olisah, G. Sulong, U. A. Chude-Okonkwo, and S. Z. Hashim, “Face Recognition via Edge-Based Gabor Feature Representation for Plastic Surgery-Altered Images,” EURASIP Journal on Advances in Signal Processing, vol. 2014, no. 1, July 2014.

A. Bolotnikova, H. Demirel, and G. Anbarjafari, “Real-Time Ensemble Based Face Recognition System for NAO Humanoids using Local Binary Pattern,” Analog Integrated Circuits and Signal Processing, vol. 92, no. 3, pp. 467-475, June 2017.

Z. Liu, X. Song, and Z. Tang, “Fusing Hierarchical Multi-Scale Local Binary Patterns and Virtual Mirror Samples to Perform Face Recognition,” Neural Computing and Applications, vol. 26, no. 8, pp. 2013-2026, March 2015.

Z. Xu, Y. Jiang, Y. Wang, Y. Zhou, W. Li, and Q. Liao, “Local Polynomial Contrast Binary Patterns for Face Recognition,” Neurocomputing, vol. 355, pp. 1-12, August 2019.

D. Huang, C. Shan, M. Ardabilian, Y. Wang, and L. Chen, “Local Binary Patterns and its Application to Facial Image Analysis: A Survey,” IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), vol. 41, no. 6, pp. 765-781, November 2011.

L. Wisesa, “OpenCV Face Recognition Berbasis Algoritma Haar Cascade,” https://medium.com/purwadhikaconnect/opencv-face-recognition-berbasis-algoritma-haar-cascade-1a5e23d9e8cb, May 04, 2020.

A. Mordvintsev and A. Rahman, “Histograms-2: Histogram Equalization,” https://opencv-python-tutroals.readthedocs.io/en/latest/py_tutorials/py_imgproc/py_histograms/py_histogram_equalization/ py_histogram_equalization.html, May 04, 2020.

J. J. Priestley, V. Nandhini, and V. Elamaran, “An Improved Trimmed Median Filter for the Restoration of Images Corrupted by High Density Impulse Noise,” International Journal of Applied Engineering Research, vol. 10, no. 5, pp. 11587-11598, January 2015.

X. Fu and W. Wei, “Centralized Binary Patterns Embedded with Image Euclidean Distance for Facial Expression Recognition,” Fourth International Conference on Natural Computation, IEEE Press, vol. 4, pp. 115-119, October 2008.

K. Kavita and M. Kau, “A Survey Paper for Face Recognition Technologies,” International Journal of Scientific and Research Publication, vol. 6, no. 7, pp. 441-445, 2016.

“Advantages and Disadvantages of Machine Learning Language,” https://data-flair.training/blogs/advantages-and-disadvantages-of-machine-learning, November 23, 2020.

M. Wang and W. Deng, “Deep Face Recognition: A Survey,” https://arxiv.org/abs/1804.06655v9, November 23, 2020.

Downloads

Published

2021-01-20

How to Cite

[1]
R. Rizal Isnanto, A. Rochim, D. Eridani, and G. Cahyono, “Multi-Object Face Recognition Using Local Binary Pattern Histogram and Haar Cascade Classifier on Low-Resolution Images”, Int. j. eng. technol. innov., vol. 11, no. 1, pp. 45–58, Jan. 2021.

Issue

Section

Articles