VIETNAM NATIONAL UNIVERSITY HO CHI MINH CITY UNIVERSITY OF INFORMATION TECHNOLOGY FACULTY OF INFORMATION SYSTEMS NGUYEN VAN THANH DUC - 18520421 GRADUATION THESIS FACE RECOGNITION FOR GYM MANAGEMENT SYTEM INFORMATION SYSTEMS ENGINEERING Instructor HO CHI MINH CITY, 2023 Preface First of all, I would like to express my sincerest thanks to Dr. Do Trong Hop, who wholeheartedly guided and supported me throughout the process of studying and researching to complete the thesis. In addition to teaching and commenting on academic knowledge, presentation skills, research and reporting, he also cares about students' health and psychology as well as always listens, shares, and inspires students. inspired and motivated me to complete the thesis.
The knowledge and skills imparted by the teacher will definitely be one of the valuable baggage for my future growth. Next, I would like to thank the teachers and staff at the Information Systems Laboratory, including Mr. Nguyen Ho Duy Tri, Mr. Huynh Thien Y, Mr.
Mai Van Binh, Mr. Tran Vinh Khiem for creating favorable conditions. , advice, support me throughout the process of making the thesis. Besides, I would also like to thank the teachers in the Faculty of Information Systems in particular, and the teachers in the University of Information Technology - Vietnam National University, Ho Chi Minh City in general, for teaching knowledge and skills.
for me for the past four years. Once again, I express my gratitude to Dr. Do Trong Hop and the teachers who have always accompanied and supported me during my university studies. Author Nguyen Van Thanh Duc TABLE OF CONTENTS NGUYEN VAN THANH DUC - 185204421.- --- 5: 225 *S2£+t+sE+EEsxererrrrrrrrrrrer 1 INFORMATION SYSTEMS ENGINEERING.
HH He, 1 lo itprtDOỒIắỒOỒắđOỒOỒđỒỔAỒỔỒẦỒIdđdaaiíidỎÔỎdaddđdada4. Goal and Study 2v h3. 1S nh Tho Thọ TH Tu TH HH HH HH nh TT 8 CHAPTER 2: LITERATURE REVIEW. LH 2n HH nưệp 10 2.
Facial Recognition SVSf€IS. Computer Vision Techñn1QU€S. Face [DD€f€CfIOT.-- G1 1 211211211211 11 11T TH TH TH TH HH TT HT ng 11 2. Feature EXTAC{IOH.
LH HT TH TH TH ngàng II 2. Gym Management and Member TrackIng.- -- --- ¿+ ++s++s£+sx+sx+e+sxeessxs 13 2. Related An acc ỨC. --- -- << 2E 1113111 551111155111 11351 1E 111K kg k kg k ky 19 3.
LBPH Model “TraIning. Model Evaluation 0¬ °ˆˆễ®ễ#ễồ". User Interface Development. Real-Time Facial Recognition ÍntegTafIOI.
Data Security and PTIVACY. 111111118111 1 11111111111 111 11 11 11 11 1gp 24 CHAPTER 4: SYSTEM IMPLEMENTATIƠN. Development EnVITOTIN€TI.- + 2 E3 33323 E+E+EE+EE+EEEEEEeEEetEerrrrrrerrerrke 25 4. c1 n1 t S991 1 1111 11111111111 TH HT HH TH TH HH 25 4.
Usecase 0 nan nố. Sequence Diagram nnn. Member Registration SCT€€. Attendance Tracking SCT€€N.
Membership Management SCT€€n. Facial Recognition Model IntegrafIOn. Data Serialization and S†OTA.- 5à Tnhh HH HH nh nh nh nh nh nh 32 4. Real-Time Performance OpfII1ZAfIOTI.
Testing and ValIdafIOTn. Integration with Gym InfTasfTUCfUTC€.- óc 2c 2+ SE 3E ererrrrrrrke 33 CHAPTER 5: EVALUATION AND RESULTS. Training and Validation PhấadÝỶ. Testing and Recognition PerÍOrmanC©.
False Positives and False NegatIVe€S.- ác St HH HH t 38 5. False Positive Rate (FPR) 07. False Negative Rate (ENR). Sàn HH HH HH HH nhiệt 4I 5.
Comparison with Traditional Attendance SŠysfems. Variability in Facial EXPT€SSIOTS. Evaluation of System PerfOTTnannCe. Accuracy and Recognition SŠpeed.
Robustness and Error AnnaÌyS1S. -- ¿5c 2c St SE srrsrerrerrrrrrrke 46 6. User Feedback and Accepfance. ---- -----cc+cc k2 x + net 46 6.
Privacy and Ethical ConS1d€rafIOTNS. Cost-Benefit Analysis 1n. Future Enhancements and RecommendatIOWS.- -¿-- 55+ ++++xs+x>ec+exsxss 47 6. Continuous Model 'TTaIning.
Enhanced False Positive Mitigation. Usability Enhanceim€IfS. Summary of Results 1. Effectiveness and Potential for DevelopImen(.--- -- 5-5 5+5 s+ss+ss++e+exss 49 7.
Time and Effort SaVITE. Improved Member Managermer(. Optimized Customer EXP€TI€TIC€.---- (5 3+ 32333 E*EE+E+EE+eeeeeesrrrerree 51 7. Contributions and LIIfAfIOIS.- --- c2 3+ 2+ **t**E+EE+EEE+EEsEekrrrkrrkrrrkrrree 51 7.
Future Development Directions. Upgrading Recognition Algorithms. Integration with Attendance and Management Systems. Extension to Other Fields.
s6 12x 99 2 919 121 1121 11g ng ưêp 52 I9 (c)060iải 7. 53 CATALOG OF IMAGE Figure 3. Face Recognition using LBPH algorithm. --s- 5+ sx+e+sseesersexee 20 Figure 3.
Comparison between accuracy, precision, recall, and fl score.Yu0i20A0Đàt Tay 0. Add New SGT. co nh kh nh nh TT TT HH HH HH giờ 30 Figure 4. Camera scans and shows customer’s information on screen.
Problem Statement In today's fast-paced world, managing gym facilities efficiently and effectively has become a critical task. Traditional methods of manual registration and identification of gym members can be time-consuming and prone to errors. Additionally, ensuring the security and privacy of gym members' data is of utmost importance. The problem statement addressed in this thesis is to develop a facial recognition system to manage gym facilities.
The system aims to provide an automated and accurate solution for identifying gym members, registering their attendance, and maintaining a secure and convenient environment for both gym staff and members. Problem Solution To address the challenges in gym management, the proposed solution involves the development of a facial recognition system. The system will use state-of-the-art computer vision techniques to recognize and identify gym members based on their facial features. By integrating this system into the gym's existing infrastructure, it will streamline the registration process and enhance the overall user experience.
The key components of the problem solution are: Facial Recognition Model: Develop and train a facial recognition model using OpenCV and LBPH (Local Binary Patterns Histograms) algorithm. This model will be capable of recognizing registered gym members' faces accurately. User Interface: Design and implement a user-friendly interface using Tkinter to facilitate gym staff 1n registering new members and managing member data. Attendance Tracking: Implement real-time facial recognition to track gym member attendance, providing a seamless and contactless experience.
Data Security: Ensure the protection of sensitive user information and privacy by securely storing member data and incorporating appropriate data protection measures. Challenges During the development of the facial recognition system, several challenges need to be addressed: Accuracy and Robustness: Ensuring high accuracy and robustness of the facial recognition model to correctly identify gym members under various lighting conditions and facial expressions. Real-time Performance: Implementing the system to perform facial recognition in real- time, enabling swift attendance tracking during peak gym hours. Data Privacy: Addressing data privacy concerns by adhering to data protection regulations and implementing secure data storage and access mechanisms.
Goal and Study Scope The primary goal of this thesis is to develop a fully functional facial recognition system tailored for gym management. The system aims to provide an efficient and secure solution for gym staff to manage member registrations, track attendance, and ensure a smooth gym experience for members. The study scope encompasses the development, implementation, and evaluation of the facial recognition system. It includes: Collecting and preprocessing facial image data for model training.
Training and optimizing the facial recognition model. Developing a user interface for gym staff to interact with the system. Integrating real-time facial recognition for attendance tracking. Addressing data security and privacy concerns.
Thesis Structure The thesis is structured as follows: Chapter 1: Introduction: This chapter provides an overview of the problem statement, the proposed solution, challenges, goals, and the scope of the study. Chapter 2: Literature Review: This chapter reviews the existing literature and research related to facial recognition systems, computer vision techniques, and gym management. Chapter 3: Methodology: In this chapter, the methodology used to develop the facial recognition system will be discussed in detail, including data collection, model training, and system implementation. Chapter 4: System Implementation: This chapter presents the implementation details of the facial recognition system, including the user interface and real-time facial recognition integration.
Chapter 5: Evaluation and Results: The performance evaluation and results of the facial recognition system will be presented in this chapter. Chapter 6: Discussion: This chapter discusses the findings, limitations, and potential improvements of the developed facial recognition system. Chapter 7: Conclusion: The final chapter concludes the thesis, summarizing the achievements and contributions of the research, and suggests future directions for further improvement and application of the facial recognition system in gym management. References: The reference list of all the sources cited throughout the thesis.
CHAPTER 2: LITERATURE REVIEW 2. Facial Recognition Systems Facial recognition technology has gained significant attention in recent years due to its wide-ranging applications in various fields, including security, surveillance, and user authentication. It involves the use of computer vision algorithms to identify and verify individuals based on their facial features. Several facial recognition techniques have been developed, including Eigenfaces, Fisherfaces, and Local Binary Patterns Histograms (LBPH).
The Eigenfaces method, introduced by Turk and Pentland in 1991, uses Principal Component Analysis (PCA) to extract essential facial features from a set of training images. Similarly, Fisherfaces, proposed by Belhumeur et al., is based on Linear Discriminant Analysis (LDA) and aims to maximize the inter-class variations while minimizing intra-class variations. In recent years, LBPH has emerged as a popular facial recognition technique due to its simplicity and efficiency. LBPH encodes facial features by considering local binary patterns in a face image and creates a histogram of these patterns.
It has shown promising results in various real-world applications and has become the algorithm of choice for many facial recognition systems. Computer Vision Techniques Computer vision techniques play a pivotal role in developing facial recognition systems. These techniques enable the system to detect, extract, and process facial features effectively. Some fundamental computer vision techniques include: Computer vision techniques are at the core of developing robust and accurate facial recognition systems.
These techniques empower the system to detect, extract, and process facial features effectively, laying the foundation for successful facial identification. Several fundamental computer vision techniques are utilized in facial recognition systems, 10 2. Face Detection Face detection is the process of locating and localizing human faces in an image or video frame. Various methods have been proposed for face detection, such as Haar cascades, Histogram of Oriented Gradients (HOG), and Single Shot MultiBox Detector (SSD).
Haar cascades, introduced by Viola and Jones, utilize a set of Haar-like features and a trained classifier to detect faces efficiently. Image Preprocessing Image preprocessing is essential to enhance the quality of facial images before feeding them into the facial recognition system. Common preprocessing techniques include grayscale conversion, histogram equalization, and noise reduction using filters like Gaussian and Bilateral filters. These techniques help to improve the robustness and accuracy of the facial recognition process.
Feature Extraction Feature extraction aims to identify relevant and distinctive features from facial images that can be used for recognition. In addition to the aforementioned PCA and LDA methods, Convolutional Neural Networks (CNNs) have also been extensively employed for feature extraction. CNNs have proven to be highly effective in learning hierarchical features and achieving state-of-the-art performance in various computer vision tasks, including facial recognition. Feature extraction is a crucial step in facial recognition systems, where the goal is to identify relevant and distinctive features from facial images that can be used for recognition purposes.
Extracting meaningful and discriminative features is essential for accurate and robust identification of individuals in varying conditions. In addition to the previously mentioned principal component analysis (PCA) and linear discriminant analysis (LDA) methods, Convolutional Neural Networks (CNNs) have gained significant popularity and success in the field of feature extraction for facial recognition. CNNs have demonstrated remarkable capabilities in learning hierarchical features from raw 11 image data, making them highly effective in various computer vision tasks, including facial recognition. CNNs work by employing multiple layers of convolutional filters, followed by pooling layers, to automatically learn and extract intricate patterns and features from the input images.
The initial layers detect simple patterns such as edges and corners, while subsequent layers learn more complex and higher-level features, such as facial contours and textures. This hierarchical learning process enables CNNs to capture both local and global features, making them well-suited for facial recognition tasks where facial features can vary in size, shape, and orientation.