MINISTRY OF EDUCATION AND TRAINING HO CHI MINH CITY UNIVERSITY OF TECHNOLOGY AND EDUCATION FACULTY FOR HIGH QUALITY TRAINING GRADUATION PROJECT ELECTRONICS AND TELECOMMUNICATION ENGINEERING TECHNOLOGY DESIGN A CONVEYOR SYSTEM TO SORT PRODUCT USING QR CODE LECTURER: Ph. DO DUY TAN STUDENT: NGUYEN PHAM DUY THAI SKL 0 0 9 8 7 2 Ho Chi Minh City, December, 2022 HO CHI MINH CITY UNIVERSITY OF TECHNOLOGY AND EDUCATION FACULTY FOR HIGH QUALITY TRAINING GRADUATION THESIS MAJOR: ELECTRONICS AND TELECOMMUNICATION ENGINEERING TECHNOLOGY DESIGN A CONVEYOR SYSTEM TO SORT PRODUCTS USING QR CODE ADVISOR: Ph.D DO DUY TAN STUDENT: NGUYEN PHAM DUY THAI 18161135 Ho Chi Minh, December, 2022 HO CHI MINH CITY UNIVERSITY OF TECHNOLOGY AND EDUCATION FACULTY FOR HIGH QUALITY TRAINING GRADUATION THESIS MAJOR: ELECTRONICS AND TELECOMMUNICATION ENGINEERING TECHNOLOGY DESIGN A CONVEYOR SYSTEM TO SORT PRODUCTS USING QR CODE ADVISOR: Ph.D DO DUY TAN STUDENT: NGUYEN PHAM DUY THAI 18161135 Ho Chi Minh, December, 2022 THE SOCIALIST REPUBLIC OF VIETNAM Independence - Freedom - Happiness ---------------- Ho Chi Minh City, July … 2022 GRADUATION PROJECT ASSIGNMENT Student name: Nguyen Pham Duy Thai Student ID: 18161035 Major: Electronics and Telecommunication Engineering Technology Class: 18161CLA Advisor: Ph.D Do Duy Tan Date of assignment: 01/10/2022 Date of submission: 24/12/2022 1. Thesis title: Design A Conveyor System To Sort Products Using Qr Code 2. Initial materials provided by the advisor: Adrian-Vasile Duka (Dec.
2014) “Neural network based inverse kinematics solution for trajectory tracking of a robotic arm”. Presented in The 7th International Conference Interdisciplinarity in Engineering. Mada Sanjaya, Dyah Anggraeni, Madinatul Munawwaroh, M. Nurasyidiek, Darmawan Setia Rahayu, Ahmad Samsudin, Ikhsan Purnama Santika, and Endah Kinarya Palupi (2018) “Colored Object Sorting using 5 DoF Robot Arm based Artificial Neural Network (ANN) Method”.
Content of the thesis: Content 1: Learn QR code and set parameters Content 2: Write a program to recognize image processing using OpenCv Python Content 3: Build a database system to store data upon identification Content 4: Design GUI user interface Content 5: Hardware design of conveyor belt and robot arm Content 6: Write an Arduno program to control an automatic robot Content 7: Connect hardware and software, run model execution, evaluate results Content 8: Write an implementation report. Content 9: Defend the graduation thesis CHAIR OF THE PROGRAM ADVISOR (Sign with full name) (Sign with full name) THE SOCIALIST REPUBLIC OF VIETNAM Independence - Freedom - Happiness ---------------- Ho Chi Minh City, Dec 24 2022 ADVISOR’S EVALUATION SHEET Student name: Nguyen Pham Duy Thai Student ID: 18161035 Major: Electronics and Telecommunication Engineering Technology Thesis title: Design A Conveyor System To Sort Products Using Qr Code Advisor: Ph.D Do Duy Tan EVALUATION 1. Content of the thesis: - Thesis has 5 chapters with 51 pages. - The real system is successfully completed following the objectives in the proposal.
Strengths: Basically finish the target within limited time. Weaknesses: Content of some parts needs to be further improved e. Approval for oral defense? (Approved or denied) Approved 5. Overall evaluation: (Excellent, Good, Fair, Poor) Fair 6.2 (in words: Eight point two) HCM City, month 12 day 24 year 2022 ADVISOR A GUARANTEE I am here with formally declare that this thesis is our research and implementation.
I am have not copied from any published articles without quoting the source. If there is any violation, I amaccept full responsibility. Student implement GRATITUDE First of all, I would like to express my sincere thanks to the teachers and lecturers at Ho Chi Minh City University of Technology and Education, especially the teachers in the electronics and telecommunications department who have imparted valuable knowledge. so that my group can complete this thesis topic.
During the writing of the thesis, thanks to the help of Ph.D Do Duy Tan, he helped us to solve the difficulties and problems we encountered. Therefore, we would like to express our sincere thanks to you, for your dedication and encouragement that you have given me. In addition, my team would also like to express our deep gratitude to the teachers in the council for giving valuable suggestions so that I can summarize the experiences and lessons on my future study and career path. Sincerely thank! ABSTRACT In various industries, robot manipulator systems combined with computer vision are increasingly being used.
Those systems usually have high accuracy, hence, they can replace humans in some specific complex applications and improve productivity effectively. To understand more about these system, in this thesis, we want to research on robot manipulator that have ability to pick up moving objects on the conveyor and classify them to their right groups. The main contents of this thesis consist of a program to control robot manipulator using Arduino, an image processing program for tracking and classifying moving objects, a communication program between robot manipulator and computer. Besides, we implemented a graphic user interface to supervise the process of system.
The thesis has completed succesfully proposed requirements, despite of some specific limits. Therefore, in the future, this thesis can be develop to reduce the image processing time, reduce noise, increase speed of gripping objects. That will help improve productivity and get high accuracy for the system. Contents CHAPTER 1: INTRODUCTION.
2 CHAPTER 2: BACKGROUND INFORMATION .1 Overview OF QR CODE .1 About QR CODE.2 The development history of QR codes .2 Structure and specifications of the QR code .1 QR code creation .2 The specifications of the QR code .3 Practical applications of QR codes .4 Background information of image processing .1 Overview of image processing .2 Open Source Computer Vision (OpenCV - Open Source Computer Vision) .5 Detect objects and scan QR codes with the camera .2 Scan QR code .6 Robot control programming .1 Coordinate Axis System .7 Components Used To Design Hardware .7 12V geared moter LS220 .8 Limit switch KW11-3Z .9 High trigger 5V relay module.10 Vacuum Pump 12VDC Pyp – 370 .8 Program used for software. System analysis and design.1 Pick and place .3 Scan QR Code .5 Connection Diagram Of The System .1 QR Code Recognition Algorithm .2 Create customer database using mysql workbench .42 CHAPTER 4: RESULTS AND ASSESSMENT .1 Programming the control of the robot arm .2 Classification based on QR code .2 Comments and ratings .2 Object classification algorithm using computer vision .51 List of tables Table 1 Specifications of QR code. 5 Table 2 Basic parameters of the robot arm.15 Table 3 Parameters of stepper motor 17HS4401S [Datasheet] .16 Table 4 Basic parameters of Arduino UNO R3 [datasheet] .17 Table 5 Basic parameters of A4988 Driver [datasheet] .18 Table 6 Microstep configuration for A4988 driver [datasheet] .19 Table 7 Basic parameters of 12V 5A power voltage [datasheet] .19 Table 8 LS220 Basic parameters of 12V LS220 .20 Table 9 Basic parameters of the KW11-3Z .21 Table 10 Basic parameters of high-powered 5V relay module .21 Table 11 Basic parameters of Pyp - 370.22 Table 12 Basic parameters of Logitech webcam.23 Table 13 Basic parameters of the robot arm.30 Table 14 Parameter table Denavit - Hartenberg .30 Table 15 Position of end-effector desired to control and position of end-effector measured from reality .47 Table 16 Classification results based on QR code using reverse kinematics method .48 List of figures CHAPTER 2 Figure 2. 2 The history of the development of symbol codes [5].
3 The evolution of QR codes[6]. 4 QR code creation [7]. 5 QR code image placed in public places to declare health for people [8]. 6 Color image is converted to grayscale image.
7 Global thresholded image. 8 Adaptive Global Threshold Image. 9 The right hand determines the direction of the axes. 10 Coordinate Axis Systems.
12 17HS4401S Stepper Motor. 13 Board Arduino UNO R3. 14 Board CNC Shield V3. 17 12V geared motor LS220 [datasheet].
18 Limit switch KW11-3Z [datasheet]. 19 High-powered 5V relay module [datasheet]. 20 Vacuum Pump 12VDC Pyp – 370. 21 Mini conveyor model.
1 Block diagram of system. 2 Flowchart of the system. 3 Denavit-Hertenberg parameter sets. 4 Mount coordinate systems on robots Building a Denavit - Hartenberg.
5 Hardware connection diagram for position control 3 Stepper Motor of Robot. 6 Hardware connection diagram for On/Off control - effector of robot. 7 Connect the webcam to the conveyor. 8 System Hardware Connection Diagram.
9 Block diagram of image processing algorithm. 10 Example of defining the contour and center of an object. 11 Table Info_customer. 13 Manual mode control interface.
14 Auto mode console. 15 Information database interface.1 complete model of the system. 2 Product go to district 1. 3 Product go to district 3.
4 Order Information displayed .1 OVERVIEW It can be claimed that the global e-commerce business has been booming in recent years. For instance, Jeff Bezos, the founder and CEO of the online retailer Amazon, amassed the most wealth in the world (as of April 2021) [1]. Additionally, other behemoths like Alibaba, eBay, Walmart, and others bring in billions of dollars from the e-commerce market every year. In addition to setting the trend, having a firm understanding of the market and consumer preferences, Amazon or Alibaba must also use scientific and technology advancements to management in order to be in the position they are in today.
The task of supply chain management is crucial. Amazon will reap significant benefits from the Covid-19 pandemic in 2020 as more individuals stay at home and conduct more online shopping as a result of holding on to the most cutting-edge technology chains. The business claimed to have sent a record 1 billion items to clients worldwide during the year- end shopping season, and it can process up to 60 million orders daily for China's Alibaba ( 2018). One of the Southeast Asian nations with the fastest expanding e-commerce markets at the moment is Vietnam.
In 2020, the Ministry of Industry and Trade estimates that 53% of people on the e-commerce market would have done their shopping online. Vietnam's e- commerce income increased by 18% (and by 25% in 2019) to reach $11.5% of all retail sales, despite the COVID-19 pandemic's effects. The biggest obstacle preventing us from realizing our full potential is technology. According to the aforementioned statistics, there is a growing need for online purchasing, and among the criteria that influence whether or not a customer will return the following time are correct classification and quick delivery.
Vietnamese e-commerce companies need to use machines if they want to keep their customers and compete with global brands in their own backyards. Modern equipment is used in the process to guarantee that goods are classified correctly, delivered to clients safely, unharmed, and quickly. Realizing that the majority of other units employ the approach of classifying items by hiring workers to directly read and classify them by hand, with the exception of a few prominent enterprises like Shopee Vietnam, Lazada Vietnam, or Tiki. This creates implications for both delivery performance and safety.
Due to the aforementioned factors, I developed an autonomous goods classification system based on QR codes that is tailored specifically for the storage of goods by units working in the logistics industry.2 OBJECTIVES 1 A disdistinctive QR code on packaged goods includes the order number and the delivery zip code. Three goals are outlined within the context of this thesis, including: Developing a product classification system by delivery region using a robotic arm and machine vision. Labor costs will be cut with the use of robots in production. Create a database management system to supervise commodities in a warehouse before export.
Create a user interface to track and track the system's 1.3 SCOPES The mechanical design of the robot is not good, so the orbital planning problem for the group robot is still uncontrollable (done but the robot did not draw the desired trajectory). Open-loop driven stepper motors lead to the accumulation of control errors, with occasional slippage when the motor is hot.