UPPSALA UNIVERSITÉT & UPPSALA UNIVERSITY OF EC! SINESS,VNUH UNIVERSITET The Rm MASTER THESIS OF MPPM Research for monitor and evaluation system of Program 135 in Stage II ( 2006-2010), propose improvement solutions for purpose of evaluating the impact of Program. Authors Tran Kien Lo Viet Phuong Hoang Van Tuyen Supervisor. Sven-Erik Svärd Local Supervisor: Dr. Quach Manh Hao Class MPPM INTAKE 4B - Group 16 Hanoi, March — 2012 ACKNOWLEDGMENTS During our process of research and completion for this thesis, the authors have received encouragement and assistance from many individuals and groups.
In the first place, the authors ourselves should express the deep gratitude to PhD Quach Manh Hao, Deputy Dean of Faculty of Finance and Accounting, Economics College - Vietnam National University and PhD Sven-Erik Svard (Uppsala University, Swiss) who are always whole- hearted to instruct and help us complete this thesis. We do express our thank you to teachers and lecturers, Management Board of Economics College (Vietnam National University), Uppsala University (Swiss); Leaders and officers of Centre for International Education and Training; Leader of Committee for Ethnic Minorities, Department of Ethnic Polocies, Project Management Unit of enhancing planning quality and implementation of poverty reduction policies for the ethnic minority and mountainous areas (Committee for Ethnic Minorities); Embassy of Ireland in Hanoi have created the most favourable conditions for us during out researching and learning the. During our research, we also get the help and valuable comments of the Committee for Ethnic Minorities of Bac Kan, Dak Lak and Soc Trang provinces, leaders of People's Committee of districts, the departments and divisions of the districts and communes in three provinces such as Bac Kan, Dak Lak; Soc Trang who have helped us complete this research; through this, allow us to give our thank you to the above units and agencies. Finally, we do send our deep gratitude to our family, friends and colleagues who always give us encouragement and create the most favourable conditions during researching and learning.
Hanoi, February 10" 2012 On behalf of authors Head of group Tran Kien REPORT OF THE THESIS SUMMARY 1, Name of the topic: Research of the Monitoring and Evaluation system in the Program 135 Phase II (2006- 2010), proposals on recovery solutions toward impact evaluation objectives of the Project 2. Education level: Master Course on Public Administration. Group of authors: Tran Kien, Lo Viet Phuong, Hoang Van Tuyen. Quach Manh Hao and Dr.
Sven-Erik Svärd. Completion time: February in 2012. Context: The Program 135 — Phase II (2006-2010) has applied new monitoring and evaluation tools in comparison with traditional method applied in other similar previous Programs. However, monitoring and evaluation work in the program remains shortcomings because this is the first time for the tools to be applied to the program of authorities in all levels.
In addition, this monitoring and evaluation tool has not been developed fully because it only evaluates short-term results when the program impacts local people with the policies instead of pointing out deeper and overall impact of the program. Purpose: The purpose of this thesis is the evaluation of monitoring and evaluation of the Program 135 at 2" stage, analysis of strengths and weaknesses of the tools and methods of monitoring and evaluation of the Program; analysis to adjust and correct weakness in order to develop a framework for monitoring and evaluation of the program 135 at the next stage aiming at monitoring and evaluation based on the results / impact; giving policy recommendations for monitoring and evaluation program in accordance with actual conditions in the next period. Method: This is a qualitative study, using the methodology of study of primary and secondary documents, site observation, group discussion and use of questionnaires. interview of performance by all levels.
On that basis, SWOT analysis and logical framework are used to analyze, evaluate and ive recommendations. 9, Results: Group searches following main results - Solution on improving effectiveness of monitor and evaluation tools of the Program 135, phase II - Monitor and evaluation framework for the Program 135 for the next ages Recommendation so that the system monitors and assesses the Program based on results/ impact - Recommendations on policies to mission on monitor and evaluation of the Program effectively. Propose for future research: Due to sample research is small, just at 3 provinces with limited time and scope of the thesis, group of authors does not have ambition to comprehensively change, we only want to further furnish information on proces of monitor and evaluation of the Program 135, phase I] and a group of solution for the Program, next stag Additionally, group of authors also recommend to further research on the contents of community- based monitor and evaluation. By the large programs and limited resources of locality, the community-use form is important in assuring of the publicity and transparency, promote people’s ownership and ensure the closeness of the evaluated contents.
Thesis contributions The authors believe that the information given in this thesis is the credible ba s for the policies planners and managers at the governmental, provincial and district levels. Particularly, for the Committee of Ethnic Minorities, Department of Ethnic Policies (where members in the team have been coordinating) with the desire of better support in improving and ensuring the implementation of monitor and evaluation for Program 135 in period 2012 - 2016. OF FIGUR PREABLE 1. Reasons to choose the research topic.
Appropriateness of the research topic. Research Scope and Objects. ANALYSIS OF CURRENT SITUATION OF THE MONITORING AND EVALUATION FRAMEWORK AND MECHANISM OF THE PROGRAM 135 PHASE II. Basic information on the program.
Introduction about the Program 135-1. Introduction about the M& E System of the Program 135 II 1. Logical framwork and route-map framework 1. Basic inspection tool: 1.
AMT/PMT monitoring and reporting system. The internal M & E activities. The internal M & E activities 1. The independent M & E activities.
Community-based monitoring and evaluating. 27 THE SOLUTION OF OVERCOMING AND COMPLETING M & E TOOL OF THE PROGRAM 135 AT 2Ÿ” STAGE ©5) 1. The AMT/ PMT monitoring and report:. The M&E internal and independent to the CT: 5.
Some proposal to enhance the role of community supervisor in implementation of Program 135 in the next period: CHAPTER II. PROPOSE SOLUTIONS TO ENHANCE MONITOR, EVALUATION ON R LTS FOR PURPOSE OF EVALUATING THE PROGRAM IMPACT THE NEXT PERIOD 1. Status of M & E capacity and performance of monitoring and evalu: based on results towards the target of impact evaluation of the Program. Human resources for monitoring and evaluation activities: 2: The budget for M & E activities:.
Training for M & E based on the results. Proposed monitoring and evaluation framework for the program at the next stage. Complete the institutionalization of M & E work. Organization of supervision and evaluation.
Development of M & E plan and design of monitoring / evaluation: 2. Development of M & E indicators in the logical framework. Monitor on assessing Program 135 ID) 2u Construct tool set of indicators for monitoring and ašSeSSiHg. Build a network of information (Web page) 2.
Collect related secondary data. Perform the monitor and evaluation. Some measures aimed at targets of monitor and evaluation based on the results/ impacts on the Program for the next period. RECOMMENDATIONS TO PERFORM MONITOR AND EVALUATION MISSION OF THE NEXT PHASE EFFICIENCY 1.
Documents on organizing M&E system, the program should be issued and the personnel system for M&E is promptly formed to grasp the content and the execution steps of the program. Early issue operation mechanism of M&E system with the participation of all levels from centre to local levels 50 4. Issuance of guidance documents 5. Construction of software of data system and information link.
M& Ework is an integral part of planning. Necessity of minimum regulations to publicly report contents. LIST OF REFERENCE DOCUME APPENDIX I. SUMMAY OF THE PROGRAM H 1 APPENDIX II.
QUESTIONAIRS IN FIELD INTEVIEWS. LIST OF ABBREVIATIONS AMT Aligned Monitoring Tool PI35-II Program 135 , Stage II P135 — III Program 135 , Stage III EMPCD Strengthen Capacity for CEMA in Ethnic Minority Policy Formulation, Implementation and Monitoring " M&E Monitor and evaluation JPR Joint Progress Rating Logframe Logical frame (M&E Frame) MIS Management Information System PMT Provincial Monitoring Tool SM-P135 Project of technical support for Program 135 management CEMA Committee for Ethnic Minorities UNDP United Nations Development Programme WB World bank LIST OF TABLES | 49 LIST OF FIGURES Page Figure 1: Monitor and evaluation arrangement for Program 135 35 in Stage III Figure 2: Model of monitor and evaluation arrangement for 42 Program 135 in Stage III PREABLE 1. Necessity of the research topic 1.Reasons to choose the research topic Vietnam has recently made impression with its poverty reduction in achivements on social and economic development. These achievements have been internationally recognized and one of important reasons is that the Government of Vietnam has offered so many special priority for poverty reduction policies, especially poverty reduction programs in the area of ethnic minorities, mountainous and extremely difficult areas throughtout the country.
Program 135 Phase II (2006-2010) is a comprehensive economic and social development program for the ethnic minority and mountainous areas issued by the Government with positive effectiveness, which is supported by the whole society. One of the most prominent traits of the program is to apply a lot of new monitoring and evaluation tools in comparison with traditional method applied in other similar previous Programs. The use of new monitoring and evaluation tools brings positive effect, contributing to the overall effectiveness of the program. However, monitoring and evaluation work in the program remains shortcomings because this is the first time for the tools to be applied to the program of authorities in all levels.
In addition, this monitoring and evaluation tool has not been developed fully because it only evaluates short-term results when the program impacts local people with the policies instead of pointing out deeper and overall impact of the program The Program Document 135 consists of so clear General Objective of the program. The specific economic objectives are clearly stated to meet common objectives. However, the results of the activities (tasks) has indexes only but no specific indicator is stated as a basis to evaluate whether to achieve the objectives or not. Another important program to evaluate appropriateness to targets must reflect its logic and indexes reflecting the logic ofcause and effect The researchers thought that the research matter is practical to the contents taught in the Master Course on Public Administration, especially theories that the researchers studied in Monitoring and Evaluation Subject (MPPM6).They shall make the comparison between the studied theoies and practice from the Program 135 and their practical experience to learn lessons and to propose recommendations to improve monitoring and evaluation work ofthe Program in following periods.
Appropriateness of the research topic 1. Appropriateness of the research to current trend In the context of administrative reform aimed at building a transparent, sustainable, professional, effective and valid democratic administration, intensification of monitoring and evaluation work is so important. Many programs and projects are invested with very large fund by the Government of Vietnam but their monitoring and testing is not paid with proper attention, causing loss and waste, impacting significantly on quality and effectiveness. In addition, monitoring and evaluation are effective tools when Vietnam is in the process of integration with the world and toward a transparent administration 1.
Appropriateness of the research to the works of the group of authors: The researchers are now working at construction agencies and in charge of guiding the implementation, monitoring and evaluation of policies in mountainous and ethnic group areas. Therefore, this study closely linked with the assigned missions. The research results will be applied directly to the practical work of the authors to meet the requirements on granting the Communce authority the position of the Employer in the Program 135 Period 2012-2015.