1 VIETNAM NATIONAL UNVERSITY, HANOI UNIVERSITY OF LANGUAGES AND INTERNATIONAL STUDIES FACULTY OF POST-GRADUATE STUDIES VŨ HOÀNG DUNG DESIGNING AN ENGLISH ACHIEVEMENT TEST FOR THE 12TH FORM OF NON-ENGLISH MAJORS AT LE QUY DON HIGH SCHOOL – DONG DA, HANOI (Thiết kế một bài kiểm tra Tiếng Anh cuối kì cho học sinh lớp 12 không chuyên ngữ tại trường Trung học phổ thông Lê Quý Đôn – Đống Đa, Hà Nội) M. Minor Programme Thesis Field: Methodology Code: 60 14 10 Hanoi, August 2010 LUAN VAN CHAT LUONG download : add luanvanchat@agmail.com 2 VIETNAM NATIONAL UNVERSITY, HANOI UNIVERSITY OF LANGUAGES AND INTERNATIONAL STUDIES FACULTY OF POST-GRADUATE STUDIES VŨ HOÀNG DUNG DESIGNING AN ENGLISH ACHIEVEMENT TEST FOR THE 12TH FORM OF NON-ENGLISH MAJORS AT LE QUY DON HIGH SCHOOL – DONG DA, HANOI (Thiết kế một bài kiểm tra Tiếng Anh cuối kì cho học sinh lớp 12 không chuyên ngữ tại trường Trung học phổ thông Lê Quý Đôn – Đống Đa, Hà Nội) M.A Minor Programme Thesis Field: Methodology Code: 60 14 10 Supervisor: Pham Thi Hanh, M.A Hanoi, August 2010 LUAN VAN CHAT LUONG download : add luanvanchat@agmail.com 5 TABLE OF CONTENTS STATEMENT OF AUTHORSHIP. ii TABLE OF CONTENTS. vi LIST OF ABBREVIATIONS.
vii LIST OF TABLES AND APPENDICES …………………………………………. viii Part A: INTRODUCTION…………………………………………………………. Rationale for the study…………………………………………………………. Aims and scope of the study………………………………………………….
Methods of the study…………………………………………………………. Design of the study……………………………………………………………. 3 Part B: LITERATURE REVIEW………………………………………………. Basic Concepts of Testing…….
Roles of testing………………. Types of Test…………………………………………………. Direct versus indirect testing…………………………………. Discrete point versus integrative testing……………………….
Norm-referenced versus criterion-referenced testing…………. Objective versus subjective testing……………………………. Communicative language testing………………………………. Characteristics of a Good Test……………………………………….
18 LUAN VAN CHAT LUONG download : add luanvanchat@agmail. Direct test items……………. Indirect test items…………. 20 Part C: THE STUDY…………………………………….
The issues influencing current testing situation at LQD-DD High School……. The students and their backgrounds……………………………………. The English teaching staff………………………………………………. English teaching and learning………………………………………….
The objectives of the K-12 course………………………………………. Teaching material used for the K-12……………………………………. The content and construction required for the achievement test for the K-12 26 2. The current testing situation………………………………………………….
The process of testing…………………………………………………. Determining the purpose of the test………………………………. Planning the test………………………………………………………. Selecting items and tasks…………………………………………….
Administering the test………………………………………………. Scoring and rating…………………………………………………. Descriptive data from test score……………………………………. Measures of central tendency.
Measures of dispersion. Data collection procedure. Some discussions from test result analysis. 40 LUAN VAN CHAT LUONG download : add luanvanchat@agmail.com 8 LIST OF ABBREVIATIONS 1.
FV: Facility Value 3. GCSE: General Certificate of Secondary Education 4. K-12: The 12th form 5. L: The number of lower group students who answered the item correctly 6.
LQD – DD: Le Quy Don – Dong Da 7. MCQs: Multiple Choice Questions 8. U: The number of upper group students who got the item correct LUAN VAN CHAT LUONG download : add luanvanchat@agmail.com 9 LIST OF TABLES AND APPENDICES Table 1: Objectives and contents of the test Table 2: The frequency of marking scores Table 3: The measures of central tendency Table 4: The measures of dispersion Table 5: Facility value and Discrimination index APPENDIX 1: The contents of the eight units taught in the 1st term of K-12 APPENDIX 2: The structure of English tests for the GCSE national examination APPENDIX 3: Revision outline for the 1st term test APPENDIX 4: The 1st-term English examination for K-12 APPENDIX 5: Keys for the 1st-term English examination for K-12 APPENDIX 6: Students’ performance on test arranged from the highest score to the lowest score APPENDIX 7: The survey questionnaire for students APPENDIX 8: The survey questionnaire for teachers LUAN VAN CHAT LUONG download : add luanvanchat@agmail.com 10 Part A: INTRODUCTION 1. Rationale for the study Assessment plays a significant part in the field of linguistics.
It allows teachers as well as administrators to make important decisions regarding the proficiency, placement, and achievement of second language learners. Among some kinds of assessment, testing is the one that is typically used at the end of a stage of instruction to measure students‟ achievement. 1) says that the most common purpose of language tests is “to pinpoint strengths and weaknesses in the learned abilities of the student”. 9) also shares the idea that it is “to find out how well the students have mastered the language areas and skills which have just been taught”.
Besides, teachers can use language tests to encourage students. Students can show their ability and progress through tests. 10) agrees that tests are also “used for the purpose of increasing motivation”. Having good results, students will be eager for their coming study.
With not very good test results, they will know which level of language they are at so as to set a more realistic goal for themselves. Being aware of the above things, the author of this study, who has been a teacher of English for about 10 years and has written many tests to evaluate the language abilities of students, has noticed that not all the tests have satisfying results. Some tests have bad results, which means that too many students get bad marks or too many students get very good marks. Teachers cannot use the results of these tests to categorize the students.
Therefore, such tests are not reliable. Taking the problem into consideration, the author has found out that it is the technique of designing tests that leads to the situation. When writing tests, the test writer may only feel that this or that test item is suitable for their students. She or he may have never analyze the test designing and the test result carefully in order to find out the causes for the problem.
On the other hand, a well-designed test is always necessary for all students of every language level, especially those of high school level - the elementary level which aims at acquiring survival English. Therefore, getting more knowledge and experience in designing tests is the author‟s desire. In this minor thesis, the author would like to base herself on the knowledge of testing and testing situation to design an achievement test for the 12th form of non-English majors at Le Quy Don-Dong Da High School, Ha Noi. LUAN VAN CHAT LUONG download : add luanvanchat@agmail.
Aims and scope of the study This study seeks to use the academic knowledge in test design to write a reliable achievement test for the 12th form of non-English majors at Le Quy Don-Dong Da High School. Because this is an achievement test given to students after a study period of about four months, the 1st term of the school year, and students are required to use what has recently been taught and practiced to do the test, we, the teachers of English at LQD – DD High School, expect our students to score fairly high marks, at least 70% of which should be from mark 6 upwards. Therefore, this study specifically seeks to answer such questions as whether the items of the test meet the requirements of the course, whether these test items are suitable for at least 70% of students to get marks from 6 upwards and what recommendations should be given to improve the testing situation so that we can build a bank of reliable tests for the school in the coming years. As students of grade 12 are going to take part in the national examination for General Certificate of Secondary Education (GCSE), they should be given to a chance to get used to the structure of this kind of examination.
Therefore, the study will focus on the existing situation at LQD – DD High School, which means that the author will design a multiple choice written achievement test only on such fields as phonetics, grammar, vocabulary, communicative function, reading and writing skills as directed in the book called “Cấ u trúc đề thi môn Ngữ văn , Lịch sử, Đi ̣a lí , Ngoại ngữ” (i. “The Test Structures of Literature, History, Geography, Foreign Languages”) by Nguyen (2009, p. The study will also provide analyzed data of the test, the teachers‟ and students‟ comments on the test as well as their suggestions for its improvement. Methods of the study The main methods employed in this study included test design, test result analysis and teacher and student survey.
For the purpose of designing tests, the author based on the theory and principle of language testing, major characteristics of a good test, especially a good achievement test and testing situation at LQD-DD High School The test result was analyzed by the software SPSS to present the frequency distribution, central tendency and dispersion of the test score. The analysis of test items is carried out manually. Finally, the survey enabled the author to collect teachers‟ and students‟ opinions on the reliability and suitability of the test. A questionnaire in both English and Vietnamese LUAN VAN CHAT LUONG download : add luanvanchat@agmail.com 12 was given to 50 students and another in English was given to 9 teachers of English at LQD – DD High School.
The questionnaires include most closed-ended questions because the quantitative data was the major interest and it was easy to carry out the survey. There was only one open-ended question in each questionnaire so that more suggestions could be given to improve the quality of test design. Research questions This study was intended to answer such research questions as: 1. What test items are appropriate to meet both the requirements of the course and the test writer‟s expectation in the testing situation at LQD-DD High School? What items are the easiest and most difficult of all? 2.
What should be done to improve the test? 5. Design of the study This thesis consists of four parts, with a list of references, and appendices. Part A, “Introduction”, provides the rationale for the study, the aims, the scope, the methods, the research questions and the design of the study. Part B, “Literature Review”, discusses the basic concepts of testing, the roles of testing, the types of test, the characteristics of a good test and the test items.
Part C, “The Study”, presents five sections. The first is issues influencing current testing situation at LQD-DD High School. The second is the current testing situation. The third is the process of testing, which is ended with the descriptive data from test score.
Then the study goes on with the teacher and student survey including data collection procedure and some findings. The next is about the archive of good test items. The last is some discussions from test result analysis. Part D, “Conclusion”, gives some brief conclusions on the study and some recommendations for further study.
LUAN VAN CHAT LUONG download : add luanvanchat@agmail.com 13 Part B: LITERATURE REVIEW 1. Basic Concepts of Testing For the concepts of testing, many linguists have expressed their opinions. It is said to refer to “the specific procedures that teachers and examiners employ to try to measure ability in the language, using what learners show they know as an indicator of their ability” (Hedge, 2000, p. According to Bachman (1990, p.
20), a test is a measurement instrument designed to elicit a specific sample of an individual‟s ehaviour. Besides the term “testing”, it is necessary that we should consider some more terms such as “evaluation”, “assessment” and “measurement” as all of them have a close relationship. 18) proposes that these terms are often used as synonyms that refer to the same activity. However, he also points out that each of them has its own distinctive characteristics.
Therefore, tests are only one of many different types of measurement. Hedge (2000) also agrees that: Assessment is the more inclusive term: it refers to the general process of monitoring or keeping track of the learners‟ progress. Testing is one kind of assessment, one which is typically used at the end of a stage of instruction to measure student achievement. 22) says that “tests in and of themselves are not evaluative”.