VIETNAM NATIONAL UNIVERSITY, HANOI UNIVERSITY OF FOREIGN LANGUAGES AND INTERNATIONAL STUDIES FALCUTY OF POST-GRADUATE STUDIES ………………. TRẦN THÚY QUỲNH THE CONTENT VALIDITY OF THE CURRENT ENGLISH ACHIEVEMENT TEST FOR SECOND YEAR NON MAJOR STUDENTS AT PHUONG DONG UNIVERSITY (Đánh giá sự phù hợp về nội dung của bài kiểm tra tiếng Anh cuối kỳ dành cho sinh viên không chuyên năm thứ hai Trường Đại học dân lập Phương Đông) M.A MINOR THESIS Field: ENGLISH TEACHING METHODOLOGY Code: 60-14-10 Course: 18 (2009-2011) Supervisor: M.A Kim Van Tat HA NOI- SEPTEMBER 2011 TIEU LUAN MOI download : skknchat@gmail.com iv TABLE OF CONTENTS Page Acknowledgement……………………………………………………….ii List of tables and figures…………………………………………………iii The table of contents………………………………………………….iv Chapter 1: Introduction 1. Scope of study……………………………………………………. Aims of study…………………………………………………….
Methods of study…………………………………………………. Design of study……………………………………………………3 Chapter 2: Literature review 2. Definition of language testing……………………………………. The roles of language testing…………………………………….
Relationship between testing and teaching- learning……………. Major Characteristics of a good test 2. What is test validity?. Types of test validity………………………………………….
What is content validity?. How to make the test more valid?.13 TIEU LUAN MOI download : skknchat@gmail. Relationship between reliability and validity……………………. Discrimination………………………………………………17 Chapter 3: The study 3.
English learning, teaching and testing at Phuong Dong University 3. The course book “New Headway Elementary- The third edition”. Syllabus and its objectives………………………………………. The final achievement test…………………………………………20 3.
The survey questionnaires…………………………………………21 3. Analysis of the final achievement test……………………………. Analysis of the survey questionnaire for students…………………26 3. Analysis of the survey questionnaire for teachers…………………30 3.32 Chapter 4: Recommendations and conclusions 4.45 Appendixes Appendix 1: The content of the course book……………….I Appendix 2: Survey questionnaires for students………….IV Appendix 3: Survey questionnaires for teachers……………V Appendix 4: Answer key for reading task ………………….VII Appendix 5: Answer key for the new final achievement test.VIII TIEU LUAN MOI download : skknchat@gmail.com iii LIST OF TABLES AND CHARTS 1.
Table 1: Scores on test A (invented data) by Arthur Hughes 2. Table 1: Scores on test B (invented data) by Arthur Hughes 3. Table 3: The components of the final achievement test 4. Table 4: What students had been taught and what they had been checked in part I, II, III of the test 5.
Table 5: What students had been taught and checked in the writing part. Table 6: Paper specification grids for the final achievement test. Chart 1: Students’ comment on validity of the test 8. Chart 2: Students' comment on time allowance of the test 9.
Chart 3: Students' comment on difficult level of the test 10. Chart 4: The result of the test 11. Chart 5: The purpose of the test TIEU LUAN MOI download : skknchat@gmail.com 1 Chapter 1: Introduction 1. Rationale These days, the need of learning English has become greater and greater.
In our country Viet Nam, having recognized the importance of it, the Ministry of Education and Training (MOET) has recently decided that English is a compulsory subject in most high schools and universities. This decision requires both teachers and students to alter their ways of teaching and learning. In addition, testing is one effective way to evaluate teaching and learning. They are so closely related.
Testing validates the teaching-learning process while teaching and learning provides a great source of language materials for testing to exploit. And testing is a concerned matter to all teachers. During the teaching time at Phuong Dong University, the writer heard both teachers and students here complaining that the English test did not often faithfully reflect the teaching and learning process or in other words, the test did not reflect what the students learnt and what the teachers taught. What was tested was not really taught and the test measures neither the achievement of the course objectives nor the expected skills and knowledge of students.
It is shared by some test researchers as Brown (1994: 373) and Hughes (1989:1) on recent language testing: “A great deal of language testing is of very poor quality. Too often language testing has a harmful effect on teaching and learning and too often they fail to measure accurately whatever it is they are intended to measure.” Another reason for the selection of this research topic lays in the fact that language testing at Phuong Dong University has not been paid enough attention to. Classroom language tests were often written in a hurry because the teachers here could not find time to think carefully and plan the test. Sometimes, they did not have a clear idea of what they were testing students for and why.
They were busy mixing the number of various question types and from that many students got low marks. Due to its close relationship with language teaching and learning, testing deserves proper attention from teachers and students in order for a positive backwash on the teachers‟ teaching, students‟ satisfaction and encouragement in their study. In order to design a good test to have exact, fair and effective evaluation of students‟ knowledge and TIEU LUAN MOI download : skknchat@gmail.com 2 performance of English, teachers are supposed to have good knowledge of test writing techniques and testing theories. Because of all above-mentioned reasons, the writer is encouraged to undertake this study entitled: “Content validity of the current English achievement test for second-year- non-major students of English at Phuong Dong University” with aims at finding out the strengths and weaknesses of this test in terms of the content validity and some, if any, suggested solutions for the improvement of it.
Scope of study The scope of this thesis is limited to a research on evaluating the final achievement test in terms of its content validity by comparing the objectives, the syllabus and the textbook allocation with the test contents. The study provides investigated and analyzed data of the currently used test and proposes practical suggestions on the improvements of this test. Due to the limitations of time, ability and conditions, it is impossible for the writer to cover all the tests. Only some suggestions for the improvements of the test are presented.
Aims of study The study aims at checking the content validity of the final achievement test for second-year-non-major students at Phuong Dong University. It places high emphasis on analyzing the contents of the final achievement test. The specific aims of this research are: - To find out the strengths and weaknesses of the currently used test with reference to the content validity. - To suggest some improvements for the test.
Methods of study In order to achieve the above-mentioned aims, a combination of many methodologies was utilized. Firstly, the writer based herself both on the theories and principles of language testing and major characteristics of a good test with a special focus on test content validity. From her own reading, many reference materials have been gathered and analyzed to draw out a theoretical basis to evaluate the achievement test being used for second year students TIEU LUAN MOI download : skknchat@gmail.com 3 in terms of its content validity. Basing on what students had learnt in their first semester and the contents of this test, the writer would examine its content validity.
In addition, qualitative methodologies involving data collected through survey questionnaires were employed. Two sets of questionnaires were administered to both English teachers and students at Phuong Dong University to investigate their evaluative comments on the content validity of the final achievement test and some suggestions for its improvements. Research questions In this study, the writer tries to answer the two following questions: Question 1: What are the strengths and weaknesses of the final achievement test with reference to the content validity for second year non major students at Phuong Dong University? Question 2: What are some suggested solutions for the improvements of the test? 1. Design of study The thesis is organized into five major chapters: 1.
Chapter 1 INTRODUCTION presents such basic information as: the rationale, the aims, the methods, the research questions and the design of the study. Chapter 2 LITERATURE REVIEW presents a review of related literature that provides the theoretical basis for evaluating and building a good language test. This review includes background on language testing, criteria of good tests and theoretical issues on test content validity. Chapter 3 THE STUDY mentions the methods used in the research and which shows its detailed results of the surveys including the questionnaires and the analysis of the final achievement test in order to find out its problems with reference to the content validity.
Chapter 4 RECOMMENDATIONS AND CONCLUSIONS. Recommendations provide some suggestions for the improvements of the final achievement test basing on the mentioned theoretical and practical study. Conclusions summarize the matters of research, its findings as well as its limitations. TIEU LUAN MOI download : skknchat@gmail.com 4 Chapter 2: Literature review This chapter provides an overview of the theoretical background of the study.
It includes three main sections. Definition of language testing Testing is an important part of every teaching and learning experience and becomes one of the main aspects of methodology. The issue of language testing and its significant role has been discussed a great deal by many professionals and research worldwide. Different definitions of language testing are given out with various points of view.
According to Allen (1974:313), testing as an instrument to ensure that students have a sense of competition rather than to know how good their performance is and in which condition a test can take place. He says: “Test is a measuring device which we use when we want to compare an individual with other individuals who belongs to the same group.” Carroll (1986:46) stresses a psychological or educational test is a procedure designed to elicit certain behavior from which one can make inferences about certain characteristics of an individual. In other words, a test is a measurement instrument designed to elicit a particular behavior of each individual. According to Bachman (1990:20), what distinguishes a test from other types of measurement is that it is designed to obtain specific sample of behavior.
This distinction is believed to be of great importance as it reflects the primary justification for the use of language and has implications for how we design, develop, and use them to their best use. Thus, language tests can provide the means for more focus on the specific assure of interest. In the point of view of Ibe (1981:1), “a sample of behavior under the control of specified conditions aims toward providing a basis for performing judgment.” The term a sample of behavior used here is quite board and it means something else rather than the traditional types of paper and pencils. Yet, Heaton (1988:5) has different opinion.
In his ideal, tests are considered as a mean of assessing the students‟ performance and to motivate the students. He looks at tests with positive eyes as many students are eager to take tests at the end of the semester to TIEU LUAN MOI download : skknchat@gmail.com 5 know how much knowledge they have. One important thing is that he points out the relationship between testing and teaching. The roles of language testing Language testing is a form of measurement.
It helps the teachers: + To assess the learner‟s achievement in a language program, for example, to evaluate the testee‟s language knowledge in relation to a given curriculum or material which the testee has gone through in a given course. + To assess a learner‟s proficiency in language in relation to future language use; for example, to find out if a person‟s language is good enough for him to become a tourist guide. This is the future use of the language regardless of what language programs or materials the testee went through. + To diagnose a learner‟s strengths and weaknesses in a language and to attempt to explain why the certain problems occur and what treatments could be used to tackle these problems.
+ To classify or place the testees in the appropriate language classes. + To measure the testee‟s aptitude for learning a language. + To evaluate the effectiveness of a language program.