MINISTRY OF INDUSTRY AND TRADE HANOI UNIVERSITY OF INDUSTRY PHAM THUY QUYNH ALIGNMENT BETWEEN COURSE LEARNING OUTCOMES AND ASSESSMENTS: AN ANALYSIS WITHIN LINGUISTIC PROGRAMS AT A UNIVERSITY IN VIETNAM MASTER THESIS IN ENGLISH LINGUISTICS Hanoi, 2024 MINISTRY OF INDUSTRY AND TRADE HANOI UNIVERSITY OF INDUSTRY PHAM THUY QUYNH ALIGNMENT BETWEEN COURSE LEARNING OUTCOMES AND ASSESSMENTS: AN ANALYSIS WITHIN LINGUISTIC PROGRAMS AT A UNIVERSITY IN VIETNAM Major: English Linguistics Code: 8220201 MASTER THESIS IN ENGLISH LINGUISTICS SUPERVISOR: Dr. Dang Thi Minh Tam Hanoi, 2024 i DECLARATION BY THE AUTHOR It is sincerely declared that the work presented in this document is entirely my original creation, except where otherwise indicated or acknowledged. Any assistance received in the preparation of this work has been duly acknowledged. I confirm that this manuscript has not been submitted for any degree or examination at any other institution.
All sources used in this work are appropriately cited and referenced. I take full responsibility for any errors or omissions present in this document. Furthermore, I affirm that this work does not violate upon the intellectual property rights of any individual or organization. I understand the consequences of academic dishonesty and plagiarism and assert that this work upholds the highest standards of academic integrity.
Date: ____________________________ Author’s signature Phạm Thúy Quỳnh ii ACKNOWLEDGEMENTS Embarking on the journey of academic research and thesis writing is not merely an individual attempt; it is a collective effort encompassing the support, guidance, and encouragement of numerous individuals and institutions. From the deepest of my heart, I wish to express my gratitude to those who have played irreplaceable roles in the realization of this thesis. I would like to express my heartfelt gratitude to Dr. Dang Thi Minh Tam for her invaluable guidance, encouragement, and unwavering support throughout the completion of this thesis.
Tam's helpful insights, constructive feedback, and scholarly knowledge not only influenced the content of my study but also helped me improve my critical thinking abilities and academic professionalism. Her expertise and mentorship have been instrumental in shaping the direction and quality of this research. I am deeply appreciative of the esteemed Rector of School, dedicated staff and the entire institution for providing a conducive academic environment and resources essential for undertaking this scholarly endeavor. My profound thanks go to my family for their unconditional love, understanding, and endless encouragement.
Their wholehearted support has been my pillar of strength throughout this journey. Lastly, I would like to express my gratitude to myself for the perseverance, determination, and hard work invested in completing this thesis. This journey has been challenging yet rewarding, shaping me into a better scholar and individual. iii ABSTRACT This thesis investigates the enhancement of course design methodologies through an examination of the application of Bloom's taxonomy in creating learning outcomes (LOs) and the analysis of alignment between assessment strategies and LOs.
Focused on the domains of linguistics and English as a Medium of Instruction (EMI), the study scrutinizes 33 test specifications and syllabi from relevant courses. Employing rigorous data analysis techniques, the research uncovers prevalent patterns in LO formulation, revealing a tendency within the institution to incorporate numerous requisites within individual LOs. Furthermore, the analysis highlights both areas of alignment and instances of misalignment between assessment methodologies and LOs. By illuminating these strengths and weaknesses, this study contributes valuable insights for refining course design paradigms, fostering more coherent alignment between intended learning outcomes and assessment strategies, and ultimately enhancing the educational experience.
Keywords: alignment, learning outcomes, assessment, linguistics programs iv TABLE OF CONTENTS DECLARATION BY THE AUTHOR .iii TABLE OF CONTENTS. Rationale for the study. Aim and objectives of the study. Scope of the study.
Significance of the study. Structure of the thesis. 5 CHAPTER 1: LITERATURE REVIEW. Course learning outcomes.
Definition of assessment. Types of test methods. Alignment and Constructive alignment. The importance of alignment.
Outcome-based approach. Outcome-based teaching and learning. Advantages of outcome-based approach. Outcome-based assessment.
English as medium instruction. Theoretical framework: Bloom9s Taxonomy. Bloom9s Taxonomy in writing learning outcomes. Bloom9s Taxonomy in assessment.
29 CHAPTER 2: RESEARCH METHODOLOGY. Data collection procedures. Data analysis methods. 33 CHAPTER 3: FINDINGS AND DISCUSSION.
The clarity of verbs in learning outcomes. The quantities of requirements within a single LO. Alignment between stated LOs and actual assessment. Alignment between stated LOs and actual assessment.
Misalignment between stated LOs and actual assessment in linguistics program. The balance quantities of requirements within a learning outcome statement. The importance of clarity in learning goals for enhancing the educational experience. Answering the research question.
Limitations and Recommendations. I APPENDIX 1: List of English-major courses. XI APPENDIX 2: List of EMI courses. XII vii APPENDIX 3: Examples of evaluation of alignment between assessment and learning outcomes in English-major courses.
XIII APPENDIX 4: Examples of evaluation of alignment between assessment and learning outcomes in EMI courses. XVIII APPENDIX 5: Letter of consent. XX viii LIST OF TABLES Table 1. Types of Written Tests.
Skills related to higher level thinking. Guidelines and experience in writing learning outcomes. The clarity of verbs in learning outcomes. Learning outcomes of linguistics courses.
Learning outcomes of EMI courses. Alignment between stated LOs and actual assessment in linguistics courses. Alignment between stated LOs and actual assessment in EMI courses 49 Table 3. Misalignment between stated LOs and actual assessment in linguistics program.
51 ix LIST OF ABBREVIATIONS EMI: English as a Medium Instruction OBE: Outcome-Based Education LOs/ILOs: Learning outcomes/Intended Learning Outcomes OBTL: Outcome-Based Teaching & Learning TLAs: Teaching and Learning Activities AMs: assessment methods OBA: Outcome-Based Approach 1 INTRODUCTION 1. Rationale for the study The globalized world's dominance of the English language in various spheres such as socio-economic development, technology, art and culture, and international relations has accentuated the need for career-oriented education to equip university students with language proficiency for effective exchange and integration. In this educational context, considering the alignment between assessment and learning outcomes in improving educational practices and fostering student learning represents a significant focus in higher education globally, particularly with the shift from a teacher-centered to a student-centered approach (El-Maaddawy & Deneen, 2017; Kennedy et al. A major concern in developing learning outcomes is their measurability, as they must lend themselves to assessment procedures that successfully evaluate what students have obtained after learning the courses.
Theoretically, the critical requirement is to develop evaluation methods and assessment tasks that can determine the extent to which these established learning outcomes are satisfied. This cohesive connection between assessment strategies, and intended learning outcomes serves as a crucial factor in enhancing the transparency of the overall learning experience (Coates, 2014). However, teachers may confront the difficult challenge of selecting and designing suitable assessments to guarantee a smooth alignment with the specified learning objectives. As a result, the difficulty is not only in articulating precise and measurable learning goals but also in integrating them into a framework that improves the learning experience.
Curriculum alignment becomes a crucial process for evaluating educational courses or programs, enabling 2 them to effectively respond to the evolving demands of society and the labor market. Through consistent understanding of course objectives and assessment methods, successful comprehension and application of knowledge are fostered, promoting active engagement and self-discovery among students. To contribute to this endeavor, the present study aims to analyze the alignment between course learning outcomes and assessments within linguistic programs at a Vietnamese university, sheds light on potential discrepancies or congruence between what is intended to be taught and what is being evaluated. It is hoped that the findings of this research will promote a more positive and effective learning and provide valuable insights into enhancing language education and its relevance to the demands of the contemporary world.
Furthermore, the insights gained from this study are also expected to aid teachers and curriculum development teams in designing more efficient and targeted courses, ultimately enhancing students' language proficiency and overall learning experience in linguistic programs at the university. Aim and objectives of the study The primary aim of this study is to investigate the alignment between course learning outcomes and assessments within linguistic programs at a Vietnamese university. The overarching objectives are: • To examine how Bloom Taxonomy applied in writing and delivering learning outcome statements to students • To analyze the extent to which the stated learning objectives of linguistic courses correspond with the actual assessment methods employed to evaluate students' knowledge and skills. 3 • To make recommendations with a view to enhancing the alignment between assessment and learning outcomes in the researched institution.
Research question In pursuit of the research aim and objectives outlined above, an overarching research question has been put forward: • To what extent do the assessment methods employed in linguistic courses align with the stated learning objectives at a Vietnamese university? 4. Scope of the study The scope of this research focuses on analyzing 33 different sets of documents including syllabi and test specifications for assessing learning outcomes. These documents represent a purposive selection from both linguistic courses and courses from EMI group (English as a Medium Instruction) offered within the linguistic programs. The inclusion of major language courses and courses from EMI group ensures a holistic representation of the diverse educational offerings within the linguistic curriculum.
The examination of these 33 sets of documents allows for an investigation into the alignment dynamics between course learning outcomes and assessment methods. This scope enables an in-depth exploration of current alignment and possible challenges across the linguistic programs, while also facilitating the identification of patterns specific English-majored and EMI courses. Significance of the study The extensive literature on utilizing Bloom's Taxonomy to align assessments with learning outcomes reveals a research gap, particularly within the context of Vietnamese higher education. While global studies highlight the taxonomy's 4 importance in shaping educational practices, few focus on its application in Vietnam.
This gap emphasizes the necessity for the present study, which aims to investigate how Vietnamese higher education teachers employ Bloom's Taxonomy in writing learning outcomes and aligning assessments with stated learning outcomes. By examining this alignment, the research can uncover disparities and areas of misalignment, informing suggestions to enhance instructional design and assessment strategies. This study holds promise for improving course design within linguistic programs. By identifying alignment strengths and weaknesses, educators can refine educational offerings to better support students' cognitive development and knowledge acquisition.
Additionally, the findings could guide the development of courses aligned with the goals of linguistic programs, creating a more cohesive learning experience. Ultimately, this research has the potential to drive meaningful improvements in pedagogical practices, educational quality, and student success within linguistic programs within the institution context. Research methods The research methodology for this study involves a combination of document analysis and qualitative content analysis methods to investigate the alignment between learning outcomes and assessment methods within linguistic courses. Over 30 sets of documents, including test specifications and assessment guidelines, are collected from a diverse range of linguistic courses to serve as primary data sources.
Through a systematic coding process based on Bloom's Taxonomy levels, learning outcomes and assessment methods are categorized to provide a structured framework for evaluating alignment. The alignment assessment is conducted using the 5 predefined coding scheme, focusing on assessing the extent to which learning outcomes align with the cognitive demands implied by assessment methods. Qualitative content analysis will further facilitate the identification of emerging patterns, and misalignments within linguistic programs, leading to a comprehensive interpretation of the data. The results will be discussed in light of pedagogical practices and curriculum design, with implications drawn for enhancing educational quality within linguistic programs.
Structure of the thesis The thesis structure commences with an Introduction, providing an overview of the study.