A Dissertation Entitled The U. News and World Report Rankings: An Investigation into the Perceptions of Engineering Deans regarding the Survey and the Rankings. Smallman Submitted to the Graduate Faculty as partial fulfillment of the requirements for the Doctor of Philosophy Degree in Higher Education _______________________________________________ David Meabon, Ph., Committee Chair _______________________________________________ Sonny Ariss, Ph., Committee Member _______________________________________________ Snejana Slantcheva-Durst, Ph., Committee Member _______________________________________________ Gregory Stone, Ph., Committee Member _______________________________________________ Dr. Komuniecki, Dean College of Graduate Studies The University of Toledo May 2015 Copyright 2015, Christine M.
Smallman This document is copyrighted material. Under copyright law, no parts of this document may be reproduced without expressed permission of the author. An Abstract of The U. News and World Report Rankings Survey: An Investigation into the perception of engineering deans regarding the survey and the rankings.
Smallman Submitted to the Graduate Faculty as partial fulfillment of the requirements for the Doctor of Philosophy Degree in Higher Education Degree The University of Toledo May 2015 The U. News and World Report Survey of graduate engineering programs is structured around four areas and nine indicators. Area A addresses quality assessment, Area B addresses student selectivity, and Area C addresses faculty resources, lastly Area D addresses research activity. The nine indicators categorized under the areas are: peer assessment, recruiter assessment, mean GRE quantitative scores, acceptance rate, and student to faculty ration (both doctoral and masters), faculty in the National Academy of Engineering, doctoral degree awarded, total research expenditures, and average research expenditures per faculty member.
Each area is weighted and each indicator given a percentage towards their final score. News and World Report Survey has a tenuous relationship with deans of engineering programs; yet is considered the authority by many among institutions who compile data to determine program quality and rankings. This study examines the perceptions of engineering deans in regards to the U. News and World Report Survey instrument, data collected, marketing budgets and the information the deans deem important, unimportant and what they would like to see iii included in the survey collection.
This instrument provided an opportunity to the 198 deans, who participated in the 2011 U. News and World Report Survey, who in turn provided their perceptions and input into what the U. News and World Report Survey is currently using to access and rank quality engineering programs. Nine research questions guided this research study which focus on the perceptions of the deans in regards to weights, percentages, what areas and indicators they would leave in the survey and which they would leave out.
The questions also address budgets and outcomes of funding put towards increasing survey ranking results. Analysis of the information returned indicate no significance between the U. News and World Report Survey and discord among the deans of engineering graduate programs. However, this research does reveal areas and indicators the deans of engineering would like removed, such as membership in the National Academy of Engineers, peer assessment review, and student selectivity, as well as, indicators deans would like to add when distributing the U.
News and World Report Survey such as scholarly publications, distance education and research space. iv Dedication To my patient and supportive husband Terry, our children and their partners, for their support and understanding in times when I could not be where I wanted to be, but needed to be, and to all six of my beautiful grandchildren who keep me smiling. To my sister and head cheerleader, Nancy Keefe Bump who held me up and kept me from getting discouraged – your turn is next. cohort family Drs.
Karen Hoblet, Gwen Walters and Marty Sexton, I could not have done this without your moral support and encouragement. The pride I feel that we have all finished the journey is unmeasurable. Lastly, with great love and respect I dedicate this study and my doctoral degree to my mother Beatrice Ann Logan Keefe (1931-1980). My promise to you, made on the night of your passing, 34 years ago is finished.
I am so grateful for having been your daughter. What you taught me in the 22 short years you were in my life has been my compass. Your love was unending and your thirst for learning unquenchable. You have given me many gifts my dear mother and because of you I was able to reach the goal - you could not - because you left this earth so young.
I owe you my life and am truly indebted to you for all that I am. You are in my thoughts and prayers each day and are a driving force in my life daily. I missed you terribly during this process and will continue to always miss you until I join you. Most of all I give all glory and recognition to our Lord Jesus Christ who has sustained me through this process and blessed me with his grace.
v Acknowledgements Next to God our Father I dedicate this dissertation to my advisor, Dr. David Meabon, who is an incredible mentor and strong supporter of my academic pursuits and total well-being. This journey has been filled with trials, tribulations, sickness, job loss, retirement and a new career path. Meabon’s silent strength, encouragement and belief in me is an incredible motivator which led me to the completion of this research study.
Meabon’s impact on my life educationally as well as a human being is priceless. He and he alone stood by me every step of the way and for this I am truly in your debt. God Bless You. I am indebted to several people at The University of Toledo who supported me during this endeavor, specifically Dr.
Sonny Arises, Dr. Gregory Stone and Dr. Snejana Slantcheva-Durst who served as committee members. I am also grateful for the advice, academic and monetary support of the following U.
colleagues, Interim President Nagi G. Naganathan, Dean Thomas Switzer, President Emeritus Daniel Johnson, Associate Dean Mohamed Samir Hefzy, Dr. Steven Kramer, Dr. Vickie Kuntz, Dr.
Frank Calzonetti, Dr. William Logie, Dr. Pat Murphy, Dr. Earl Murry, Dr.
William Bischoff, and Mrs. Ruth Anne Easterwood (superwoman) and Ms. I am also grateful to the John Russell family who provided me with a scholarship to offset some of the costs of my survey distribution. I would also like to acknowledge Dr.
Douglas Walters and Dr. Russ Sprinkle for their editing and APA guidance. Lastly, I would like to thank The University of Toledo for the three degrees I obtained as a former employee of their institution. Such a wonderful benefit accessible to every University of Toledo employee that is priceless.
vi Table of Contents Abstract iii Acknowledgements vi Table of Contents vii List of Tables xi Preface xii I. Chapter One - The Background of the Study 1 A. Statement of the Problem 4 C. Purpose of the Study 7 D.
Significance of the Study 15 G. Definition of Terms 20 L. Summary and Organizations of Remainder of Study 20 vii II. Chapter Two – Literature Review 22 A.
Engineering Graduate Education in the United States 30 G. Engineering Standards Professional Association 33 H. Accreditation in Engineering and Engineering Technology 35 I. Impact of Rankings 50 M.
Enrollment Management and Marketing 53 N. Chapter Three – Methodology 61 A. Data Collection Procedures 64 F. Survey Response and Coding 67 viii H.
Theory of Study 69 K. Chapter Four – Results and Implications 70 A. Chapter Five – Summary, Discussion, and Conclusion 80 A. Discussion of Findings 84 D.
Consumer Behavior Theory 87 E. Other Notable Findings 89 F. Implications for Policy and Practice 90 ix G. Engineering Programs Rankings Methodology 112 b.
Research Study Instrument 115 x List of Tables Table 1 Characteristics of Sample and Sample Population 65 Table 2 Deans Ranking of U. News and World Report Survey 66 Table 3 Ratings by Deans of U. News and World Report Survey Table 4 Indicators that Deans suggest be removed 68 Table 5 Comments Regarding specific indicators 69 Table 6 Additional indicators Deans would add 70 Table 7 Additional general comments from Deans of Engineering 71 xi Preface Individuals reading this doctoral decision may be curious as to the reasons why a doctoral student in higher education would choose to pursue a dissertation topic focused on engineering. This is a reasonable question considering neither my undergraduate nor master’s degree is in engineering.
I was employed in a college of engineering for over 27 years, and during that time, I have administered in a variety of roles in a number of different settings. For example, I was involved in academic activities and programs both at the undergraduate and graduate levels, such as assessment, accreditation, fundraising, friend raising and marketing. Through these various roles, I have attended various conferences and meetings at which ranking were discussed in a variety of different forums. During one particular visit to Washington, D., to attend the engineering dean’s yearly Capitol Hill visit, I received a copy of The Gathering Storm: Can the U.
Preserve its Lead in Science and Technology? (Brown, 2006). The publication was distributed by President George W. Bush in an effort to educate those in attendance about the importance of engineering and to warn engineering educators of a potential deficit in the number of engineers in the United States. This publication led to lively discussions regarding education, recruitment and the role that rankings play in the field of engineering education.
Furthermore, the rankings are currently being discussed in the Obama administration as to what involvement the government should have in the rankings process and should it be connected to external funding to institutions. These discussions, as well as my association with the academic aspects of engineering education, led to my interest in exploring issues related to ranking systems. In particular, xii these experiences led me to explore how deans of engineering colleges view the U. News and World Report Survey ranking system and the role it plays in recruitment, fundraising, and overall engineering graduate program percecptions.
xiii Chapter One The Background of the Study Introduction Rankings associated with academic institutions are defined as lists of institutions in higher education ranked according to a combination of factors. In addition to institution- wide rankings, there are specific program rankings by academic programs. Additionally, departments, and schools are also individually ranked by various organizations and publications such as the Princeton Review and Washington Monthly. Rankings are conducted by magazines, newspapers, government agencies, and academic associations.
When providing rankings, organizations and associations typically consider measures of research excellence, influence, student choices, eventual success, demographics, and other performance criteria. Some organizations and associations provide rankings for institutions within a single country, while others assess institutions worldwide. College and university rankings generally consist of lists of higher education institutions that are placed in a particular order based on combinations of factors. However, the topic of rankings have continued to generate much debate among stakeholders in higher education regarding their usefulness and accuracy.
The growing diversity in ranking methodologies and accompanying criticisms of each method of ranking reflect a lack of consensus in the field of higher education (Hyman and Jacobs, 2009). The rise in popularity of rankings and their durability is attributed to several conditions: increased student mobility; institutional use of rankings in promotional and marketing campaigns and decision making; the use of rankings in international 1 discussions of assessment, and accountability, and quality assurance efforts (Sponsler, 2009). For example, prospective students and parents often consult various rankings during the college admissions process. A Cornell University study found that rankings in the United States significantly affected colleges’ applications and admissions (Paget, 2008).
In recent months President Barack Obama entered the rankings discussions by holding the first U. Department of Education’s Symposium on Postsecondary Institution Rating System (Morse, 2014). Obama’s involvement with rankings is an effort to address institutional accountability and to address soaring tuition cost (Anderson, 2014).