Online Student Ratings of Instruction

This volume examines the development and growing use of onlinestudent ratings and the potential impact online rating systems willhave on the future of students' evaluations ofteaching. The contributors demonstrate how the preference foronline evaluation is growing, even amidst challenges and doubt.Sharing their first-hand experience as researchers andadministrators of online systems, they explore major concernsregarding online student ratings and suggest possible solutions.D. Lynn Sorenson and Christian M. Reiner review existingonline-rating systems that have been developed independently acrossthe globe. Kevin Hoffman presents the results of a national surveythat tracks the increased use of the Internet for student ratingsof instruction. At Northwestern University, Nedra Hardydemonstrates how ongoing research about online student evaluationsis helping to dispel common misperceptions.Application of online rating systems can present institutionswith new challenges and obligations. Trav D. Johnson details a casestudy based on five years of research in the response rates for oneuniversity's online evaluation system and suggests strategiesto increase student participation. Reviewing online reportingof results of online student ratings, Donna C. Llewellyn exploresthe emerging issues of security, logistics, andconfidentiality.Other chapters explore existing online systems, highlightingtheir potential benefits for institution and instructor alike.Beatrice Tucker, Sue Jones, Lean Straker, and Joan Cole analyzeCourse Evaluation on the Web (CEW), a comprehensive online systemfor instructional feedback and improvement. Cheryl Davis Bullockreviews the Evaluation Online (EON) system and its successful rolein facilitating midcourse student feedback.The fate of online rating may rest in the unique advantages itmay - or may not - have over traditional ratingssystems. Debbie E. McGhee and Nana Lowell compare online andpaper-based methods through mean ratings, inter-rater reliabilitiesand factor structure of items. Comparing systems from anotherangle, Timothy W. Bothell and Tom Henderson examine the fiscalcosts and benefits of implementing an online evaluation system overpaper-based systems.Finally, Christina Ballantyne considers the prominent issues andthought-provoking ideas for the future of online student ratingsraised in this volume. Together, the contributors bring insight andunderstanding to the processes involved in researching andinitiating innovations in online-rating systems.This is the 96th issues of the quarterly journal NewDirections for Teaching and Learning.

1. Charting the Uncharted Seas of Online Student Ratings ofInstruction 1D. Lynn Sorenson, Christian ReinerIslands of online-rating systems are sprinkled across theglobe. Separated by uncharted seas, most have arisen independentlywithout the benefit of other innovators' "maps." In facilitatingdiscussion among these "early adopters," the authors previewWeb-based evaluation issues to provide a navigation tool forexplorers of online student ratings.2. Online Course Evaluation and Reporting in Higher Education25Kevin M. HoffmanResults of a national survey indicate an increase in the use ofthe Internet for student ratings of instruction.3. Online Ratings: Fact and Fiction 31Nedra HardyAdministrators, faculty, and students sometimes expressreservations about online student ratings. At NorthwesternUniversity, ongoing research about online student evaluations hashelped dispel some common (mis)perceptions.4. Psychometric Properties of Student Ratings of Instruction inOnline and On-Campus Courses 39Debbie E. McGhee, Nana LowellTo compare online and paper-based methods of student ratings ofinstruction, researchers examine mean ratings, inter-raterreliabilities, and factor structure of items.5. Online Student Ratings: Will Students Respond? 49Trav D. JohnsonBased on five years of research, a case study focuses on theresponse rates for one university's online evaluation system. Theauthor identifies factors that influence response rates andsuggests strategies to increase student participation.6. Online Reporting of Results of Online Student Ratings61Donna C. LlewellynWhen examining the merits of online reporting of student-ratingresults, universities must consider security, logistics,confidentiality, and other important issues.7. Do Online Ratings of Instruction Make $ense? 69Timothy W. Bothell, Tom HendersonIn comparing online and paper-based systems, institutions needto consider development costs, operating costs, and miscellaneouscosts. In a case study, researchers found that an online studentevaluation system was less expensive than a traditional paper-basedsystem.8. Course Evaluation on the Web: Facilitating Student andTeacher Reflection to Improve Learning 81Beatrice Tucker, Sue Jones, Leon Straker, Joan ColeCourse Evaluation on the Web (CEW) is a comprehensive onlinesystem for instructional feedback and improvement. CEW promotesreflection and cooperation among faculty, students, andadministrators.9. Online Collection of Midterm Student Feedback 95Cheryl Davis BullockAn online evaluation system offers an opportunity forcollecting midcourse student feedback. The Evaluation Online (EON)system provides both flexibility and structure for midcourseformative evaluation. This chapter presents faculty opinions andsuggestions for the online midterm feedback system.10. Online Evaluations of Teaching: An Examination of CurrentPractice and Considerations for the Future 103Christina BallantyneThe author considers prominent issues raised in this volume andthought-provoking ideas for the future of online studentratings.INDEX 113