Objective Measurement

Mark Wilson is the founder and director of the Asia Minor Research Center in Antalya, Turkey. He currently has academic appointments at Stellenbosch University, the University of South Africa, Ridley College, and Regent University. He is the author of Biblical Turkey (2014) and Victory through the Lamb (2014).

The chapters in this new volume describe original research concerned with both theory and practice in measurement. The material originated in presentations made at a conference that brings together practicing professionals and theoreticians in diverse areas of measurement and related fields. The first group of papers embody the most important aspect of objective measurement - its application to diverse contexts and purposes. The examples included concentrate on two types of situations: performance assessment and criterion-referenced testing. The specific contexts range from writing assessment, to assessment of the professional development of teachers, to high school physics. The second group of papers are focused on an area of great importance in assessment today: the modeling of raters and judges in an assessment context. The volume concludes with papers that explore the domain of theory in measurement, characterized by an innovative approach to model-building. Even though they are categorized as theory papers, most are based on the complicated and interesting problems that arise in quite specific contexts. As such, they represent some of the most original and exciting developments in the field of measurement today ranging from multidimensional measurement to graph theory and clustering techniques.This volume presents original research concerned with the practice of measurement, and the theory of measurement. The words in the title, objective measurement indicate that the chapters are all related to a particular approach to the philosophy and practice of measurement. By objective measurement, we mean that, in a situation where a certain class of stimuli (for example, items) are used to measure certain individuals.The chapters in this book originated in presentations made at the International Objective Measurement Workshop (IOMW) devoted to exploring the interface between theory and practice in measurement. Based on the complicated and interesting problems that arise in quite specific contexts, they represent some of the most original and exciting developments in the field of measurement today.

Aimed at a broad audience concerned with measurement and assessment issues in education, psychology, and related social science fields.

MEASUREMENT PRACTICESetting and Evaluating Performance Standards for High Stakes Writing Assessments, George Engelhardt Jr. and Belita GordonFormative Evaluation of a Performance Assessment Scoring System, Susan Paulukonis, Carol Myford and Joan I. HellerUsing Criterionreferenced Maps to Produce Meaningful Evaluation Measures: Evaluating Changes in Middle School Science Teachers' Assessment Perceptions and Practice, Lily RobertsUsing the Rasch Model to Study Large Scale Physics Exams in Australia, Andrew StephanouAPPLICATONS INVOLVING RATERS AND JUDGESRaters and Single Prompt-to-Prompt Equating Using the FACETS Model in a Writing Performance Assessment, Yi Du and William L. BrownAn Examination of Variation in Rater Severity Over Time: A Study in Rater Drift, Mark Wilson and Harry CaseA Method to Compare Rater Severity Across Several Administrations, Thomas R. O'Neill and Mary LunzDetecting Rater Effects in Simulated Data with a Multi-faceted Rasch Rating Scale Model, Edward W. Wolfe, Chris W. T. Chiu and Carol M. MyfordUnmodelled Rater Discrimination Error, Peter CongdonSetting Standards on Performance Examinations, Mary E. LunzMEASUREMENT THEORYA Multicomponent Rasch Model for Measuring Covert Processes: Application to Lifespan Ability Changes, Susan Embretson and Karen M. SchmidtInterpreting the Parameters of a Multidimensional Rasch Model, Wen-chung Wang, Mark Wilson and Raymond J. AdamsThe Implications of Halo Effects and Item Dependencies for Objective Measurement, T. F. McNamara and Raymond J. AdamsRasch Measurement Theory, The Method of Paired Comparisons, and Graph Theory, Mary Garner and George Engelhard Jr.A Procedure for Detecting Pattern Clustering in Measurement Designs, George Marcoulides and Zvi DreznerExamining Replication Effects in Rasch Fit Statistics, Richard M. Smith, Randall E. Schumaker, and M. Joan BushAPPENDIXThe Ninth International Objective Measurement Workshop