+612 9045 4394
Scoring Performance Assessments Based on Judgements : Generalizability Theory - Christopher Wing-Tat Chiu

Scoring Performance Assessments Based on Judgements

Generalizability Theory

Hardcover Published: 30th September 2001
ISBN: 9780792374992
Number Of Pages: 155

Share This Book:


RRP $457.99
or 4 easy payments of $79.22 with Learn more
Ships in 7 to 10 business days

Other Available Editions (Hide)

  • Paperback View Product Published: 20th November 2012

Scoring Performance Assessments Based on Judgements focuses on the applications of Generalizability Theory to Performance Assessment. The author developed an objective method to examine the dependability of the scoring of large-scale performance assessments by humans.
This book presents principles in identifying common missing data patterns inherent in assessment designs. These principles can be used to guide the design of assessment procedures including those used in large-scale testing programs, observations, and structured interviews.

List of Figuresp. xi
List of Tablesp. xv
Prefacep. xix
Acknowledgmentsp. xxi
Introductionp. 1
Significance of the Current Studyp. 2
Literature in Variance Component Estimations, Large-Scale Assessments, and Missing Datap. 5
Indices Commonly Used in Criterion Referenced and Norm-Referenced Testsp. 5
Analyzing Missing Data in G Theoryp. 9
Historical Approaches to Analyzing Missing Datap. 12
Imputation as a Method to Handle Missing Datap. 14
Potential Solutions in Handling Missing Data in G Theoryp. 14
Summary of Literature Reviewp. 17
Methodologyp. 19
Procedures of the Subdividing Methodp. 20
Decision Rule for Weightingp. 31
Examplesp. 33
Evaluation of the Subdividing Methodp. 38
Conditions to Varyp. 41
Data Generationp. 49
Outcomes and Data Analysisp. 52
Validations of the Subdividing Methodp. 57
Comparison of Pooled Results with Weights and Without Weightsp. 59
The Effect of Packing Essays into Batches of 12 Versus Batches of 24p. 68
Accuracy of the Variance Components for Two Rating Plansp. 73
Precision of the Subdividing Method and the Effects of Expanding Rater Pool Sizesp. 74
Precision of the Subdividing Method and the Effects of Increasing Volume of Examineesp. 80
Findings on the Disconnected Crossed and the Connected Mixture Rating Plansp. 82
Precision of the Subdividing Method for Item Effectsp. 88
Accuracy and Precision in Making Norm- and Criterion-Referenced Decisionsp. 90
Conclusions, Discussions, and Future Directionsp. 97
Subdividing Method and Unbalanced Situations in Performance Assessmentp. 97
Major Findings and Implicationsp. 98
New Applications of the Subdividing Method and Future Directionsp. 103
Suggestions to Test Developers and Educational Valuesp. 106
Computer Programs and Rater Design Diagnosisp. 111
Illustrations of the SPSS Subdividing Programp. 112
Rater Profilingp. 118
Using Multiple Computers to Conduct Large-Scale Simulationsp. 121
Appendicesp. 125
Referencesp. 139
Subject Indexp. 146
Author Indexp. 151
Table of Contents provided by Syndetics. All Rights Reserved.

ISBN: 9780792374992
ISBN-10: 0792374991
Series: International Series in Operations Research & Management Science
Audience: Professional
Format: Hardcover
Language: English
Number Of Pages: 155
Published: 30th September 2001
Country of Publication: NL
Dimensions (cm): 22.91 x 17.88  x 1.6
Weight (kg): 0.45