Research Reports

Rpt#Research ReportDateAuthor(s)
1.Coefficients and Indices in Generalizability TheoryAugust 2003Robert L. Brennan
2.Institutional Selectivity and Good Practices in Undergraduate Education: How Strong is the Link?April 2004Ernest T. Pascarella, Ty Cruce, Paul D. Umbach, Gergory C. Wolniak, George D. Kuh, Robert M Carini, John C, Hayek, Robert M. Gonyea, and Chun-Mei Zhao
3.LEGS ManualJanuary 2004Robert L. Brennan
4.A Multivariate Generalizability Analysis of the Multistate Bar ExamJanuary 2004Ping Yin
5.Bootstrap Procedures for Estimating Standard Errors of Estimated Variance Components for Two-Facet DesignsFebruary 2004Ye Tong and Robert L. Brennan
6.Revolutions and Evolutions in Current Educational TestingMay 2004Robert L. Brennan
7.The Bootstrap Procedure for Estimating Decision Consistency for Single-Administration Complex AssessmentsJune 2004 Robert L. Brennan and Lei Wan
8.Some Perspectives on Inconsistencies Among Measurement ModelsJuly 2004Robert L. Brennan
9.Manual for BB-CLASS: A Computer Program that uses the Beta-Binomial Model for Classification Consistency and AccuracyDecember 2004Robert L. Brennan
10.A Multinomial Error Model for Tests with Polytomous ItemsJanuary 2005Won-Chan Lee
11.An Alternative Continuization Method to the Kernel Method in von Davier, Holland and Thayer's (2004) Test Equating FrameworkJuly 2007Tianyou Wang
12.Some Test Theory for the Reliability of Individual Profiles - under revision  
13.Classification Consistency and Accuracy Under the Compound Multinomial ModelRevised April 2008Won-Chan Lee
14.Standard Errors of Equating for Equipercentile Equating with Log-Linear Pre-Smoothing using the Delta MethodMarch 2006Tianyou Wang
15.Bootstrap Techniques for Estimating Variability in Generalizability TheoryMarch 2006Ye Tong and Robert L. Brennan
16.A Strong True-Score Model for Polytomous ItemsApril 2006Won-Chan Lee, Tianyou Wang, Seonghoon Kim, and Robert L. Brennan
17.A Comparison of the Frequency Estimation and Chained Equipercentile Methods Under the Common-Item Non-Equivalent Groups DesignApril 2006Tianyou Wang, Won-Chan Lee, Robert L. Brennan, and Michael J. Kolen
18.Correcting for Bias in Single-Administration Decision Consistency IndexesJuly 2006Robert L. Brennan and Won-Chan Lee
19.A Modified Frequency Estimation Equating Method for the Common-Item Non-Equivalent Groups DesignAugust 2006Tianyou Wang and Robert L. Brennan
20.A Model for the Joint Distribution of Item Response and Response Time using a One-Parameter Weibull DistributionApril 2006Tianyou Wang
21.Unbiased Estimates of Variance Components with Bootstrap Procedures: Detailed ResultNovember 2006Robert L. Brennan
22.Estimating Classification Consistency for Complex AssessmentsJanuary 2007Lei Wan, Robert L. Brennan, and Won-Chan Lee
23.Comparison of Three IRT Linking Procedures in the Random Groups Equating DesignFebruary 2007Won-Chan Lee and Jae-Chun Ban
24.Defining a Score Scale in Relation to Measurement Error for Mixed Format TestsFebruary 2007Jae-Chun Ban and Won-Chan Lee
25.A Multi-group Generalizability Analysis of a Large-scale Reading Comprehension TestAugust 2007Dongmei Li and Robert L. Brennan
26.Assessing IRT Model-Data Fit for Mixed Format TestsNovember 2007Kyong Hee Chon, Won-Chan Lee, and Timothy N. Ansley
27.Classification Consistency and Accuracy for Complex Assessments Using Item Response TheoryApril 2008Won-Chan Lee
28.The Effect of Different Factors on Group Invariance in a Concordance Context with a Single Group DesignFebruary 2009Nooree Huh and Won-Chan Lee
29.Multivariate Generalizability Analyses of Mixed-Format ExamsNovember 2009Sonya Powers and Robert L. Brennan
30.First-order and Second-order Equity in EquatingAugust 2010Robert L. Brennan
31.Assessing Equating Results Based on First-order and Second-order EquityDecember 2010Eunjung Lee, Won-Chan Lee, and Robert L. Brennan
32.Measurement Error Variability for Advanced Placement (AP) Composite Scores and GradesJanuary 2011Benjamin J. Andrews, Michael J. Kolen, and Won-Chan Lee
33.Utility Indexes for Decisions about SubscoresRevised December 2012Robert L. Brennan
34.A Multivariate Generalizability Analysis of Portfolio Assessments in Dental Education April 2013 Robert L. Brennan
35.Hierarchical Cognitive Diagnostic Analysis for TIMSS 2003 MathematicsAugust 2013 Yu-Lan Su, Kyong Mi Choi, Won-Chan Lee, Taehoon Choi, and Melissa McAninch
36.Factors Affecting Accuracy of Comparable Scores for Augmented Tests under Common Core State Standards August 2013Ja Young Kim, Won-Chan Lee, Deborah J. Harris
37.Effects of the Number of Common Items on Equating Precision and Estimates of the Lower Bound to the Number of Common Items NeededAugust 2013 Mengyao Zhang and Michael J. Kolen
38.Hierarchical Cognitive Diagnostic Analysis: Simulation StudyDecember 2013Yu-Lan Su, Won-Chan Lee, Kyong Mi Choi
39.Evaluation of Comparability of Scores and Passing Decisions for Different Item Pools of Computerized Adaptive ExaminationsNovember 2014Wei Wang, Shichao Wang, Michael J. Kolen,
Won-Chan Lee, Jaime L. Peterson,
Mengyao Zhang, and Seohong Pak
40.Equating Multidimensional Tests under a Random Groups Design: A Comparison of Various Equating ProceduresNovember 2014Eunjung Lee, Won-Chan Lee, Robert L. Brennan
41.A Comparative Study of Item Response Theory Item Calibration Methods for the Two Parameter Logistic ModelApril 2015Kyung Yong Kim and Won-Chan Lee
42.Utility Indexes for Composite ScoresRevised September 2016Robert L. Brennan
43.Equating with Bivariate Log-linear Presmoothing under the Common-item Nonequivalent Groups Design: Structural Zeros and Their ImplicationsJune 2015Hyung Jin Kim, Robert L. Brennan, and Won-Chan Lee
44.Utility Indexes for Composite Scores: Matrix Formulation Including R Code and ExamplesRevised August 2016Hyung Jin Kim and Robert L. Brennan
45.Manual for ESUM-RG: Excel VBA Macros for Comparing Multiple Equating Procedures under the Random Groups DesignDecember 2015Robert L. Brennan, Prasad Toke, Hyung Jin Kim, Won-Chan Lee, Kyung Yong Kim, and Euijin Lim
46.Interval Estimation Procedures for Weighted Composite ScoresApril 2016Kyung Yong Kim and Won-Chan Lee
47.Subscore Equating and ReportingMay 2016Euijin Lim and Won-Chan Lee
48.Similarities Between Equated Equivalents Using Presmoothing and PostsmoothingAugust 2016Hyung Jin Kim, Robert L. Brennan and Won-Chan Lee
49.Multiple Group IRT Fixed-Parameter Estimation for Maintaining an Established Ability ScaleAugust 2016Seonghoon Kim and Michael J. Kolen
50.Weights in Multivariate Generalizability TheoryDecember 2016Robert L. Brennan
51.Using G Theory to Examine Confounded Effects: "The Problem of One"January 2017Robert L. Brennan
52.A Statistical Criterion to Assess Fitness of Cubic-Spline PostsmoothingAugust 2017Hyung Jin Kim, Robert L. Brennan and Won-Chan Lee
53.Generalizability Theory References: The First Sixty YearsFebruary 2020Robert L. Brennan and Jui-Teng Ray Liao
54.Impact of Degrees of Postsmoothing on Long-Term Equated Scale Score AccuracyDecember 2020Stella Y. Kim, YoungKoung, Kim∗ Tim Moses
55.Rater Effects and Double Scoring in IRT Proficiency EstimationJanuary 2021Yoon Ah Song, Brandon LeBeau, Won-Chan Lee
56.Illustration of Factors Affecting Performance of the S − X2 Item-Fit IndexJune 2023Hyung Jin Kim, Won-Chan Lee
56.Comparison of Simultaneous Linking and Separate Calibration with Stocking-Lord MethodNovember 2024Guangyun Liu, Hyung Jin Kim, Won-Chan Lee, YoungKoung Kim

Monographs

Rpt# Monograph Date Author(s)
1. Equating Recipes September 2009 Robert L. Brennan, Tianyou Wang, Seonghoon Kim, and Jaehoon Seol
2.1
Mixed-Format Tests: Psychometric Properties with a Primary Focus on Equating (Volume 1)
December 2011 Michael J. Kolen and Won-Chan Lee, Editors
2.2 Mixed-Format Tests: Psychometric Properties with a Primary Focus on Equating (Volume 2) December 2012 Michael J. Kolen and Won-Chan Lee, Editors
2.3 Mixed Format Tests: Psychometric Properties with a Primary Focus on Equating (Volume 3) December 2014 Michael J. Kolen and Won-Chan Lee, Editors
2.4 Mixed-Format Tests: Psychometric Properties with a Primary Focus on Equating (Volume 4) December 2016 Michael J. Kolen and Won-Chan Lee, Editors
2.5 Mixed-Format Tests: Psychometric Properties with a Primary Focus on Equating (Volume 5) May 2018 Michael J. Kolen and Won-Chan Lee, Editors

Technical Notes

Rpt# Technical Note Date Author(s)
1. Estimated Standard Error of a Mean When There are only two Observations October 2002 Robert L. Brennan
2. Some Perspectives on KR-21 March 2006 Robert L. Brennan and Won-Chan Lee
3. Chained Linear Equating June 2006 Robert L. Brennan
4. Technical Note 4 has been replaced by Research Report 50   Robert L. Brennan
 5. Regressed Score Estimates and Inconsistencies with Classical Test Theory December 2012 Robert L. Brennan
 6. Standard Errors of Measurement of the Difference in Group Mean Difficulty Levels for Items March 2013 Robert L. Brennan
 7. A Note on Sample Size for Alternative Random Groups Equating Designs January 2015 Michael J. Kolen
 8. Notes about Partial Derivatives for Analytic Standard Errors of Levin-observed Equating with an External Anchor November 2015 Hyung Jin Kim and Robert L. Brennan