Research Reports

Rpt# Research Report Date Author(s)
1. Coefficients and Indices in Generalizability Theory August 2003 Robert L. Brennan
2. Institutional Selectivity and Good Practices in Undergraduate Education: How Strong is the Link? April 2004 Ernest T. Pascarella, Ty Cruce, Paul D. Umbach, Gergory C. Wolniak, George D. Kuh, Robert M Carini, John C, Hayek, Robert M. Gonyea, and Chun-Mei Zhao
3. LEGS Manual January 2004 Robert L. Brennan
4. A Multivariate Generalizability Analysis of the Multistate Bar Exam January 2004 Ping Yin
5. Bootstrap Procedures for Estimating Standard Errors of Estimated Variance Components for Two-Facet Designs February 2004 Ye Tong and Robert L. Brennan
6. Revolutions and Evolutions in Current Educational Testing May 2004 Robert L. Brennan
7. The Bootstrap Procedure for Estimating Decision Consistency for Single-Administration Complex Assessments June 2004  Robert L. Brennan and Lei Wan
8. Some Perspectives on Inconsistencies Among Measurement Models July 2004 Robert L. Brennan
9. Manual for BB-CLASS: A Computer Program that uses the Beta-Binomial Model for Classification Consistency and Accuracy December 2004 Robert L. Brennan
10. A Multinomial Error Model for Tests with Polytomous Items January 2005 Won-Chan Lee
11. An Alternative Continuization Method to the Kernel Method in von Davier, Holland and Thayer's (2004) Test Equating Framework July 2007 Tianyou Wang
12. Some Test Theory for the Reliability of Individual Profiles - under revision    
13. Classification Consistency and Accuracy Under the Compound Multinomial Model Revised April 2008 Won-Chan Lee
14. Standard Errors of Equating for Equipercentile Equating with Log-Linear Pre-Smoothing using the Delta Method March 2006 Tianyou Wang
15. Bootstrap Techniques for Estimating Variability in Generalizability Theory March 2006 Ye Tong and Robert L. Brennan
16. A Strong True-Score Model for Polytomous Items April 2006 Won-Chan Lee, Tianyou Wang, Seonghoon Kim, and Robert L. Brennan
17. A Comparison of the Frequency Estimation and Chained Equipercentile Methods Under the Common-Item Non-Equivalent Groups Design April 2006 Tianyou Wang, Won-Chan Lee, Robert L. Brennan, and Michael J. Kolen
18. Correcting for Bias in Single-Administration Decision Consistency Indexes July 2006 Robert L. Brennan and Won-Chan Lee
19. A Modified Frequency Estimation Equating Method for the Common-Item Non-Equivalent Groups Design August 2006 Tianyou Wang and Robert L. Brennan
20. A Model for the Joint Distribution of Item Response and Response Time using a One-Parameter Weibull Distribution April 2006 Tianyou Wang
21. Unbiased Estimates of Variance Components with Bootstrap Procedures: Detailed Result November 2006 Robert L. Brennan
22. Estimating Classification Consistency for Complex Assessments January 2007 Lei Wan, Robert L. Brennan, and Won-Chan Lee
23. Comparison of Three IRT Linking Procedures in the Random Groups Equating Design February 2007 Won-Chan Lee and Jae-Chun Ban
24. Defining a Score Scale in Relation to Measurement Error for Mixed Format Tests February 2007 Jae-Chun Ban and Won-Chan Lee
25. A Multi-group Generalizability Analysis of a Large-scale Reading Comprehension Test August 2007 Dongmei Li and Robert L. Brennan
26. Assessing IRT Model-Data Fit for Mixed Format Tests November 2007 Kyong Hee Chon, Won-Chan Lee, and Timothy N. Ansley
27. Classification Consistency and Accuracy for Complex Assessments Using Item Response Theory April 2008 Won-Chan Lee
28. The Effect of Different Factors on Group Invariance in a Concordance Context with a Single Group Design February 2009 Nooree Huh and Won-Chan Lee
29. Multivariate Generalizability Analyses of Mixed-Format Exams November 2009 Sonya Powers and Robert L. Brennan
30. First-order and Second-order Equity in Equating August 2010 Robert L. Brennan
31. Assessing Equating Results Based on First-order and Second-order Equity December 2010 Eunjung Lee, Won-Chan Lee, and Robert L. Brennan
32. Measurement Error Variability for Advanced Placement (AP) Composite Scores and Grades January 2011 Benjamin J. Andrews, Michael J. Kolen, and Won-Chan Lee
33. Utility Indexes for Decisions about Subscores Revised December 2012 Robert L. Brennan
34. A Multivariate Generalizability Analysis of Portfolio Assessments in Dental Education  April 2013  Robert L. Brennan
35. Hierarchical Cognitive Diagnostic Analysis for TIMSS 2003 Mathematics August 2013  Yu-Lan Su, Kyong Mi Choi, Won-Chan Lee, Taehoon Choi, and Melissa McAninch
36. Factors Affecting Accuracy of Comparable Scores for Augmented Tests under Common Core State Standards  August 2013 Ja Young Kim, Won-Chan Lee, Deborah J. Harris
37. Effects of the Number of Common Items on Equating Precision and Estimates of the Lower Bound to the Number of Common Items Needed August 2013  Mengyao Zhang and Michael J. Kolen
38. Hierarchical Cognitive Diagnostic Analysis: Simulation Study December 2013 Yu-Lan Su, Won-Chan Lee, Kyong Mi Choi
39. Evaluation of Comparability of Scores and Passing Decisions for Different Item Pools of Computerized Adaptive Examinations November 2014 Wei Wang, Shichao Wang, Michael J. Kolen,
Won-Chan Lee, Jaime L. Peterson,
Mengyao Zhang, and Seohong Pak
40. Equating Multidimensional Tests under a Random Groups Design: A Comparison of Various Equating Procedures November 2014 Eunjung Lee, Won-Chan Lee, Robert L. Brennan
41. A Comparative Study of Item Response Theory Item Calibration Methods for the Two Parameter Logistic Model April 2015 Kyung Yong Kim and Won-Chan Lee
42. Utility Indexes for Composite Scores Revised September 2016 Robert L. Brennan
43. Equating with Bivariate Log-linear Presmoothing under the Common-item Nonequivalent Groups Design: Structural Zeros and Their Implications June 2015 Hyung Jin Kim, Robert L. Brennan, and Won-Chan Lee
44. Utility Indexes for Composite Scores: Matrix Formulation Including R Code and Examples Revised August 2016 Hyung Jin Kim and Robert L. Brennan
45. Manual for ESUM-RG: Excel VBA Macros for Comparing Multiple Equating Procedures under the Random Groups Design December 2015 Robert L. Brennan, Prasad Toke, Hyung Jin Kim, Won-Chan Lee, Kyung Yong Kim, and Euijin Lim
46. Interval Estimation Procedures for Weighted Composite Scores April 2016 Kyung Yong Kim and Won-Chan Lee
47. Subscore Equating and Reporting May 2016 Euijin Lim and Won-Chan Lee
48. Similarities Between Equated Equivalents Using Presmoothing and Postsmoothing August 2016 Hyung Jin Kim, Robert L. Brennan and Won-Chan Lee
49. Multiple Group IRT Fixed-Parameter Estimation for Maintaining an Established Ability Scale August 2016 Seonghoon Kim and Michael J. Kolen
50. Weights in Multivariate Generalizability Theory December 2016 Robert L. Brennan
51. Using G Theory to Examine Confounded Effects: "The Problem of One" January 2017 Robert L. Brennan
52. A Statistical Criterion to Assess Fitness of Cubic-Spline Postsmoothing August 2017 Hyung Jin Kim, Robert L. Brennan and Won-Chan Lee
53. Generalizability Theory References: The First Sixty Years February 2020 Robert L. Brennan and Jui-Teng Ray Liao
54. Impact of Degrees of Postsmoothing on Long-Term Equated Scale Score Accuracy December 2020 Stella Y. Kim, YoungKoung, Kim∗ Tim Moses
55. Rater Effects and Double Scoring in IRT Proficiency Estimation January 2021 Yoon Ah Song, Brandon LeBeau, Won-Chan Lee
56. Illustration of Factors Affecting Performance of the S − X2 Item-Fit Index June 2023 Hyung Jin Kim, Won-Chan Lee

Monographs

Rpt# Monograph Date Author(s)
1. Equating Recipes September 2009 Robert L. Brennan, Tianyou Wang, Seonghoon Kim, and Jaehoon Seol
2.1
Mixed-Format Tests: Psychometric Properties with a Primary Focus on Equating (Volume 1)
December 2011 Michael J. Kolen and Won-Chan Lee, Editors
2.2 Mixed-Format Tests: Psychometric Properties with a Primary Focus on Equating (Volume 2) December 2012 Michael J. Kolen and Won-Chan Lee, Editors
2.3 Mixed Format Tests: Psychometric Properties with a Primary Focus on Equating (Volume 3) December 2014 Michael J. Kolen and Won-Chan Lee, Editors
2.4 Mixed-Format Tests: Psychometric Properties with a Primary Focus on Equating (Volume 4) December 2016 Michael J. Kolen and Won-Chan Lee, Editors
2.5 Mixed-Format Tests: Psychometric Properties with a Primary Focus on Equating (Volume 5) May 2018 Michael J. Kolen and Won-Chan Lee, Editors

Technical Notes

Rpt# Technical Note Date Author(s)
1. Estimated Standard Error of a Mean When There are only two Observations October 2002 Robert L. Brennan
2. Some Perspectives on KR-21 March 2006 Robert L. Brennan and Won-Chan Lee
3. Chained Linear Equating June 2006 Robert L. Brennan
4. Technical Note 4 has been replaced by Research Report 50   Robert L. Brennan
 5. Regressed Score Estimates and Inconsistencies with Classical Test Theory December 2012 Robert L. Brennan
 6. Standard Errors of Measurement of the Difference in Group Mean Difficulty Levels for Items March 2013 Robert L. Brennan
 7. A Note on Sample Size for Alternative Random Groups Equating Designs January 2015 Michael J. Kolen
 8. Notes about Partial Derivatives for Analytic Standard Errors of Levin-observed Equating with an External Anchor November 2015 Hyung Jin Kim and Robert L. Brennan