Research Reports

  Research Report   Date   Author(s)
1. Coefficients and Indices in Generalizability Theory   August 2003   Robert L. Brennan
2. Institutional Selectivity and Good Practices in Undergraduate Education: How Strong is the Link?   April 2004   Ernest T. Pascarella, Ty Cruce, Paul D. Umbach, Gergory C. Wolniak, George D. Kuh, Robert M Carini, John C, Hayek, Robert M. Gonyea, and Chun-Mei Zhao
3. LEGS Manual   January 2004   Robert L. Brennan
4. A Multivariate Generalizability Analysis of the Multistate Bar Exam   January 2004   Ping Yin
5. Bootstrap Procedures for Estimating Standard Errors of Estimated Variance Components for Two-Facet Designs   February 2004   Ye Tong and Robert L. Brennan
6. Revolutions and Evolutions in Current Educational Testing   May 2004   Robert L. Brennan
7. The Bootstrap Procedure for Estimating Decision Consistency for Single-Administration Complex Assessments   June 2004    Robert L. Brennan and Lei Wan
8. Some Perspectives on Inconsistencies Among Measurement Models   July 2004   Robert L. Brennan
9. Manual for BB-CLASS: A Computer Program that uses the Beta-Binomial Model for Classification Consistency and Accuracy   December 2004   Robert L. Brennan
10. A Multinomial Error Model for Tests with Polytomous Items   January 2005   Won-Chan Lee
11. An Alternative Continuization Method to the Kernel Method in von Davier, Holland and Thayer's (2004) Test Equating Framework   July 2007   Tianyou Wang
12. Some Test Theory for the Reliability of Individual Profiles - under revision        
13. Classification Consistency and Accuracy Under the Compound Multinomial Model   Revised April 2008   Won-Chan Lee
14. Standard Errors of Equating for Equipercentile Equating with Log-Linear Pre-Smoothing using the Delta Method   March 2006   Tianyou Wang
15. Bootstrap Techniques for Estimating Variability in Generalizability Theory   March 2006   Ye Tong and Robert L. Brennan
16. A Strong True-Score Model for Polytomous Items   April 2006   Won-Chan Lee, Tianyou Wang, Seonghoon Kim, and Robert L. Brennan
17. A Comparison of the Frequency Estimation and Chained Equipercentile Methods Under the Common-Item Non-Equivalent Groups Design   April 2006   Tianyou Wang, Won-Chan Lee, Robert L. Brennan, and Michael J. Kolen
18. Correcting for Bias in Single-Administration Decision Consistency Indexes   July 2006   Robert L. Brennan and Won-Chan Lee
19. A Modified Frequency Estimation Equating Method for the Common-Item Non-Equivalent Groups Design   August 2006   Tianyou Wang and Robert L. Brennan
20. A Model for the Joint Distribution of Item Response and Response Time using a One-Parameter Weibull Distribution   April 2006   Tianyou Wang
21. Unbiased Estimates of Variance Components with Bootstrap Procedures: Detailed Result   November 2006   Robert L. Brennan
22. Estimating Classification Consistency for Complex Assessments   January 2007   Lei Wan, Robert L. Brennan, and Won-Chan Lee
23. Comparison of Three IRT Linking Procedures in the Random Groups Equating Design   February 2007   Won-Chan Lee and Jae-Chun Ban
24. Defining a Score Scale in Relation to Measurement Error for Mixed Format Tests   February 2007   Jae-Chun Ban and Won-Chan Lee
25. A Multi-group Generalizability Analysis of a Large-scale Reading Comprehension Test   August 2007   Dongmei Li and Robert L. Brennan
26. Assessing IRT Model-Data Fit for Mixed Format Tests   November 2007   Kyong Hee Chon, Won-Chan Lee, and Timothy N. Ansley
27. Classification Consistency and Accuracy for Complex Assessments Using Item Response Theory   April 2008   Won-Chan Lee
28. The Effect of Different Factors on Group Invariance in a Concordance Context with a Single Group Design   February 2009   Nooree Huh and Won-Chan Lee
29. Multivariate Generalizability Analyses of Mixed-Format Exams   November 2009   Sonya Powers and Robert L. Brennan
30. First-order and Second-order Equity in Equating   August 2010   Robert L. Brennan
31. Assessing Equating Results Based on First-order and Second-order Equity   December 2010   Eunjung Lee, Won-Chan Lee, and Robert L. Brennan
32. Measurement Error Variability for Advanced Placement (AP) Composite Scores and Grades   January 2011   Benjamin J. Andrews, Michael J. Kolen, and Won-Chan Lee
33. Utility Indexes for Decisions about Subscores   Revised December 2012   Robert L. Brennan
34. A Multivariate Generalizability Analysis of Portfolio Assessments in Dental Education    April 2013    Robert L. Brennan
35. Hierarchical Cognitive Diagnostic Analysis for TIMSS 2003 Mathematics   August 2013    Yu-Lan Su, Kyong Mi Choi, Won-Chan Lee, Taehoon Choi, and Melissa McAninch
36. Factors Affecting Accuracy of Comparable Scores for Augmented Tests under Common Core State Standards    August 2013   Ja Young Kim, Won-Chan Lee, Deborah J. Harris
37. Effects of the Number of Common Items on Equating Precision and Estimates of the Lower Bound to the Number of Common Items Needed   August 2013    Mengyao Zhang and Michael J. Kolen
38. Hierarchical Cognitive Diagnostic Analysis: Simulation Study   December 2013   Yu-Lan Su, Won-Chan Lee, Kyong Mi Choi
39. Evaluation of Comparability of Scores and Passing Decisions for Different Item Pools of Computerized Adaptive Examinations   November 2014   Wei Wang, Shichao Wang, Michael J. Kolen,
Won-Chan Lee, Jaime L. Peterson,
Mengyao Zhang, and Seohong Pak
40. Equating Multidimensional Tests under a Random Groups Design: A Comparison of Various Equating Procedures   November 2014   Eunjung Lee, Won-Chan Lee, Robert L. Brennan
41. A Comparative Study of Item Response Theory Item Calibration Methods for the Two Parameter Logistic Model   April 2015   Kyung Yong Kim and Won-Chan Lee
42. Utility Indexes for Composite Scores   Revised September 2016   Robert L. Brennan
43. Equating with Bivariate Log-linear Presmoothing under the Common-item Nonequivalent Groups Design: Structural Zeros and Their Implications   June 2015   Hyung Jin Kim, Robert L. Brennan, and Won-Chan Lee
44. Utility Indexes for Composite Scores: Matrix Formulation Including R Code and Examples   Revised August 2016   Hyung Jin Kim and Robert L. Brennan
45. Manual for ESUM-RG: Excel VBA Macros for Comparing Multiple Equating Procedures under the Random Groups Design   December 2015   Robert L. Brennan, Prasad Toke, Hyung Jin Kim, Won-Chan Lee, Kyung Yong Kim, and Euijin Lim
46. Interval Estimation Procedures for Weighted Composite Scores   April 2016   Kyung Yong Kim and Won-Chan Lee
47. Subscore Equating and Reporting   May 2016   Euijin Lim and Won-Chan Lee
48. Similarities Between Equated Equivalents Using Presmoothing and Postsmoothing   August 2016   Hyung Jin Kim, Robert L. Brennan and Won-Chan Lee
49. Multiple Group IRT Fixed-Parameter Estimation for Maintaining an Established Ability Scale   August 2016   Seonghoon Kim and Michael J. Kolen
50. Weights in Multivariate Generalizability Theory   December 2016   Robert L. Brennan
51. Using G Theory to Examine Confounded Effects: "The Problem of One"   January 2017   Robert L. Brennan
52. A Statistical Criterion to Assess Fitness of Cubic-Spline Postsmoothing   August 2017   Hyung Jin Kim, Robert L. Brennan and Won-Chan Lee
53. Generalizability Theory References: The First Sixty Years   February 2020   Robert L. Brennan and Jui-Teng Ray Liao
54. Impact of Degrees of Postsmoothing on Long-Term Equated Scale Score Accuracy   December 2020   Stella Y. Kim, YoungKoung, Kim∗ Tim Moses
55. Rater Effects and Double Scoring in IRT Proficiency Estimation   January 2021   Yoon Ah Song, Brandon LeBeau, Won-Chan Lee

Monographs

  Monograph   Date   Author(s)
1. Equating Recipes   September 2009   Robert L. Brennan, Tianyou Wang, Seonghoon Kim, and Jaehoon Seol
2.1
Mixed-Format Tests: Psychometric Properties with a Primary Focus on Equating (Volume 1)
  December 2011   Michael J. Kolen and Won-Chan Lee, Editors
2.2 Mixed-Format Tests: Psychometric Properties with a Primary Focus on Equating (Volume 2)   December 2012   Michael J. Kolen and Won-Chan Lee, Editors
2.3 Mixed Format Tests: Psychometric Properties with a Primary Focus on Equating (Volume 3)   December 2014   Michael J. Kolen and Won-Chan Lee, Editors
2.4 Mixed-Format Tests: Psychometric Properties with a Primary Focus on Equating (Volume 4)   December 2016   Michael J. Kolen and Won-Chan Lee, Editors
2.5 Mixed-Format Tests: Psychometric Properties with a Primary Focus on Equating (Volume 5)   May 2018   Michael J. Kolen and Won-Chan Lee, Editors

Technical Notes

  Technical Note Date Author(s)
1. Estimated Standard Error of a Mean When There are only two Observations October 2002 Robert L. Brennan
2. Some Perspectives on KR-21 March 2006 Robert L. Brennan and Won-Chan Lee
3. Chained Linear Equating June 2006 Robert L. Brennan
4. Technical Note 4 has been replaced by Research Report 50   Robert L. Brennan
 5. Regressed Score Estimates and Inconsistencies with Classical Test Theory December 2012 Robert L. Brennan
 6. Standard Errors of Measurement of the Difference in Group Mean Difficulty Levels for Items March 2013 Robert L. Brennan
 7. A Note on Sample Size for Alternative Random Groups Equating Designs January 2015 Michael J. Kolen
 8. Notes about Partial Derivatives for Analytic Standard Errors of Levin-observed Equating with an External Anchor November 2015 Hyung Jin Kim and Robert L. Brennan