Robert L. Brennan

Robert L. Brennan

Director, CASMA
210D Lindquist Center
Psychological and Quantitative Foundations
Iowa City, IA 52242
robert-brennan@uiowa.edu
319-335-5405 (phone)
319-384-0505 (fax)

Academic History

  • Ed.D. in Measurement and Statistics, Harvard Graduate School of Education, 1970
  • M.A.T. in Mathematics, Harvard Graduate School of Education, 1968
  • B.A. in Mathematics, State College at Salem, 1967

Research Interests

  • Generalizability theory
  • Equating, Linking, and Scaling
  • Classical test theory
  • Relationships among measurement models
  • Policy issues in educational testing
  • Standard Setting
  • Performance assessment
  • Context effects
  • Domain-referenced and criterion-referenced interpretations of scores

Teaching Interests

  • Generalizability theory
  • Equating, linking, and scaling
  • Classical test theory

Professional Experience

  • Director, Center for Advanced Studies in Measurement and Assessment, College of Education, University of Iowa
  • Distinguished Professor, University of Iowa
  • E. F. Lindquist Chair in Measurement and Testing, College of Education, Psychological and Quantitative Foundations, University of Iowa
  • Director, Iowa Testing Programs, College of Education, University of Iowa
  • Distinguished Research Scientist, American College Testing, Research Division, Iowa City, IA
  • Adjunct Assistant Professor, College of Education, Psychological and Quantitative Foundations, University of Iowa
  • Assistant Vice President, Measurement Research, American College Testing, Research Division, Iowa City, IA
  • Founding Director, Measurement Research Department, American College Testing, Research Division, Iowa City, IA
  • Senior Research Psychologist, American College Testing, Research Division, Iowa City, IA
  • Assistant Professor, Department of Education, SUNY-Stony Brook
  • Acting Director, Harvard Graduate School of Education Computer-Aided Instruction Laboratory

Professional Service

  • Manuscript Reviewer, Ad hoc reviewer for: Psychometrika Journal of Educational Measurement, Review of Educational Research, Applied Psychological Measurement, American Educational Research Journal, Psychological Bulletin, Journal of Applied Psychology, Educational and Psychological Measurement, Journal of Educational Statistics, Educational Measurement: Issues and Practice, Journal of Educational Psychology, Psychological Methods, TOEFL Research Report, International Journal of Testing.
  • Professional Board, Member of Editorial Board of National Council on Measurement in Education (NCME) Book Series, 2011–current.
  • Professional Board, Member of the Journal Advisory Board, Applied Measurement in Education, 2001–current.
  • Professional Board, Member of the Journal Advisory Board, Journal of Educational Measurement, 1995–current.
  • Professional Board, Member, Iowa Measurement Research Foundation, 1994–current.
  • Professional Board, Member of the Journal Advisory Board, Applied Psychological Measurement, 1982–current.
  • Workshop, Co-director of AERA, NCME, APA and ATP pre-sesssion/workshops on "Test Equating Methods and Practices" 1988, 1990, 1992, 1994, 1995, 1996, 1998, 2000, 2002, 2004, 2006, 2007, 2008, 2010, 2012.
  • Workshop, Co-director of CASMA Equating Workshop, 2008, 2009, 2011.
  • Workshop, Director of AERA and NCME pre-seesions on "Generalizability Theory and Applications" 1978, 1983, 1985, 1987, 1989, 1991, 1993, 1995, 1997, 1999, 2001, 2003, 2005, 2007, 2009, 2011.
  • Committee Assignment, Nominating Committee member, American Educational Research Association (Division D), 2010–2011.
  • Other, CASMA - ACT Conference on Current Challenges in Educational Measurement, 2003, 2005, 2007, 2010.

Professional Activities and Membership

  • American Educational Research Association, Divisions B, C, D, and I
  • American Psychological Association, Divisions 5 and 15
  • American Statistical Association
  • International Test Commission
  • Iowa Academy of Education
  • Iowa Educational Research and Evaluation Association
  • Iowa Measurement Research Foundation
  • Midwestern Educational Research Association
  • National Council on Measurement in Education
  • Psychometric Society

Awards and Professional Recognition

  • Featured in "Great Careers in Testing"
  • Career Achievement Award, Association of Test Publishers
  • Inaugural Fellow of American Educational Research Association (AERA)
  • AERA/ACT E. F. Lindquist Award for Outstanding Achievement in Applied or Theoretical Research in the Field of Testing and Measurement
  • NCME Award for Career Contributions to Educational Measurement
  • NCME Award for Outstanding Technical Contribution to the Field Educational Measurement
  • Charter membe, Iowa Academy of Education
  • Distinguished Professor, University of Iowa
  • Fellow, Division 5 of American Psychological Association,

Selected Publications

Journal Articles

  • Tavakol, M., & Brennan, R. L. Medical education assessment: A brief overview of concepts in generalizability theory. International Journal of Medical Education, 4, 221-222.
  • Brennan, R. L. (2011). Generalizability theory and classical test theory. Applied Measurement in Education, 24, 1-21.
  • Brennan, R. L. (2010). Evidence-centered assessment design and the Advanced Placement Program: A Psychometrician's Perspective. Applied Measurement in Education, 23, 392-400.
  • Brennan, R. L. (2010). Assumptions about true scores and populations in equating. Measurement: Interdisciplinary Research and Perspectives, 8, 1-3.
  • Wang, T., Lee, W., Brennan, R. L., & Kolen, M. J. (2008). A comparison of the frequency estimation and chained equipercentile methods under the common-item non-equivalent groups design. Applied Psychological Measurement, 32, 632-651.
  • Tong, Y., & Brennan, R. L. (2007). Bootstrap estimates of standard errors in generalizability theory. Educational and Psychological Measurement, 67, 804-817.
  • Lee, W., Brennan, R. L., & Kolen, M. J. (2006). Interval estimation for true raw and scale scores under the binomial error model. Journal of Educational and Behavioral Statistics, 31(261-281).
  • Lee, W., Hanson, B. H., & Brennan, R. L. (2002). Estimating consistency and accuracy indices for multiple classifications. Applied Psychological Measurement, 26, 412-432.
  • Lee, W., Brennan, R. L., & Kolen, M. J. (2000). Estimators of conditional scale-score standard errors of measurement: A simulation study. Journal of Educational Measurement, 37(1), 1-20.
  • Brennan, R. L., & Lee, W. (1999). Conditional scale-score standard errors of measurement under binomial and compound binomial assumptions. Educational and Psychological Measurement, 59, 5-24.
  • Kreiter, C. D., Brennan, R. L., & Lee, W. (1998). A generalizability study of a new standardized rating form used to evaluate students' clinical clerkship performance. Academic Medicine, 73, 1294-1298.

Books and Book Chapters

  • Kolen, M. J., Tong, Y., & Brennan, R. L. (2011). Scoring and scaling educational tests. In Davier, A. v. (Ed.) Statistical models for test equating, scaling, and linking (pp. 43-58). New York: Springer.
  • Brennan, R. L. (2010). Generalizability theory. In Peterson, P., Baker, E., & McGraw, (Eds.), International Encyclopedia of Education (pp. 61-68). NY: Springer Verlag.
  • Wan, L., Brennan, R. L., & Lee, W. (2008). Classification consistency for complex assessments. In Shigemasu, K., Okada, A., Imaizumi, T., & Hoshino, (Eds.), New trends in psychometrics (pp. 525-534).Tokyo Universal Academy Press, Inc.
  • Brennan, R. L., & Lee, W. (2008). Correcting for bias in single-administration decision consistency indexes. In Shigemasu, K., Okada, A., Imaizumi, T., & Hoshino, (Eds.), New trends in psychometrics (pp. 14-25).Tokyo Universal Academy Press, Inc.
  • Brennan, R. L. (2007). Tests in transition: discussion and synthesis. In Dorans, N., Pommerich, M., & Holland, P. (Eds.), Linking and aligning scores and scales (pp. 161-175). Springer-Verlag: New York.
  • Brennan, R. L. (Ed.) (2006). Educational measurement (4th ed.). Westport, CT. American Council on Education/Praeger.
  • Kolen, M. J., & Brennan, R. L. (2004). Test equating, scaling, and linking: Methods and practices (2nd ed.). New York. Springer-Verlag.
  • Brennan, R. L. (2001). Generalizability theory. New York. Springer-Verlag.
  • Nichols, P. D., Chipman, S. F., & Brennan, R. L. (1995). Cognitively diagnostic assessment. Hillsdale, NJ. Erlbaum.
  • Kolen, M. J., & Brennan, R. L. (1995). Test equating methods and practices. New York. Springer-Verlag.
  • Brennan, R. L. (1992). Elements of generalizability theory (rev. ed). Iowa City, IA. American College Testing.
  • Brennan, R. L. (1983). Elements of generalizability theory. Iowa City, IA. American College Testing.

Other Work


Selected Presentations

  • Brennan, R. L. (2013, December). Some milestones in the history of educational measurement. . Speech given at the Invited presentation at a conference on Testing Then and Now: Building on a Legacy in Educational Measurement, Assessment and Evaluation, New York, NY.
  • LaFond, L., Brennan, R. L., & Ansley, T. N. (2013, April). A Multivariate Generalizability Study of the Iowa Algebra Readiness Assessment. Paper presented at the Annual Meeting of the National Council on Measurement in Education, San Francisco, CA.
  • Brennan, R. L. (2013, April). An Investigation of Mixed-format Tests Using Multivariate Generalizability Theory. Presented at the Presentation at the Annual Meeting of the National Council on Measurement in Education, Philadelphia.
  • Brennan, R. L. (2013, April). Contributions of Everett F. Lindquist . Presented at the Presentation in a Symposium entitled "A Look at Our Psychometric History" , Philadelphia.
  • Brennan, R. L. (2013, April). A Comparability Perspective. . Presented at the Presentation in a Symposium entitled "Consortia Research Agendae", Philadelphia.
  • Brennan, R. L. (2012, May 3). Scaling PARCC Assessments: Some Considerations and a Synthetic Data Example. Paper presented at the PARCC TAC, Washington, DC.
  • Brennan, R. L. (2012, April). Applying the Testlet Response Theory to the Random Facet px(i:c) Design of Generalizability Theory. Presented at the Annual Meeting of the National Council on Measurement in Education, Vancouver.
  • Gao, X., Guo, F., & Brennan, R. L. (2012, April). Modeling Measurement Facets and Assessing Generalizability of the GMAT Analytical Writing Assessment. Presented at the Annual Meeting of the National Council on Measurement in Education, Vancouver.
  • Kim, J. A., Banks, K., & Brennan, R. L. (2012, April). The Effect of Linguistic Complexity on Math Word Problem Solving Tests: Multigroup Generalizability Analyses. Presented at the Annual Meeting of the National Council on Measurement in Education, Vancoucer.
  • Kolen, M. J., & Brennan, R. L. (2012, April 13). Test Equating Methods and Practices. Workshop lead at the Annual Meeting of the National Council on Measurement in Education, Vancouver, BC.
  • Brennan, R. L. (2011, October). Utility Indexes for Decisions about Subscores. Presented at the Presentation to the Iowa Academy of Education, Iowa City, IA.
  • Brennan, R. L. (2011, April). Comments on Standards: Introduction, Validity and Reliability Chapters. Presented at the Annual Meeting of the National Council on Measurement in Education, New Orleans.
  • Brennan, R. L. (2011, April). Discussant for invited symposium on: Will Common Core State Standards and Assessment Consortia Ensure Comparability of Assessment Results Across Students, Schools, Districts, and States? Presented at the Annual Meeting of the National Council on Measurement in Education, New Orleans.
  • Brennan, R. L. (2011, April). Lee J. Cronbach: Contributions to Measurement. Presented at the Annual Meeting of the National Council on Measurement in Education, New Orleans.
  • Brennan, R. L. (2011, February). Impact of Common-Core State Standards (CCSS) and Assessments on Testing Organizations. Presented at the Annual Meeting of the Association of Test Publishers, Phoenix, AZ.
  • Brennan, R. L. (2010, July). Measurement and its Models: Consistencies and Inconsistencies. Keynote Address given at the National Institute for Testing and Evaluation, Jerusalem, Israel.
  • Brennan, R. L. (2010, June). First-order and second-order equity in equating. Paper presented at the Annual Meeting of the Psychometric Society, Athens, GA.
  • Lee, E., Lee, W., & Brennan, R. L. (2010, April). Assessing equating results based on equity properties. Paper presented at the Annual Meeting of the National Council on Measurement in Education, Denver.
  • Hagge, S., Seol, J., Liu, C., & Brennan, R. L. (2009, April). Group invariance: Examining the adequacy of linear linking methods for small samples. Paper presented at the Annual Meeting of the National Council on Measurement in Education, San Diego, CA.
  • Powers, S., & Brennan, R. L. (2009, April). Multivariate generalizability analyses of mixed-format exams. Paper presented at the Annual Meeting of the National Council on Measurement in Education, San Diego, CA.
  • Wang, T., Lee, W., Brennan, R. L., & Kolen, M. J. (2006, April). A comparison of the frequency estimation and chained equipercentile methods under the common-item non-equivalent groups design. Paper presented at the Annual Meeting of the National Council on Measurement, San Francisco.