All Downloads

Tools and Packets

The Item Development Process

Expertise

Fairness

Feedback

Item Alignment Examination

About RTD

Assessment Explanations

RTD Papers

Whitcomb, D. & Hoffman, A. (2025). RTD Tasks Models Impact on Dynamics Between Item Contributors. Paper presented at the annual meeting of the National Council on Measurement in Education, Denver, Colorado.

Wine, M., Glore, C. & Hoffman, A. (2025). Content and Cognition Traits of High Quality Valid Items. Paper presented at the annual meeting of the National Council on Measurement in Education, Denver, Colorado.

Wine, M. & Hoffman, A. (2025). Item Alignment: Understanding the Quality of the Evidence that Items Elicit [White paper]. The Rigorous Test Development Project. HYPERLINK "http://dx.doi.org/10.13140/RG.2.2.34771.49443"http://dx.doi.org/10.13140/RG.2.2.34771.49443

Wine, M. & Hoffman, A. (2025). RTD Task Models: Addressing Item Development Challenges Through Organizational Learning. Paper presented at the annual meeting of the National Council on Measurement in Education, Denver, Colorado.

Wine, M. & Hoffman, A. (2025). Using Rigorous Test Development to Address Two Major Obstacles to Developing Valid Items. Paper presented at the annual meeting of the National Council on Measurement in Education, Denver, Colorado.

Hoffman, A., Glore, C., Harrison, D. & Wine, M. (2024). Recognizing the Strengths of Classroom Assessment: What a Principled Large Scale Content Development Practice Has to Offer to Classroom Assessment. 2024 NCME Special Conference on Classroom Assessment, Chicago, Illinois. HYPERLINK "https://www.researchgate.net/publication/384065928_Recognizing_the_Strengths_of_Classroom_Assessment_What_a_Principled_Large_Scale_Content_Development_Practice_Has_to_Offer_to_Classroom_Assessment"https://www.researchgate.net/publication/384065928_Recognizing_the_Strengths_of_Classroom_Assessment_What_a_Principled_Large_Scale_Content_Development_Practice_Has_to_Offer_to_Classroom_Assessment

Wine, M. & Hoffman, A. (2024). Commentary: What is the Breadth of “Educational Measurement?” Educational Measurement: Issues and Practices, 43(3), 23-26. HYPERLINK "https://doi.org/10.1111/emip.12627"https://doi.org/10.1111/emip.12627

Wine, M. & Hoffman, A. (2024). Item Logic [White paper]. The Rigorous Test Development Project. HYPERLINK "http://dx.doi.org/10.13140/RG.2.2.17671.41126"http://dx.doi.org/10.13140/RG.2.2.17671.41126

Wine, M. & Hoffman, A. (2024). Rigorous Test Development: The New Core Principles and the Pillar Practices. Annual meeting of the American Educational Research Association, Philadelphia, Pennsylvania.

Wine, M. & Hoffman, A. (2023). Reinvigorating Webb’s Depth of Knowledge in Three Content Areas. Annual meeting of the National Council on Measurement in Education, Chicago, Illinois.

Wine, M., & Hoffman, A. M. (2023). Reinforcing Webb’s Depth of Knowledge: Laterally Extending DOK by Acknowledging Proficiency’s Impact on Cognitive Demand. Annual meeting of the American Educational Research Association, Chicago, Illinois.

Wine, M., & Hoffman, A. (2022). A CDP's Very Practical Framework for Thinking about Sensitivity Issues [White paper]. The Rigorous Test Development Project.

Wine, M. & Hoffman, A. (2022). Principles for unpacking standards (for the purpose of assessment) [White paper]. Rigorous Test Development Project. HYPERLINK "http://dx.doi.org/10.13140/RG.2.2.27352.51209"http://dx.doi.org/10.13140/RG.2.2.27352.51209

Wine, M., & Hoffman, A. (2022). RTD Alignment Scale [White paper]. The Rigorous Test Development Project.

Wine, M., & Hoffman, A. (2022). RTD Approach to Using Norman Webb’s Depth of Knowledge (DOK) Typology of Cognitive Complexity [White paper]. Rigorous Test Development Project..

Wine, M., & Hoffman, A. (2022). RTD Approach to Using Norman Webb’s Depth of Knowledge (DOK) Typology of Cognitive Complexity [White paper]. The Rigorous Test Development Project.

Wine, M., & Hoffman, A. (2022). RTD Initial Guide to Fairness in Item Development [White paper]. The Rigorous Test Development Project.

Wine, M., & Hoffman, A. (2022). RTD Item Alignment Examination Annotated Procedure [White paper]. The Rigorous Test Development Project.

Wine, M., & Hoffman, A. (2022). RTD True Mastery Typology [White paper]. The Rigorous Test Development Project. HYPERLINK "http://dx.doi.org/10.13140/RG.2.2.21410.44488"http://dx.doi.org/10.13140/RG.2.2.21410.44488

Wine, M., & Hoffman, A. (2022). What is RTD's Radical Empathy [White paper]. The Rigorous Test Development Project. HYPERLINK "http://dx.doi.org/10.13140/RG.2.2.14077.37601"http://dx.doi.org/10.13140/RG.2.2.14077.37601

Wine, M., & Hoffman, A. (2021). Item Hygiene [White paper]. The Rigorous Test Development Project. HYPERLINK "http://dx.doi.org/10.13140/RG.2.2.35706.16323"http://dx.doi.org/10.13140/RG.2.2.35706.16323

Wine, M., & Hoffman, A. (2021). Rigorous Item Feedback [White paper]. The Rigorous Test Development Project. HYPERLINK "http://dx.doi.org/10.13140/RG.2.2.30170.82889"http://dx.doi.org/10.13140/RG.2.2.30170.82889

Wine, M. & Hoffman, A. (2021). The Three Kinds of Expertise Necessary to Create Valid Standardized Test Items [White Paper]. Rigorous Test Development Project. HYPERLINK "http://dx.doi.org/10.13140/RG.2.2.18055.00160"http://dx.doi.org/10.13140/RG.2.2.18055.00160

Hoffman, A. & Wine, M. (2017). The Rigorous Test Development Project: Internal Methodology [White paper]. Rigorous Test Development Project. HYPERLINK "http://dx.doi.org/10.13140/RG.2.2.13125.46563"http://dx.doi.org/10.13140/RG.2.2.13125.46563

Hoffman, A. (2016). Active Accountees: Understanding How School Leaders Mediate and Respond to Multiple Accountabilities. Annual meeting of the American Educational Research Association, Washington, District of Columbia.

Hoffman, A. (2016). Ethics and the Elite Competitive High School Student. Annual meeting of the Northeast Educational Research Association, Trumbull, Connecticut.

Hoffman, A. & Wine, M. (2015). Fairness in Item Development: Addressing Fairness Through the Test Production Phase. Annual meeting of the Northeast Educational Research Association, Trumbull, Connecticut.

Hoffman, A. (2015). Raising the Bar: “Leveling Up” in Rockville Centre. In M. Gephart and V. Marsick, How Organizations Leverage Learning to Meet Strategic Objectives. Maryland Heights, MO: Butterworth-Heinemann.

Hoffman, A. (2015). Unpacking “Everyone”: The Assemblage of Accountors to Whom Principals are Accountable. Annual meeting of the American Educational Research Association, Chicago, Illinois.

Hoffman, A. (2014). Multiple Accountability Theory: Eight Paradigms of Accountability in Education. Annual convention of the University Council for Educational Administration, Washington, District of Columbia.

Hoffman, A. & Wine, M. (2014). Rigorous Test Development Introduction: The Core Principles. Annual meeting of the Northeast Educational Research Association, Trumbull, Connecticut.

Hoffman, A. (2013). Unpacking “Everything”: The Array of Accountances for Which Principals Are Accountable. Paper presented at the annual convention of the University Council for Educational Administration, Indianapolis, Indiana.

Hoffman, A. & Wine, M. (2013). Innovations in Validity Assurance and the 2014 GED Test. Paper presented at the annual meeting of the Northeast Educational Research Association, Rocky Hill, Connecticut.

Hoffman, A., Wine, M. & McKinney, J. (2013). A GED Test for a Common Core World: Understanding the Changes Coming in 2014. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, California.