Mastering the Art of Standard Setting: Strategies for Success in Credentialing

I.C.E. Exchange Program Description: As the challenges of pass rates following the COVID-19 pandemic diminish, the spotlight on the intricate standard-setting process within the test development lifecycle remains illuminating. Hambleton's characterization of standard setting as "the most controversial problem in educational assessment today" may have waned, yet the multifaceted nature of this process persists, entwining political, educational, and social considerations alongside psychometric practices.

This session explores the critical facets unearthed by recent cut score and passing rate challenges, particularly concerning methodological selection and adaptation, comprehensive training, facilitation, and security protocols. We will explore the nuances of various Angoff modifications to enhance panel consistency and deliberations, alongside the judicious employment of compromise methods and the circumstances necessitating alternative approaches. Emphasis will also be placed on the imperative of rigorous training and the exigency for meticulous specification in delineating the performance standards for defining minimally qualified or competent candidates.

Moreover, we will dissect the inherent security concerns inherent in the standard-setting process, created by the heightened exposure of a larger item pool to the panel, and proffer strategies for mitigating these risks. Drawing upon illustrative examples of best practices and case studies from diverse standard-setting endeavors, as well as technologies that can be used to assist in the process, participants will be equipped with newfound insights into the pivotal aspects of this process, primed for implementation within their respective organizations.

By providing a comprehensive exploration of the intricacies of standard setting, coupled with actionable strategies gleaned from real-world scenarios, this session aims to empower participants with a nuanced understanding of the significance of these facets. Attendees will depart with a renewed appreciation for the complexities inherent in standard setting, armed with practical insights to navigate and optimize this pivotal aspect of the test development lifecycle effectively.

Thank you Excelsoft for Sponsoring our Test Development and Administration Track.