"None of the Above" - Pressing the Boundaries of Measuring Knowledge and Searching for the Secrets to Measuring Performance

I.C.E. Exchange Program Description: Credentialing organizations are reasonably confident they can design examinations to evaluate knowledge and skills. Nevertheless, the employers, clients, customers, and patients of professionals certified by I.C.E. members also care about how well credential holders maintain and apply their knowledge and skills in practice. That is why I.C.E.’s Public Member Committee has once again assembled an expert panel to talk about the evolving science of performance assessment.

A public member moderator will ask four experts to draw on their own experience and knowledge of case studies in a debate about the pros and cons of various approaches and methodologies designed to assess the actual delivery of services.

Often referred to as soft or non-cognitive, skills such as communication, situational judgment, and cultural competence present their own measurement challenges. Can methods used to assess these skills in academic or employment settings be practically applied and scaled to a national credential? Or do conventional psychometric principles and assumptions have to be reconceptualized?

What exactly do alternative assessment formats (e.g., oral exams, objective structured clinical exams (OSCEs)) evaluate, and how effectively? Can the complexities of scoring and grading be overcome using AI or other emerging technologies? How practical and reliable are 360 reviews and customer surveys? Is it useful and feasible to review the electronic health records maintained by healthcare practitioners? What would be the potential rewards and challenges of incorporating simulation (e.g., screen-based) to track patient management throughout a clinical scenario or plan of care? Has there been any success measuring ethical judgment and professionalism?

Explore these and other topics in depth, posing questions and share your experiences.

Thank you PSI for Sponsoring our Credentialing Innovations Track.