Re-Engineering the NAPLEX: From Semi-CAT to Pallet Assembly

Re-Engineering the NAPLEX: From Semi-CAT to Pallet Assembly

Re-Engineering the NAPLEX: From Semi-CAT to Pallet Assembly Paul Jones, Jennifer Davis, and Maria Incrocci National Association of Boards of Pharmacy NABP Adaptive: stand-alone items

Random: clinical case scenarios 150-item Semi-CAT North American Pharmacist Licensure Examination (NAPLEX) NABP

CPLEX automated test assembly (ATA) . . . . . 200-item Pallet Assembly

NAPLEX NABP Measurement precision Item pool utilization Why Pallet Assembly

(PA)? Content compliance In-house production pipeline NABP

D es ig n Mi le st on es 2010 2011

2014 2015 2016 Begin PA NAPLEX project Show that PA is good for NAPLEX Make the PA NAPLEX longer Adjust to a change in specs Decide on a final configuration Launch

NABP 2011 Pallet Assembly Is Good for NAPLEX: Standard Error Semi-CAT (computerized adaptive testing) NAPLEX 150 vs PA NAPLEX 150 2011 Pallet Assembly Is Good for NAPLEX: Classification Accuracy Semi-CAT NAPLEX 150 vs PA NAPLEX 150 Semi-CAT NAPLEX 150 kappa = 0.782

PA NAPLEX 150 kappa = 0.805 2011 Pallet Assembly Is Good for NAPLEX: Item Exposure PA NAPLEX 150 Semi-CAT NAPLEX 150 2011 Pallet Assembly Is Good for NAPLEX: Item Exposure PA NAPLEX 150

Semi-CAT NAPLEX 150 Highly Overused Items 2014 Making the PA NAPLEX Longer PA NAPLEX 200 Deep PA NAPLEX 200 Wide 2014 Making the PA NAPLEX Longer PA NAPLEX 200 Deep

PA NAPLEX 200 Wide PA NAPLEX 200 Deep kappa = 0.819 PA NAPLEX 200 Wide kappa = 0.810 2014 Making the PA NAPLEX Longer Standard Error of the Mean (SEM): PA NAPLEX 200 Wide vs NAPLEX Candidate Distribution 3.00%

2.50% 2.00% 1.50% 1.00% 0.50% 0.00% 2015: Adjusting to Changes

Practice analysis Blueprint change Standard setting Cut increased Bank shallower in some areas

Y targets need adjustment NABP 2015 Adjusting to a Change in Specs Pre-2015 Semi-CAT NAPLEX 150 2015 Semi-CAT NAPLEX 150 2015 Adjusting to a Change in Specs

PA NAPLEX 200 Gold Standard 2015 Semi-CAT NAPLEX 150 2015 Adjusting to a Change in Specs Item Use: PA NAPLEX 200 Gold Standard Highly Overused Items 2015 Adjusting to a Change in Specs PA NAPLEX 200 New Standard 2015 Semi-CAT NAPLEX 150

Still better! 2015 Adjusting to a Change in Specs PA NAPLEX 200 New Standard PA NAPLEX 200 Gold Standard Highly Overused Items Assembling the available items

collection Deciding the number of clinical case scenarios 2016 Final Decisions Defining upper and lower bounds for constraints Defining acceptable

test information function (TIF) and test characteristic curve (TCC) parallelism NABP 2016 Deciding on a Final Configuration Form Parallelism: PA NAPLEX New Standard v2, Forms = 100 It takes more

time than you think Plan on running lots of simulations Lessons Learned Beware of test spec changes

Consider alternative ATA objectives NABP Consider Alternative Assembly Objectives Objective: Minimize TIF-TCC tolerance

Objective: Maximize S (item availabilities) Constraint Constraint Item usage controls TIF-TCC tolerance

Credits National Association of Boards of Pharmacy Joy Matthews-Lpez Certification Management Services

Breakthrough Technologies Pearson VUE IBM ILOG Vector Psychometric Group Van der Linden W. Linear models for optimal test design. New York, NY: Springer; 2005 NABP

Recently Viewed Presentations

  • Enzymes and the digestive system - VBIOLOGY

    Enzymes and the digestive system - VBIOLOGY

    Enzymes and the digestive system. ... Define digestion. Give the structure and function of the major parts of the digestive system. ... Unscramble the anagrams to reveal the two stages of human digestion. Hysipalc. robewkand. Halcmice. tindogies (Physical breakdown)
  • Elements of a Short Story

    Elements of a Short Story

    Short stories! Elements of a Short Story A short story is a work of fiction that can be read in one sitting. Plot The chain of related events that take place in a story. Built around conflict, which is a...
  • Siemens Communications Presentation

    Siemens Communications Presentation

    Mobile Application: Mobile Banking - PDA Project Subjects BANCO DO BRASIL Brazil The "Banco do Brasil" Mobile phone service Mobile Project Available Platforms Next steps Subjects Brazil The "Banco do Brasil" Mobile phone Service Mobile Project Available Platforms Next Steps...
  • Nudging customers in an Omni-channel world Tracey Elliott,

    Nudging customers in an Omni-channel world Tracey Elliott,

    Webchat and Mobile apps are growing channels for customer service. Making RHP easy to do business with #4. Offering alternative contact channels would provide customers more choice and convenience. Mobile internet channels best suit our customers' preferences and access.
  • Quantitative Stock Selection: Dynamic Factor Weights

    Quantitative Stock Selection: Dynamic Factor Weights

    Quantitative Stock Selection: Practical Insights Campbell R. Harvey ... if we are evaluating someone, the attribution analysis is crucial. Practical Insights 7. ... but includes a number of practical constraints (such as the must but stocks, caps and floors on...
  • CONNECTING THE DOTS Onsit e CAP SD  NDL

    CONNECTING THE DOTS Onsit e CAP SD NDL

    Not interpret the intent or expand meaning of regs. Not validate the SD determination. SD PROCESS. Role of Hearing Official. Assess SA or SO action to propose termination. Not verify is CA submitted is acceptable. Not establish settlement of demands...
  • Patrol Techniques - Socorro Independent School District

    Patrol Techniques - Socorro Independent School District

    Copyright and Terms of Service. Copyright © Texas Education Agency, 2011. These materials are copyrighted © and trademarked ™ as the property of the Texas ...
  • Ionic, Covalent, and Metallic Bonding - Weebly

    Ionic, Covalent, and Metallic Bonding - Weebly

    Ionic, Covalent, and Metallic Bonding . Day 6 - Venn Diagram, haber Process. Metallic Bonding, Properties of Substances reading,