The Board of Pharmacy Specialties division of APhA is seeking an Examination Developer to support the development and maintenance of fair, valid, reliable and legally defensible certification examinations. This employee will ensure that the examinations developed and published by the BPS meet the highest standards of excellence, content accuracy and editorial quality. This position will provide support for the management of the exam development and maintenance processes for multiple exams programs.

 The Primary Responsibilities Are:

Item Bank Management

• Manage multiple item banks using standard industry item bank software usage throughout the development and review cycle.
• Liaise and interface with multiple groups of item authors and manage item development efforts
• Manage multiple panels of volunteer subject matter experts (SMEs) in development of objective test items in multiple formats
• Identify gaps in item banks to create “most wanted” lists to match content specifications.

Exam Construction

• Facilitate exam construction meetings, item writing workshops, item review and approval sessions with SMEs and BPS staff.
• Assemble test forms to meet test specifications
• Assist psychometrician with preparation for testing related meetings (e.g., standard setting studies) standard setting workshops and preparation of study reports.
• Interpret basic item and test statistics, and use the concepts of reliability and validity, and work with psychometrician(s) to analyze the performance of items and tests.

Security and Quality Assurance

• Conduct quality assurance on all tests to be published and support exam publication efforts.
• Maintain the security of item bank, exam forms, and confidential candidate and vendor information.