Test Development Analyst

National Board of Medical Examiners; Philadelphia (PA); Hybrid; USD 55,000 - 70,000; Full time

Job summary

A not-for-profit organization specializing in medical assessments is seeking a Test Development Analyst I in Philadelphia. The candidate will develop and update Computer-based Case Simulations (CCS), requiring strong interpersonal and organizational skills. This hybrid role is open to candidates within 50 miles of Philadelphia, offering a competitive salary ranging from $55,680 to $69,600 annually, with excellent benefits including healthcare, 401(k) with match, and remote-friendly options.

Benefits

Healthcare benefits

Dental and Vision plans

401(k) w/match

Tuition Reimbursement

Commuter Benefit

Qualifications

• 1 to 2 years of relevant experience.
• Prior experience with medical terminology, clinical topics, data analysis, and/or the exam assessment/testing industry a plus.

Responsibilities

• Develop supplemental content materials from subject matter experts.
• Proofread and edit meeting materials and committee assignments.
• Run and QC reports to verify coding accuracy.
• Format materials and maintain instructions and support information.
• Deliver quality products within specified timelines.
• Enter case and key development stages.

Skills

Knowledge of medical terminology and disease processes

Excellent interpersonal and organizational skills

Expertise with word processing and presentation software

Excellent attention to detail

Ability to work and learn new technology independently

Education

Bachelor's Degree

Job description

Overview

NBME is seeking a Test Development Analyst I to join our team. The person in this role will develop and update the supplemental Computer-based Case Simulation (CCS) to support operational and research priorities and assessment goals. Strong interpersonal, organizational, and communication skills are essential for the perfect candidate. This candidate must also be a "team player" as they will be interacting with staff and external stakeholders in various functions. This role has been designated as hybrid, which means it generally includes duties that must be performed in the office on specified dates, which may occur 2-3 days per month on average. We are open to considering candidates within 50 miles of our Philadelphia, PA (19104) office location.

Diversity, Equity, and Inclusion

At NBME ®, we continue to innovate and improve how we fulfill the evolving needs of the health care community. This commitment starts and ends with the people at NBME. By recruiting and empowering talented individuals from various disciplines and backgrounds, which includes professionals with diverse life experiences, abilities, and perspectives, NBME can take a well-informed, robust approach to advancing medical education and assessment for years to come. We also continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, workplace culture, products and services, the Philadelphia community and the broader medical education landscape.

RESPONSIBILITIES

• Cases and scoring keys - develop supplemental content materials from subject matter experts; ensure accuracy of programmed content material; maintain style guidelines; ensure formatting and editorial style
• Committee meetings - proofread and edit meeting materials and committee assignments; summarize committee comments for review; request and test computer hardware and software set-up; provide committee technical assistance
• Database support - run and QC reports to verify coding accuracy; identify content to update with new clinical orders; assist in maintaining database documentation
• Web site information - format materials; maintain instructions and support information; work with IT staff to implement and debug software enhancements
• Deliver quality products within specified timelines - debug content, review programmed expressions for completeness, editorial accuracy, consistency and adherence to style guidelines; participate in exam development assuring accuracy
• Track case and key development history and SME comments - enter case and key development stages; enter committee and staff participation in content development; record case summary information; enter content update recommendations and edits

QUALIFICATIONS

Skills and Abilities

• Knowledge of medical terminology and disease processes
• Excellent interpersonal and organizational skills
• Expertise with word processing and presentation software
• Excellent attention to detail
• Ability to work and learn new technology independently

Experience

• 1 to 2 year(s) relevant experience

Education

• Bachelor\'s Degree
• Prior experience with medical terminology, clinical topics, data analysis, and/or the exam assessment/testing industry a plus.

For more information about CCS cases please see the Step 3 practice cases on the United States Medical Licensing Examination® (USMLE®) web site:

https://www.usmle.org/step-3-test-question-formats/computer-based-case-simulations

https://orientation.nbme.org/Launch/USMLE/STPF3

About NBME

NBME is a not-for-profit organization that specializes in the creation of assessments and learning tools for physicians and health professionals. Our mission is to advance assessment of these professionals to achieve optimal care for all, supporting the development of a highly effective, diverse and compassionate health care workforce.

Founded in 1915, NBME develops and manages the United States Medical Licensing Examination ® with the Federation of State Medical Boards. We offer a comprehensive portfolio of assessment products for every stage of the medical school journey and provide assessment services to various health profession organizations.

We are dedicated to advancing innovative assessment approaches through research, collaboration and contributions to the medical education and assessment communities. In 2024, we expanded our assessment capabilities to include simulation through the acquisition of MedVR Education.

Learn more on NBME\'s website.

NBME\'s Community Collaborations and Contributions

NBME believes that a key path to meeting our mission is collaborating with and supporting our communities. Our Community Collaborations and Contributions programs provide resources and recognition to medical educators and researchers advancing the field of assessment throughout their careers. In addition, we invest in fee assistance, scholarships and pathway programs to aid learners and help support increased representation in health care. Headquartered in Philadelphia, NBME also gives to local organizations that advance health equity and access and positively impact social determinants of health.

Compensation we are offering for this position is at $55,680 - 69,600/year. Please note that the offered rate for this position typically aligns with the minimum to midrange of this grade, but it can vary based on the successful candidate\'s qualifications and experience, department budget, and an internal equity review.

The NBME offers competitive salaries, excellent benefits, and a rewarding work environment. Excellent Benefits include: Healthcare, Dental, Prescription, and Vision plans; 401(k) w/match, Tuition Reimbursement Plan, Commuter Benefit: Public Transit or Parking options. Remote Friendly Workplace.

NBME is an Equal Opportunity Employer. We will consider all qualified applicants for employment without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.

Note: This description excludes any postings, alerts, or department-specific references that are not part of the core job content.