About the Role
As the Senior Director I, AP Science Assessment Generalist, you will be responsible for preserving and improving the quality and validity of the AP Program’s core deliverables within the subject domain: the exam, the course curriculum, and the professional development content. You will also be responsible for item development and management, training and collaborating with subject-matter experts, and ethically and effectively integrating AI technologies in assessment creation and review.
Responsibilities
- Serve as an assessment leader for AP Science, with primary responsibility for assessment development and final assessment approval for AP Science.
- Develop and review content, and provide final program sign-off on test forms.
- Seamlessly move in and out of assessment workstreams across subjects, leveraging expertise about assessment, assessment processes, and content domain expertise.
- Independently lead processes for authoring and revising assessment content, including training educator constituents.
- Leverage generative AI to author and/or review assessment content to improve and/or make more efficient assessment processes and outputs.
- Independently lead the development and management of assessment content (formative and summative) and scoring materials for AP Science through iterative review stages.
- Independently lead the development of assessment forms for AP Science, ensuring the AP Exam development aligns with approved curricula and test specifications.
- Lead multiple face-to-face, weekend meetings, and virtual meetings annually with the AP Science Test Development Committees.
- Independently strategize and develop an agenda and approach to ensure committee meeting time is of the highest productivity.
- Adapt and pivot during committee meetings as needed and successfully resolve all post-meeting item content edits.
- Train and directly supervise Test Development Committee members in AP Science/Life Science as content development contributors and reviewers.
- Lead the successful scoring of student responses for AP Science Exams at the annual scoring event and produce AP Reading publications materials.
- Independently plan all-year for the AP Reading, ensuring all workflow steps and post-Reading activities are accounted for and successfully executed.
- Contribute to current research and best practices in assessment, and engage regularly with AP Curriculum & Assessment colleagues to align on standards and shared principles.
- Provide functional leadership of cross-subject assessment workstreams to ensure consistency and leverage efficiencies.
- Serve as an expert resource for course team and leadership consultation.
- Provide formal training and informal mentoring to other Course Experts within AP Science, based on need.
- Develop strong efficiencies in item development through well-defined and well-documented task models, item development training and processes, and highly effective use of generative AI.
- Independently lead initiatives to refine and improve question task models as well as exam design in collaboration with AP Curriculum & Assessment leaders and aligned to other College Board initiatives.
- Monitor exam validity, security, reliability, fairness, and quality, as well as reader reliability in accordance with established Program thresholds.
- Identify areas for improvement and independently lead and execute targeted initiatives to improve.
- Collaborate with psychometrics and AP Curriculum & Assessment staff to establish fair, reliable, and valid cut scores.
- Train and support course experts in assessment development practices, including quality, validity, fairness, and use of generative AI.
- Deepen course experts' understanding of the item and test development lifecycle, and effective use of item authoring and item bank platforms.
- Mentor team members in effectively facilitating test development committees and working with external stakeholders.
- Refine and improve AP Science Course Frameworks to ensure clear and explicit learning outcomes that align with strategic priorities.
- Collaborate with AP teams to support the development of new products for AP Biology, Environmental Science, Chemistry, or Physics designed to address unmet teacher instructional needs.
- Potentially develop prototypes, participate in small-scale market-testing, and create models for subsequent development in conjunction with other AP workstreams.
Requirements
- A Master’s degree in Biology, Environmental Science (or a related Life Science field), Chemistry, Physics, or a directly related discipline is required.
- Doctorate in the discipline is strongly preferred.
- Sufficient knowledge and disciplinary breadth to contribute to curriculum and assessment work in at least two of the following AP Science courses: Biology, Environmental Science, Chemistry, and Physics.
- Such breadth may be demonstrated through additional coursework, teaching, curriculum or assessment development, research, or equivalent professional experience.
- At least 10 years of experience in standardized assessment development is required.
- Current knowledge of trends in at least one of the disciplines listed above and demonstrated ability to apply that expertise across at least two AP Science courses.
- Experience with digital assessment and teaching in one or more of these disciplines is preferred.
- Strong oral and written communication skills, with solid technical proficiency and a customer-focused mindset.
- Excellent organizational and planning skills, with the ability to manage multiple tasks and maintain close attention to detail, including proofreading.
- Demonstrated ability to implement processes and procedures, manage project plans and schedules, and maintain tracking documentation.
- Strong interpersonal and collaboration skills, with the ability to work effectively across all levels, and engage in giving and receiving constructive feedback.
- Ability to travel 6-8 times per year, plus up to two additional weeks for the AP Reading.
- Must be eligible to work in the United States.
- A passion for expanding educational and career opportunities and mission-driven work.
- Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and comfort with learning and applying new digital tools independently and proactively.
- Clear and concise communication skills, written and verbal.
- A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving through iterative learning and user input.
- A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking.
- A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success.
- Authorization to work in the United States.
Skills
- Assessment development
- Curriculum development
- Professional development content
- Item development
- AI integration in assessment
- Psychometric collaboration
- Formative assessment development
- Summative assessment development
- Scoring materials development
- Test development committee leadership
- Assessment validity
- Assessment security
- Assessment reliability
- Assessment fairness
- Generative AI utilization
- Digital assessment
- Interpersonal skills
- Collaboration skills
- Organizational skills
- Planning skills
- Attention to detail
- Proofreading
- Project management
- Data-informed decision making
Location
- Remote
Work Type
- Full-time
- Remote
- Hybrid
Experience Level
- Senior Director
- 10+ years of experience in standardized assessment development
Education Level
- Master's degree in Biology, Environmental Science, Chemistry, Physics, or a related Life Science field
- Doctorate preferred
Salary/Compensations
- $112,000–$165,000
Benefits
- Meaningful career
- Supportive team
- Comprehensive package designed to help you thrive
- Fair and competitive compensation grounded in qualifications, experience, impact, and market
- Open, transparent conversations about compensation, benefits, and what it’s like to work at College Board
About the Company
- The AP Curriculum and Assessment Team at College Board (125+ staff) collaborates with colleagues across all aspects of the AP Program to develop, manage, and deliver AP’s 43 courses in a wide variety of subject areas.
- AP® is a rigorous academic program built on the commitment, passion, and hard work of students and educators from secondary schools and higher education.
- AP provides willing and academically prepared high school students with the opportunity to study and learn at the college level.
- AP’s course teams comprised of educators and disciplinary experts ensure that course curricula are aligned to higher education expectations and reflect the state of the art in the discipline, contribute to instructional resources and tools for teachers, and develop assessments that allow students in these courses to demonstrate their mastery of course content and skills.
- AP leads in strategic use of AI to expand student access, strengthen instructional design and professional support, and enhance assessment creation and exam analysis.
- The Science department, which includes biology, chemistry, physics, psychology, environmental science, anatomy and physiology, and Research, is currently made up of 21 people supporting 10 courses in the AP portfolio.
- College Board is a self-sustaining nonprofit.
Equal Opportunity
- All roles at College Board require authorization to work in the United States.
