About the Role
The Senior Director I, AP English Language and Seminar, Assessment Generalist is responsible for maintaining and enhancing the quality and validity of core AP Program deliverables, including exams, curricula, and professional development content within the subject domain. This role involves item development and management, training subject-matter experts, and ethically integrating AI technologies into assessment creation and review.
Responsibilities
- Serve as an assessment leader for AP English Language and Seminar with primary responsibility for assessment development and final assessment approval.
- Develop and review content, and provide final program sign-off on test forms.
- Seamlessly move in and out of assessment workstreams across subjects, leveraging expertise about assessment, processes, and content domains.
- Independently lead processes for authoring and revising assessment content, including training educator constituents.
- Leverage generative AI to author and/or review assessment content to improve or make assessment processes and outputs more efficient.
- Independently lead the development and management of assessment content (formative and summative) and scoring materials through iterative review stages.
- Independently lead the development of assessment forms, ensuring alignment with approved curricula and test specifications.
- Lead multiple meetings annually with Test Development Committees, strategizing agendas, ensuring productivity, and resolving post-meeting edits.
- Train and directly supervise Test Development Committee members as content development contributors and reviewers.
- Lead the successful scoring of student responses for AP English Language and Seminar Exams at the annual scoring event and produce AP Reading publications.
- Contribute to current research and best practices in assessment, and engage with colleagues to align on standards and shared principles.
- Provide functional leadership of cross-subject assessment workstreams to ensure consistency and leverage efficiencies.
- Serve as an expert resource for course team and leadership consultation.
- Provide formal training and informal mentoring to other Course Experts.
- Develop strong efficiencies in item development through well-defined task models, training, processes, and effective use of generative AI.
- Independently lead initiatives to refine and improve question task models and exam design in collaboration with leaders, aligning with AI innovation and professional learning best practices.
- Monitor exam validity, security, reliability, fairness, and quality, as well as reader reliability.
- Identify areas for improvement and independently lead and execute targeted initiatives.
- Collaborate with psychometrics and AP Curriculum & Assessment staff to establish fair, reliable, and valid cut scores.
- Train and support course experts in assessment development practices, including quality, validity, fairness, and use of generative AI.
- Mentor team members in effectively facilitating test development committees and working with external stakeholders.
- Refine and improve AP English Language and Seminar Course Framework to ensure clear learning outcomes aligned with strategic priorities.
- Collaborate with AP teams to support the development of new products designed to address unmet teacher instructional needs.
Requirements
- Master’s degree in English, Rhetoric and Composition, or a directly related discipline.
- Knowledge of current trends in the discipline.
- Expertise in English, Rhetoric Composition, or a closely related field.
- At least 10 years of experience in standardized assessment development or related work.
- Experience with digital assessment and teaching preferred.
- Strong oral and written communication skills.
- Solid technical proficiency.
- Customer-focused mindset.
- Excellent organizational and planning skills.
- Ability to manage multiple tasks and maintain close attention to detail, including proofreading.
- Demonstrated ability to implement processes and procedures.
- Ability to manage project plans and schedules.
- Ability to maintain tracking documentation.
- Strong interpersonal and collaboration skills.
- Ability to work effectively across all levels.
- Ability to engage in giving and receiving constructive feedback.
- Ability to travel 6-8 times per year, plus up to two additional weeks for the AP Reading.
- Must be eligible to work in the United States.
- Passion for expanding educational and career opportunities and mission-driven work.
- Curiosity and enthusiasm for emerging technologies.
- Willingness to experiment with and adopt new AI-driven solutions.
- Comfort with learning and applying new digital tools independently and proactively.
- Clear and concise communication skills, written and verbal.
- A learner's mindset and a commitment to growth.
- Welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving.
- A drive for impact and excellence.
- Solving complex problems, making data-informed decisions, prioritizing what matters most.
- A collaborative and empathetic approach.
- Working across differences, fostering trust, and contributing to a culture of shared success.
- Authorization to work in the United States.
Skills
- Assessment development
- Assessment management
- Item development
- Subject-matter expert training
- AI integration in assessment
- Assessment creation
- Assessment review
- Assessment validity
- Assessment fairness
- Assessment innovation
- Assessment protocols
- Psychometrics
- Formative assessment materials
- Curriculum development
- Scoring materials development
- Test development committees
- AP Reading leadership
- Research in assessment
- Best practices in assessment
- Cross-subject assessment workstreams
- Mentoring
- Generative AI
- Exam design
- AI innovation
- Professional learning
- Exam validity monitoring
- Exam security monitoring
- Exam reliability monitoring
- Reader reliability monitoring
- Cut score establishment
- Item bank platforms
- Facilitating committees
- Working with external stakeholders
- Course Framework refinement
- New product development
- Market testing
- Standardized assessment development
- Digital assessment
- Teaching
- Oral communication
- Written communication
- Technical proficiency
- Customer focus
- Organization
- Planning
- Task management
- Attention to detail
- Proofreading
- Process implementation
- Project management
- Schedule management
- Documentation maintenance
- Interpersonal skills
- Collaboration
- Constructive feedback
- Travel management
- Emerging technologies
- AI-driven solutions
- Digital tools
- Problem-solving
- Data-informed decision-making
- Prioritization
Location
- Remote
Work Type
- Full-time
- Remote
- Hybrid
Experience Level
- Senior
- 10+ years of experience in standardized assessment development or related work
Education Level
- Master's degree in English, Rhetoric and Composition, or a directly related discipline
- Doctorate in the discipline strongly preferred
Salary/Compensations
- $112,000–$165,000
Benefits
- Meaningful career
- Supportive team
- Comprehensive package designed to help you thrive
- Fair and competitive compensation grounded in qualifications, experience, impact, and market
- Open, transparent conversations about compensation, benefits, and work environment
About the Company
- College Board is a self-sustaining nonprofit.
- AP® is a rigorous academic program built on the commitment, passion, and hard work of students and educators from secondary schools and higher education.
- AP provides willing and academically prepared high school students with the opportunity to study and learn at the college level.
- AP’s course teams comprised of educators and disciplinary experts ensure that course curricula are aligned to higher education expectations and reflect the state of the art in the discipline.
- AP contributes to instructional resources and tools for teachers, and develops assessments that allow students to demonstrate their mastery of course content and skills.
- AP leads in strategic use of AI to expand student access, strengthen instructional design and professional support, and enhance assessment creation and exam analysis.
- The English, World Languages, and Arts department supports 14 courses in the AP portfolio.
Equal Opportunity
- All roles at College Board require authorization to work in the United States.
