About the Role
The Risk Assessment Analyst will execute comprehensive evaluations of AI tools and platforms used by children, teens, and educators, contributing to the development of safety standards and independent testing within the Youth AI Safety Institute. This role requires rigorous execution of assessment protocols, data analysis, and report development, with a focus on ensuring AI used by children is safe and developmentally appropriate. The analyst must possess professionalism, emotional resilience, and analytical detachment to evaluate sensitive content while prioritizing child safety.
Responsibilities
- Design and execute risk assessment test plans for AI tools and platforms used by kids, teens, and K–12 institutions.
- Conduct comprehensive evaluations of major AI platforms and emerging educational AI tools following established methodologies.
- Implement systematic prompt testing procedures.
- Apply standardized evaluation frameworks across different AI applications and use cases.
- Run batch and manual prompt testing plans to assess AI system outputs, behaviors, safety mechanisms, and content appropriateness.
- Process and analyze large data sets from testing procedures to identify patterns, risks, and safety considerations.
- Handle sensitive content evaluation, including potentially triggering or challenging material related to youth safety concerns.
- Conduct comprehensive background research on AI tools and platforms, including literature reviews and technical documentation analysis.
- Synthesize research findings from academic papers, industry reports, and technical specifications.
- Prepare research briefs summarizing key background information, known risks, and relevant technical details.
- Stay current with emerging research on AI safety, youth development, and platform risk assessment methodologies.
- Compile and organize assessment data into structured formats for analysis and reporting.
- Document testing procedures and findings.
- Translate complex technical findings into clear, accessible reports for diverse audiences.
- Draft assessment reports using Common Sense Media's voice, tone, and editorial standards.
- Prepare executive summaries and key findings briefs for different stakeholder groups.
- Adapt communication style for various audiences while maintaining accuracy and analytical rigor.
- Develop public-facing risk assessment reports.
- Manage assessment project timelines and deliverables.
- Supervise Risk Assessment Fellowship/Associate in executing research, assessment, and writing tasks.
- Coordinate with subject matter experts and contractors for specialized testing or expertise.
Requirements
- Bachelor's degree in a relevant field (computer science, psychology, education, public policy, or related).
- 3–5 years in research, data analysis, content moderation, or safety evaluations.
- Demonstrated experience with technical tools to support automated testing.
- Strong analytical skills, with experience in systematic evaluation methodologies.
- Excellent written communication skills, with the ability to document complex technical findings clearly.
- Ability to handle sensitive, potentially upsetting content related to youth safety in a professional context.
- Previous experience in AI safety research, platform trust and safety, or technology risk assessment is preferred.
- Background in child development, educational psychology, or youth-focused research is preferred.
- Experience with data analysis and methods is preferred.
- Familiarity with AI platform APIs and testing frameworks is preferred.
- Knowledge of privacy regulations and educational technology compliance requirements is preferred.
- Experience working in collaborative, mission-driven organizations is preferred.
- Strong organizational skills, with the ability to manage multiple concurrent projects and deliver high-quality work on deadline.
- Comfortable learning new tools and technologies while maintaining proficiency with existing technical requirements.
- Effective partnership skills for working closely with the Institute and cross-functional teams.
- Meticulous attention to accuracy in data collection, analysis, and documentation.
- Ability to engage with challenging content while maintaining objectivity and professional boundaries.
- Flexibility to adjust approaches and priorities based on strategic direction and emerging needs.
- Must pass a criminal background check.
Skills
- Risk assessment
- Data analysis
- Content moderation
- Safety evaluations
- Technical testing
- Systematic evaluation methodologies
- Written communication
- AI safety research
- Platform trust and safety
- Technology risk assessment
- Child development
- Educational psychology
- Youth-focused research
- Data analysis and methods
- AI platform APIs
- Testing frameworks
- Privacy regulations
- Educational technology compliance
- Organizational skills
- Project management
- Technical aptitude
- Collaboration
- Detail orientation
- Professional resilience
- Adaptability
Location
- San Francisco, California
Work Type
- Full-time
- Exempt
Experience Level
- 3-5 years
Education Level
- Bachelor's degree
Salary/Compensations
- $90,000.00 - $110,000.00 per year
Benefits
- Medical, dental, vision
- Matching 401(k)
- Other key benefits
- Work/life balance
About the Company
- Common Sense Media is the leading nonprofit organization dedicated to improving the lives of kids and families by providing research-backed information, education, and independent voice they need to thrive in the age of apps, algorithms, and AI.
- We rate, educate, and advocate for policies to protect and prepare kids online.
- Our ratings, research, and resources reach more than 150 million users globally, over 1.4 million educators, and more than 100,000 schools worldwide every year.
- The Youth AI Safety Institute establishes safety standards, builds open-source evaluations that AI developers can run against their models, independently tests AI products, and publishes the results to provide transparency and accountability.
- It is an independent research and testing ground dedicated to ensuring that the AI used by children is safe and developmentally appropriate.
Equal Opportunity
- Common Sense Media provides equal employment opportunities to all qualified individuals and prohibits discrimination and harassment of any type without regard to race, color, religion, sex, gender identity, sexual orientation, pregnancy, age, national origin, physical or mental disability, military or veteran status, genetic information, or any other protected classification or characteristic protected by federal, state, or local laws.
- Common Sense Media will also consider for employment qualified applicants with arrest and conviction records.
- Pursuant to the San Francisco Fair Chance Ordinance, we will consider employment for qualified applicants with arrest and conviction records.
