About the Role
Meta builds technologies that help people connect, find communities, and grow businesses. The Global Operations Integrity Operations Team strives to create a safe atmosphere for Meta communities by providing reliable, scalable support, education, and care. This role sits at the center of the shift towards AI augmentation, acting as a human expert and decision-maker on high-stakes cases, governing human review measurement, and setting standards for AI/ML model decisions.
Responsibilities
- Serve as a human expert and provide well-reasoned recommendations on ambiguous, high-severity, and precedent-setting cases, and adjudicate escalations involving potentially abusive content or real-world threats.
- Support AI oversight and governance for integrity and support decisioning: define how AI and ML models are reviewed, audited, and held accountable, and set the human-in-the-loop and human-out-of-the-loop thresholds that govern when models can act autonomously.
- Establish and steward expert-labelled ("golden") datasets used to train, evaluate, and calibrate AI/ML models, owning label quality, precision/recall, model-agreement measurement, and drift over time.
- Apply and uphold governance frameworks (quality standards, guardrails, and escalation paths) that ensure model decisions and data labels comply with all policy, regulatory, and legal requirements.
- Analyze and audit model and operational data to identify user trends, malicious actor behavior, systematic model errors, and coverage gaps, and translate findings into recommendations that improve enforcement accuracy at scale.
- Partner with Engineering, Data Science, and Product to improve labelling interfaces, oversight tooling, and the mechanisms by which human judgment feeds back into model performance.
- Become a recognized expert in integrity and support issues across Operations at Meta and how they affect our community.
- Build cross-functional partnerships to create better, more trustworthy AI-driven solutions for our community and users.
Requirements
- Currently has, or is in the process of obtaining a Bachelor's degree in a directly related field, or equivalent practical experience. Degree must be completed prior to joining Meta.
- 3+ years of experience in an operations, technology, management consulting, or equivalent environment.
- 3+ years of experience in a role involving strategic/analytical initiatives (project management, consulting, data analysis, or technical systems) and/or customer operations.
- Experience owning quality, decision-making, or oversight processes, setting standards and exercising authoritative judgment on complex cases.
- Experience communicating with a variety of audiences, including engineering, data science, and technical teams.
- Demonstrable experience using sound judgment and exhibiting maintaining clear, structured decision-making when handling time-sensitive or high-severity cases.
Skills
- Python
- R
- SQL
- SAS
- Tableau
Location
- Remote
Work Type
- Full-time
Experience Level
- 3+ years
Education Level
- Bachelor's degree
Salary/Compensations
- $79,997/year to $116,000/year
Benefits
- bonus
- equity
- benefits
About the Company
- Meta builds technologies that help people connect, find communities, and grow businesses.
- When Facebook launched in 2004, it changed the way people connect.
- Apps like Messenger, Instagram and WhatsApp further empowered billions around the world.
- Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology.
- People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.
