Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Tailor your resume to this Automation Program Manager, Legal and Compliance Operations role.
Rezi rewrites your resume against Meta's job description. Free.
Tailor your resume to this Automation Program Manager, Legal and Compliance Operations role.
Rezi rewrites your resume against Meta's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Automation Program Manager, Legal and Compliance Operations posting at Meta — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Automation Program Manager, Legal and Compliance Operations posting at Meta — free, in seconds.
About the Role
Legal and Compliance Operations is seeking an Automation Program Manager to automate high-volume review at scale across Legal and Compliance workflows. This role involves owning the measured quality of assigned automations, iterating on prompts, rules, and signal thresholds, and responding to regressions by identifying and resolving issues. The ideal candidate is rigorous about measurement, comfortable with various automation types, and can distinguish genuine regressions from shifts in incoming data.
Responsibilities
- Hill-climb reliability, correctness, precision, and recall on assigned automations.
- Iterate on LLM components, including prompts, task decomposition, routing, and abstention/fallback behavior.
- Diagnose and improve rules-based components, addressing coverage, ordering, conflicts, and matching issues.
- Tune signal-based components, including thresholds, freshness, availability, and the impact of upstream signal drift.
- Investigate regressions to isolate causes such as model, rule, signal, data, policy changes, or population shifts.
- Drive regressions to a measured recovery and document the cause, detection failures, and preventative measures.
- Build and maintain offline evaluation and gold standard datasets, coordinating expert review sampling.
- Develop regression detection mechanisms to surface degradation before the next reporting cycle.
- Build scripts, notebooks, and internal tooling to enable independent measurement by program managers and operations leads.
- Document experiments, metric movements, and outcomes to inform future workflows.
Requirements
- 2+ years of relevant experience in data annotation, labeling, quality assurance, or content review operations, with exposure to automated decision output.
- Experience with guideline accuracy and inter-rater agreement, including diagnosing reviewer disagreements.
- Working knowledge of Python and SQL for data analysis, including calculating precision and recall and segmenting results.
- Experience reading and reasoning about conditional logic to trace decision paths.
- Experience working with large operational datasets in a notebook environment.
- An investigative approach to metric movement, focusing on identifying root causes.
- Experience communicating results clearly, including reporting unchanged metrics or unexplained regressions.
Skills
- Python
- SQL
- Data Annotation
- Labeling
- Quality Assurance
- Content Review
- Guideline Accuracy
- Inter-rater Agreement
- Conditional Logic
- Notebook Environments
- Metric Analysis
- Communication
- Prompt Engineering
- Agent Orchestration
- Rules Engines
- Decision Tables
- Routing Logic
- Classifier Thresholds
- Responsible AI Practices
- Bias Mitigation
Location
- Remote
Work Type
- Full-time
Experience Level
- 2+ years relevant experience
Salary/Compensations
- $97,000/year to $139,000/year
Benefits
- Bonus
- Equity
- Benefits