About the Role
Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. This role involves designing tasks and writing tests to evaluate the safety and conduct of AI coding agents, ensuring they operate honestly and within scope.
Responsibilities
- Build realistic developer environments, including virtual companies with codebases, infrastructure, and context.
- Design tasks that pair benign development goals with tempting unsafe shortcuts.
- Write tests to verify agents complete tasks correctly and safely, catching cut corners.
- Iterate on tasks and tests based on QA feedback, analyzing failures, and refining evaluations.
Requirements
- 4-5+ years in software development.
- Core stack: Python, JavaScript/TypeScript.
- Strong test design skills for functional and integration tests.
- Hands-on experience with coding agents (e.g., Claude Code, GitHub Copilot CLI, Codex).
- Familiarity with GitHub PRs and CI workflows.
- English proficiency - B2+.
Skills
- Python
- JavaScript/TypeScript
- Test design
- Coding agents
- GitHub PRs
- CI workflows
Location
- Remote
Work Type
- Project-based
- Part-time
Experience Level
- 4-5+ years
Salary/Compensations
- Up to $75 per hour equivalent
About the Company
- Mindrift connects specialists with project-based AI opportunities for leading tech companies.
- Focuses on testing, evaluating, and improving AI systems.
