About the Role
Join a growing team of consultants from leading strategy firms to shape how AI learns high-level business reasoning. You will build realistic consulting project environments, design structured consulting tasks for AI agents, and define evaluation criteria and quality standards for an LLM-based grading system.
Responsibilities
- Build realistic consulting project environments, creating detailed project scenarios grounded in real engagement dynamics.
- Design structured consulting tasks for AI agents, breaking projects into discrete tasks that mirror real consulting work.
- Define evaluation criteria and quality standards, developing grading frameworks, evaluation rubrics, and golden-answer solutions.
Requirements
- 3+ years of experience at McKinsey & Company, Boston Consulting Group (BCG), Bain & Company, Oliver Wyman, Roland Berger, Monitor Deloitte (Deloitte S&C), EY-Parthenon, Kearney, or Strategy& (PwC).
- Hands-on project experience in structuring ambiguous client problems into workable analytical plans.
- Hands-on project experience in building financial models, market analyses, or synthesized findings from messy inputs.
- Hands-on project experience in producing client-ready deliverables under time pressure.
- Hands-on project experience in forming and defending recommendations under uncertainty.
- No deep technical background is required.
- Strong structured problem-solving and hypothesis-driven thinking.
- Ability to translate vague problems into clear analytical steps and deliverables.
- High attention to logical consistency and output quality.
- Independent, self-directed working style.
- Clear written English (B2+).
Skills
- Structured problem-solving
- Hypothesis-driven thinking
- Analytical step definition
- Deliverable creation
- Logical consistency
- Output quality assessment
- Independent work
- Self-direction
- Written English (B2+)
Location
- Remote
Work Type
- Remote
- Project-based
- Individual contributor
Experience Level
- 3+ years
Salary/Compensations
- Up to $60 per hour equivalent
About the Company
- Toloka AI supports frontier model post-training by building domain-specific reinforcement learning environments, tasks, and evaluation frameworks designed by real practitioners.
- Mindrift, powered by Toloka, is a leading enterprise AI and machine learning data partner since 2014, connecting top domain experts with cutting-edge AI initiatives.
- Backed by Toloka’s deep expertise in scalable data generation, crowd technology, and applied ML systems, Mindrift enables experts to shape how next-generation generative models learn, reason, and perform.
- We are launching a Management Consulting domain focused on translating real-world consulting engagements into structured learning environments for advanced AI systems.
