Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Tailor your resume to this Member of Technical Staff, North Modelling (Evals) role.
Rezi rewrites your resume against Cohere's job description. Free.
Tailor your resume to this Member of Technical Staff, North Modelling (Evals) role.
Rezi rewrites your resume against Cohere's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Member of Technical Staff, North Modelling (Evals) posting at Cohere — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Member of Technical Staff, North Modelling (Evals) posting at Cohere — free, in seconds.
About the Role
This role is focused on building the evaluation systems, feedback loops, and applied modeling workflows for Cohere's AI workspace platform, North. The goal is to ensure model progress translates into better product outcomes for users by defining "good" across the product, creating high-quality evaluations, and guiding model selection and updates. This is a rigorous applied MLE role for individuals passionate about measurement, model behavior, and real-world product quality.
Responsibilities
- Own the eval strategy for North, defining measurement across agent workflows, tool use, and enterprise knowledge work.
- Build high-quality evals based on user feedback, production failures, usage logs, dogfooding, customer needs, and product goals.
- Create systems to continuously translate user and customer learning into evals, ensuring measurement keeps pace with the product.
- Act as the voice of North within the modeling teams, providing clear insights from eval results and product context.
- Translate model failures, capability gaps, and North-specific needs into actionable recommendations for central modeling teams.
Requirements
- Improved LLM-powered, agent-powered, or AI-product systems through evals, feedback loops, data curation, prompting, model adaptation, or model selection.
- Deep care for evaluation as a craft, including representative tasks, precise rubrics, clean data, failure analysis, and regression tracking.
- Strong applied MLE judgment with clear reasoning about model behavior, eval validity, product outcomes, and production tradeoffs.
- Comfort working closely with users and product teams, translating qualitative signals into actionable measurements for modeling teams.
- Self-directed, practical, and motivated by open-ended problems requiring technical depth and product understanding.
- A desire to make AI systems genuinely useful in real enterprise settings, not just better on abstract benchmarks.
Skills
- Evaluation strategy
- LLM evaluation
- Agentic workflows
- Applied MLE
- Data curation
- Prompting
- Model adaptation
- Model selection
- Measurement
- Model behavior analysis
- Product quality assessment
Location
- Europe
- East Coast North America
Work Type
- Remote-friendly
- Full-Time
Experience Level
- Member of Technical Staff
Benefits
- Weekly lunch stipend ($75/£75 or equivalent)
- Full health and dental benefits
- Separate budget for mental health
- RRSP matching, 401K, Pension Scheme
- 100% Parental Leave top-up for up to 6 months
- Annual enrichment benefits (Arts & culture, fitness/wellness, quality time, workspace improvement)
- Education & learning stipend (conferences, courses, coaching)
- 6 weeks of paid vacation (30 working days)
- Budget for traveling to other offices (for remote employees)
- Annual company offsite
- Daily lunch program (for in-office employees)
- Plenty of snacks (for in-office employees)
- Regular community and social events (for in-office employees)
- Co-working benefit (for remote employees not near an office)
- $500 home office stipend
About the Company
- Cohere is the leading security-first enterprise AI company.
- Builds cutting-edge foundation AI models and end-to-end products designed to solve real-world business problems.
- Trains and deploys frontier models for enterprises building AI systems.
- Believes their work is instrumental to the widespread adoption of AI.
- A team of researchers, engineers, designers, and more, all passionate about their craft.
- A global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul.
Equal Opportunity
- Strives to create an inclusive work environment for all.
- Welcomes applicants from all backgrounds.
- Committed to providing equal opportunities.
- Provides accommodations during the recruitment process upon request.
- May use AI-enabled tools to screen and assess applicants.
- Warns about potential scams, stating Cohere will never ask for payment or third-party services, and all legitimate roles are listed on the official careers page and LinkedIn.