About the Role
This role puts you at the forefront of the AI Frontier, where you will design evaluations that set the standard for AI measurement, produce analysis that shapes industry understanding, and work directly with leading AI labs and enterprises. You will develop new benchmarking methodologies, manage key customer relationships, and influence platform product direction, aiming to become a world expert in modern AI technologies.
Responsibilities
- Structure, design, and execute projects to evaluate AI systems and technologies.
- Develop new AI evaluation methodologies and datasets.
- Drive the development of reports and data visualizations to communicate complex AI concepts.
- Collaborate with leading AI companies to benchmark their technologies.
- Identify opportunities to enhance the AI benchmarking platform and work with developers.
- Embrace an AI-native workflow using cutting-edge AI tools.
- Contribute to company strategy and drive large initiatives.
- Manage relationships with teams at leading AI labs and major enterprises.
- Evaluate major AI models across various capabilities as they are released.
Requirements
- 3+ years of relevant professional experience.
- Strong analytical and critical thinking skills.
- Proficiency in Python and data analysis.
- Genuine, demonstrable interest and knowledge of Frontier AI.
- Ability to structure ambiguous problems, build analytical frameworks, and communicate findings to senior stakeholders (for Strategy Consulting background).
- Hands-on experience with modern AI systems and understanding of how models work at a technical level (for AI and Machine Learning background).
- Experience building and shipping AI products in a fast-moving environment (for Technical Product Management background).
Skills
- Python
- Data analysis
- AI Benchmarking
- AI Evaluation Methodologies
- Strategic Analysis
- Product Development
- Client Relationship Management
- Technical Product Management
- Machine Learning
- AI Systems
Location
- San Francisco
- Sydney
- Melbourne
- Brisbane
Work Type
- Full-time
Experience Level
- 3+ years
Benefits
- Competitive compensation including equity
About the Company
- Artificial Analysis is the leading independent AI benchmarking company, supporting labs, engineers, and enterprises in understanding AI capabilities and making critical decisions about AI strategies.
- Our benchmarks and analysis are trusted by hundreds of thousands of users and are the go-to reference for leading AI labs including OpenAI, Google, Meta, NVIDIA and Anthropic, and major publications.
- We are a team of 40+, on track to double by end of year, backed by prominent industry leaders and investors.
- The company is at a defining moment, scaling rapidly with a team that will shape the product, team, and strategy.
