Intern, AI Agent Evaluations at G2 | CA, US | Rezi

Intern, AI Agent Evaluations at G2

Intern, AI Agent Evaluations

G2 · CA, US

Yesterday

Intern, AI Agent Evaluations

G2 · CA, US

2 days ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now
Resume preview

Tailor your resume to this Intern, AI Agent Evaluations role.

Rezi rewrites your resume against G2's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Intern, AI Agent Evaluations posting at G2 — free, in seconds.

About the Role

This internship role supports the Agentic Marketplace team in growing the AI agent evaluation program by assisting with evaluation methods, engaging with AI agent vendors, tracking other evaluators, and monitoring market trends. The role reports to the Head of Product, Agentic Marketplace, and collaborates with product, data science, and engineering teams.

Responsibilities

  • Break an AI agent's job into testable steps, including writing tasks, test data, and scoring rules.
  • Review scores provided by AI judges and human reviewers.
  • Support the scaling system for engaging with hundreds of vendors.
  • Prepare results packets for vendors before publication and maintain the vendor pipeline weekly.
  • Track other AI agent evaluators, including AI labs, benchmark groups, evaluation startups, and analyst firms, and monitor their publications.

Requirements

  • Currently enrolled in an MBA program.
  • Experience building with or using AI tools such as LLM APIs, chat assistants, or agents, with the ability to explain their functionality and limitations.
  • Strong written communication skills, with the ability to write clearly and briefly.
  • Comfortable communicating with startup founders and product leaders.
  • Ability to articulate and defend one's viewpoint while being open to changing it based on facts.
  • Capacity to make progress on problems lacking a defined process.
  • Based in the San Francisco Bay Area.
  • Available 10 to 15 hours per week during the school year.
  • Internship start date in October or November 2026.

Skills

  • AI tools
  • LLM APIs
  • Chat assistants
  • Agents
  • Clear and brief writing
  • Communication with founders and product leaders
  • Problem-solving
  • AI agent development
  • Evaluation development
  • Benchmark development
  • B2B software
  • Customer support
  • Sales
  • Marketing
  • Writing about AI or software for a public audience
  • Knowledge of the AI startup scene in San Francisco

Location

  • San Francisco Bay Area

Work Type

  • Internship
  • Part-time

Experience Level

  • MBA student

Education Level

  • MBA

About the Company

  • G2 is the world's largest and most trusted software marketplace, helping businesses optimize decisions and strategies with insights from real software users.
  • G2 has joined forces with Capterra, SoftwareAdvice, and GetApp to create the largest source of online data and software insights, serving over 200 million combined annual visitors and 6 million verified reviews.
  • The company aims to transform the global B2B software industry and become the trusted data foundation for software buyers and sellers in the AI era.
  • G2 operates based on PEAK values: Performance, Entrepreneurship, Authenticity, and Kindness.
  • G2 fosters a value-driven, growing global community that supports individual and collective growth.
  • The company is committed to diversity, equity, and inclusion (DEI), with people-led ERGs and philanthropic initiatives like G2 Gives.

Equal Opportunity

  • G2 is committed to creating an inclusive and diverse environment where people of every background can thrive and feel welcome.
  • G2 considers applicants without regard to race, color, creed, religion, national origin, genetic information, gender identity or expression, sexual orientation, pregnancy, age, or marital, veteran, or physical or mental disability status.
  • G2 incorporates AI-powered technology to enhance the candidate evaluation process, including initial application screening, skills assessment analysis, and candidate-role alignment. Final hiring decisions remain under human oversight.
  • Candidates can opt out of AI assistance in their application review without disadvantage.