Impress employers and recruiters.
Choose from hundreds of resume examples.

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

This role involves reviewing and evaluating AI-generated outputs, focusing on audio quality, accuracy, and usability. You will assess responses for clarity, helpfulness, natural language, technical accuracy, and adherence to project guidelines, with a strong emphasis on coding knowledge and JSON structure.

Responsibilities

• Participate in live, real-time conversational scenarios with AI systems.
• Review and label conversation transcripts.
• Evaluate AI-generated responses using structured rubrics and provide written justifications.
• Assess responses for language quality, customer experience, technical accuracy, formatting, and JSON structure.
• Capture required session artifacts, including recordings, Session IDs, and tool-call/console logs.
• Prepare the environment and verify tools before each session.
• Speak naturally and spontaneously to evaluate natural voice cadence.

Requirements

• Must pass a basic computational concepts assessment (JSON structures, function, general reasoning, and language proficiency).
• Strong spoken-language proficiency: C1/C2-level fluency (CEFR) in English, verified through a speaking/listening assessment.
• Technical literacy: JSON fluency required - reading, validating, troubleshooting, and identifying structural/formatting issues.
• Audio setup: capable of producing clear audio quality with no background noise.
• Strong attention to detail.
• Strong written communication skills.
• Ability to evaluate both the customer experience and the technical correctness of a response.
• Solid understanding of JSON, including the ability to read, validate, troubleshoot, and identify structural or formatting issues.

Skills

• JSON expertise
• Customer service judgment
• Technical evaluation
• Coding knowledge
• JSON structure
• Formatting accuracy
• Response quality assessment
• Written communication

Location

• Remote

Work Type

• Full-time
• Contract

Experience Level

• Entry Level

Education Level

• High School Diploma or equivalent

About the Company

• An Enterprise client is seeking coding experts to improve AI-generated outputs.