About the Role
This strategic, hands-on role focuses on product and experience strategy, audience research, measurement, and Answer Engine Optimisation (AEO) for both traditional digital products and generative AI experiences. You will shape user experiences based on audience insights, establish measurable strategies for digital and AI systems, and drive continuous improvement. The role involves translating research and strategy into actionable product features and measurement systems to prove and enhance real-world performance, guiding projects from discovery to evaluation.
Responsibilities
- Contribute to Product & Experience Strategy by translating audience research and user insights into actionable product strategies, ideating new features, user journeys, and AI-driven solutions.
- Synthesise Audience Research by leveraging market research and user insights to build audience personas, uncover user intent, and ensure product ideation is grounded in real human needs.
- Run AEO Audits to identify where brand content is missed, misread, or misrepresented by AI systems and answer engines.
- Set Evaluation Strategy by defining frameworks and rubrics to score AI outputs for accuracy, brand alignment, and intent-fulfilment.
- Scope Testing by setting strategy and criteria for synthetic test scenarios and interpreting results to surface resilience issues, edge cases, and failure modes.
- Set Data Strategy by defining semantic data models and JSON-LD schema approaches to make brand content and user intent machine-readable and measurable by AI/answer engines.
- Interpret Economics by reporting on operational metrics and interpreting trends against evaluation benchmarks to guide decisions.
- Interpret Performance by building evaluation dashboards and scorecards, turning results into clear findings and recommendations.
- Validate Behaviour by reviewing system prompts and intervention protocols against evaluation results to confirm brand strategy is being encoded correctly.
- Narrate Strategy by translating technical performance data and audience insights into high-level strategic narratives and reporting for executive stakeholders.
- Collaborate Broadly with data engineering, creative, and technology teams to ideate solutions, define success criteria, and report on achievement.
Requirements
- Prioritise Audience Needs & Intent: Ground digital products and experiences in deep audience research and user intent.
- Are Evaluation-Minded: Fascinated by AI system success and failure, viewing rigorous testing as a core discipline.
- Think in AEO: Understand how content and brand signals are discovered, parsed, and surfaced by AI and answer engines, and how to measure visibility.
- Ideate & Solve Systemically: Apply a structured, hypothesis-driven approach to problem-solving and ideate strategic solutions.
- Translate Strategy into Metrics: Turn abstract brand strategy and audience insights into traceable, measurable evaluation criteria.
- Thrive in Agile: Be comfortable working in a fast-moving, iterative testing and product-development environment.
- Value Rigour: Take pride in continuous improvement, statistical soundness, and measurement framework details.
- Guard the Brand: Understand the tension between dynamic personalisation and brand consistency, and test for AI 'hallucinations'.
- Experience: 4–6 years in Product/Experience Strategy, Evaluation, Measurement/Analytics, AI Operations, or Marketing Sciences with a strong measurement focus, spanning traditional digital products and generative AI experiences.
- Experience Strategy POV: Background in product strategy, CX/UX strategy, or customer journey design, using audience research to ideate solutions and applying this lens to AI system evaluation.
- Audience & Market Research Literacy: Familiarity with qualitative and quantitative market research platforms and methods for building personas, uncovering intent, and informing product ideation.
- Channel & Comms Strategy: Experience using audience and channel research to determine appropriate channels, platforms, and AI interfaces for reaching audiences.
- Technical Foundation: Proficiency in SQL and Python for data manipulation, statistical analysis, and building evaluation pipelines.
- Evaluation Tooling: Working familiarity with AI evaluation and observability tools (e.g., LangSmith, Arize) and ability to interpret outputs.
- Agentic Systems: Familiarity with agentic workflows and orchestration frameworks (e.g., LangChain, LlamaIndex), including evaluation and testing of multi-step, autonomous AI behaviour.
- AEO Literacy: Practical understanding of how answer engines and LLM platforms surface, cite, and rank content, and how to audit and improve visibility.
- Data Comfort: Comfortable working with data in various forms and translating it into visualisations for non-technical audiences.
- Testing Frameworks: Experience designing test suites, golden datasets, rubrics, or scoring frameworks for evaluating AI outputs at scale.
- Visual Mapping: Working knowledge of workflow and diagramming tools (Figma, Lucidchart, Miro) for documenting evaluation logic, user journeys, and decision trees.
- Technical Intuition: Strong understanding of how digital systems work (and fail) and how to design measurements that catch failure early.
- Cross-Functional Track Record: Demonstrated experience proactively communicating research findings and technical evaluation results to technical, creative, and business audiences.
Skills
- Product Strategy
- Experience Strategy
- Audience Research
- Measurement
- Analytics
- Answer Engine Optimisation (AEO)
- Generative AI
- SQL
- Python
- AI Evaluation Tools
- AI Observability Tools
- Agentic Workflows
- Orchestration Frameworks
- LLM Platforms
- Data Visualisation
- Testing Frameworks
- Workflow Diagramming
- Prompt Engineering
- Structured Data
- Vector Stores
- Knowledge Graphs
- Statistical Methods
- Experiment Design
- A/B Testing
- SEO
- Content Strategy
Location
- London
Work Type
- Hybrid
- In-office collaboration three days per week
Experience Level
- 4–6 years
About the Company
- R/GA is an independent creative innovation company built for the intelligence age.
- We harness the power of design and technology to create more valuable experiences for people and brands.
- We help organisations anticipate change and shape what comes next by architecting adaptive brand experiences with AI and optimising complex systems for real-world impact.
- Our teams combine craft, curiosity and technology to deliver work that drives both business and human impact.
