About the Role
DataForce by TransPerfect is seeking doctoral-level Physics experts to create challenging, PhD-level scientific problems designed to be unsolvable by current Large Language Models (LLMs). This role involves designing problems, verifying LLM failures, documenting flawed outputs, and providing authoritative, step-by-step expert solutions. It requires deep subject-matter expertise, rigorous scientific reasoning, and proficiency with digital documentation tools.
Responsibilities
- Design original, highly complex, self-contained STEM problems based on doctoral research or related subfields.
- Input prompts into multiple designated LLMs to verify they consistently fail to produce the correct answer.
- Write a flawless derivation or calculation leading to the correct answer, including all relevant steps, explanations, equations, and visual diagrams.
- Utilize the DataForce Platform (DFP) to draft, test, and format submissions.
- Review peer submissions for scientific accuracy, clarity, and adherence to project guidelines (for Senior/QA roles).
Requirements
- A Ph.D. (completed or in the final stages of defense) in Physics, Polymer Physics, Basic Physics, Condensed Matter Physics, Quantum Physics, Computational Physics, Applied Physics, High Energy & Particle Physics, or Astrophysics.
- Prior experience with peer review, academic grading, or scientific publishing.
- Deep expertise in a specific doctoral research niche.
- Familiarity with interacting with GenAI/LLMs and a critical eye for identifying AI hallucinations or logical leaps in scientific reasoning.
Skills
- Exceptional analytical and critical thinking skills.
- Proficiency in standardized scientific documentation (e.g., standard notation and equations for Physics).
- Comfort working in an agile data collection/annotation platform environment.
- Meticulous attention to detail.
- Commitment to strictly original work (AI assistance in generating own solutions is prohibited).
Location
- Remote, within Europe
Work Type
- Independent Contractor/Freelance
- Part-time (15 hours per week)
Experience Level
- Doctoral-level
Education Level
- Ph.D. in Physics or a related subfield
About the Company
- DataForce by TransPerfect is part of the TransPerfect family of companies, the world’s largest provider of language and technology solutions for global business.
- We offer high-quality data for Human-Machine Interaction to prestigious technology companies.
- Our department focuses on gathering, enriching, and processing data for Machine Learning in different AI domains.
