About the Role
DataForce by TransPerfect is seeking doctoral-level experts in Physics to contribute to a specialized AI training initiative. You will craft "stumper" prompts—complex, PhD-level scientific problems unsolvable by current Large Language Models (LLMs). Responsibilities include designing problems, testing LLM failures, documenting flawed outputs, and providing expert solutions. This role requires deep subject-matter expertise, rigorous scientific reasoning, and proficiency with digital documentation tools. This is an initial pilot project with an anticipated commitment of approximately 15 hours per week. Participants may be considered for future project phases and long-term opportunities.
Responsibilities
- Design original, highly complex, self-contained STEM problems based on doctoral research or related subfields.
- Input prompts into multiple designated LLMs to verify they fail to produce the correct answer.
- Write a flawless derivation or calculation leading to the correct answer, including all relevant steps, explanations, equations, and visual diagrams.
- Utilize the DataForce Platform (DFP) to draft, test, and format submissions (e.g., drawing chemical structures, creating physics diagrams, utilizing equation editors).
- Review peer submissions for scientific accuracy, clarity, and adherence to project guidelines (for Senior/QA roles).
Requirements
- A Ph.D. (completed or in the final stages of defense) in Physics (Basic Physics, Condensed Matter Physics, Computational Physics, Applied Physics).
- Prior experience with peer review, academic grading, or scientific publishing.
- Deep expertise in a specific doctoral research niche.
- Familiarity with interacting with GenAI/LLMs and a critical eye for identifying AI hallucinations or logical leaps in scientific reasoning.
Skills
- Exceptional analytical and critical thinking skills.
- Proficiency in standardized scientific documentation (e.g., standard notation and equations for Physics).
- Comfort working in an agile data collection/annotation platform environment.
- Meticulous attention to detail.
- Commitment to strictly original work (AI assistance in generating own solutions is strictly prohibited).
Location
- Remote
Work Type
- Independent Contractor
- Freelance
- Part-time
Experience Level
- Doctoral Level
Education Level
- Ph.D.
About the Company
- DataForce by TransPerfect is part of the TransPerfect family of companies, the world’s largest provider of language and technology solutions for global business, with offices in over 100 cities worldwide.
- We offer high-quality data for Human-Machine Interaction to some of the most prestigious technology companies in the world.
- Our department focuses on gathering, enriching and processing data for Machine Learning in different AI domains.
- Learn more about DataForce at https://www.transperfect.com/dataforce.
