LLM Training - Physics PhD or PhD candidates

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

Role Overview

We are seeking Physicists (PhD or Master's Degree) with strong background in upper-undergraduate Physics or beyond to design rigorous Physics problems used to train and evaluate frontier AI models. This role focuses on creating realistic, exam-quality tasks that are solvable by humans yet challenging enough to expose failure modes in advanced language models.

Responsibilities :

• Design and curate upper-undergraduate and graduate-level Physics problems with fully worked, step-by-step solutions.
• Create model-breaking tasks that resemble top university coursework but frequently fail frontier AI models.
• Customize problem sets according to strict client specifications (SI units, LaTeX formatting, explicit constants, closed-form answers).
• Convert multi-part or image-based textbook / exam questions into single, self-contained, text-only problems with one definitive answer.
• Write clear, rigorous solution processes and verify consistency across question, reasoning, final answer, and units.
• Evaluate model outputs, diagnose common failure modes, and iteratively refine problems to ensure difficulty without sacrificing solvability.
• Review and quality-check Physics problems created by others, correcting issues in clarity, correctness, and formatting.
• Collaborate with other trainers, reviewers, and project managers to maintain consistent quality at scale.

Commitments Required : 8 hours per day with an overlap of 4 hours with PST.

Employment type : Contractor assignment (no medical / paid leave)

Duration of contract : 2 months (possible extention)

Location : India, Pakistan, Sri Lanka, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Mexico, Argentina, Brazil

Selection process : Home Assignment + 15min interview

Requirements