Rust Software Engineer – LLM Evaluation & Tooling

The Role :

Senior Software Engineer – Rust (LLM Evaluation & Repository Validation)

Location :  Permanent Remote, Africa-Based

Contract Type :  Contractor (no medical / paid leave)

Duration :  3 months (extensions possible)

Start Date :  Immediate (within 1 week)

Commitment :  20–40 hours / week with some overlap with Pacific Standard Time (PST)

Experience Required :  3–8 years overall, with 2+ years in Rust

About the Project

We are building LLM evaluation and training datasets to train large language models (LLMs) to work on realistic software engineering problems. A key approach in this project involves creating verifiable SWE tasks from public repository histories in a synthetic, human-in-the-loop process. The goal is to expand dataset coverage across programming languages, complexity levels, and problem domains.

This role blends hands-on software engineering with AI-focused research, giving you a chance to work at the intersection of open-source software and cutting-edge AI systems.

Responsibilities :

• Analyse and triage GitHub issues across trending open-source libraries.
• Set up and configure repositories (including Dockerization and development environment setup).
• Evaluate unit test coverage and quality across projects.
• Run and modify codebases locally to assess LLM bug-fixing performance.
• Collaborate with researchers to design / select repositories and tasks challenging for LLMs.
• (Optional) Lead junior engineers collaborating on evaluation tasks.

Why Join :

Application Process :  To apply, please submit your CV and a cover letter detailing your relevant experience and qualifications for the role. Applications will be reviewed on a rolling basis, so early submissions are encouraged.

Equal Opportunity Employer :  We value diversity and are committed to creating an inclusive work environment. We encourage applicants from all backgrounds to apply.

Contact :   Elvis Eckardt

Ideal Profile : Must-Have Skills :

Nice-to-Have Skills :

What's on Offer?