Staff Software Engineer (AI Evals)
G2iUnited States only
Apply now
Opens the original posting on Himalayas.
Apply nowSource: HimalayasApply on the original site
Companies in this catalog do not charge applicants. Never send money to apply.
Staff Software Engineer (AI Evals) Contract | $100–$200/hour | 20-40 hrs/week | Start ASAP We’re looking for highly experienced software engineer to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code.
This is not a traditional engineering role.
You won’t be writing production code.
You’ll be evaluating something harder: whether the model thinks like a great engineer.
What This Role Actually Is
- You will assess how AI coding agents behave in real-world scenarios — focusing on:
- Whether the response makes sense