Research, Evals

Tech Stack

Responsibilities

• Design and build the ML eval stack at Exa, investigating how to evaluate search engines in an LLM world.
• Build scalable, reliable eval pipelines that track regressions, drift, and quality signals across billions of documents.
• Create golden datasets, synthetic benchmarks, agentic tasks, and real-world test suites that reflect how developers, agents, and humans actually use Exa.
• Partner closely with ML researchers, data engineers, infra engineers, and product to shape the feedback loops that improve search models.

Benefits

• Gym Membership
• Health Insurance
• Parental Leave

Culture

Requirements