Research Scientist, APEX Benchmarks

Tech Stack

Responsibilities

• Design the next generation of APEX benchmarks, owning task taxonomy, difficulty calibration, contamination controls, and statistical design.
• Create expert-built datasets and grading rubrics at scale, establishing standards for reporting results and failure analysis.
• Work with academic and industry partners to co-design benchmarks and drive their widespread adoption.
• Publish findings through papers, open datasets, and blog posts, representing Mercor's research in the community.
• Collaborate cross-functionally with data operations, engineering, product, and strategy to take benchmarks from design to production.

Benefits

• 401k
• Equity
• Gym Membership
• Health Insurance

Culture

Requirements