Staff Machine Learning Research Scientist, LLM Evals

Tech Stack

Responsibilities

• Drive research on the effectiveness and limitations of existing LLM evaluation techniques.
• Design and develop novel evaluation benchmarks for large language models.
• Communicate, collaborate, and build relationships with clients and peer teams to facilitate cross-functional projects.
• Implement scalable and reproducible evaluation pipelines using modern ML frameworks.
• Mentor and guide research scientists and engineers, providing technical leadership across cross-functional projects.

Benefits

• 401k
• Equity
• Health Insurance
• Learning Budget

Culture

Requirements