Staff Applied Scientist - Agentic Interfaces
Posted
$276,000 USD
Tech Stack
Responsibilities
- Own the evaluation strategy for Datadog's AI agent integrations, defining metrics for quality and cost across single-turn and trajectory-level interactions.
- Build eval datasets, golden traces, and regression harnesses, making these assets reusable for all teams contributing tools.
- Drive measurable improvements in retrieval relevance, tool-selection accuracy, and context efficiency, collaborating with AI engineers.
- Conduct applied research on agent-data interaction problems like tool selection in large catalogs, multi-turn agent evaluation, grounding, hallucination control, and cost/quality tradeoffs.
- Provide technical leadership within the Agentic Interfaces team and the broader organization through design reviews, mentorship, and external representation.
Benefits
- 401k
- Equity
- Gym Membership
- Health Insurance
- Learning Budget
Culture
Continuous Professional DevelopmentInclusive Company CultureCross-Functional Teams
Requirements
Required: BS/MS/PhD in a scientific field, or equivalent experience
Regions: Us
Get jobs like this in your inbox
Weekly Rust, TypeScript hiring trends and salary data — free.
Join 6 engineers getting weekly insights
Get market intelligence in your inbox
Free weekly insights on tech hiring trends, salaries, and in-demand stacks.
Already a subscriber? Sign in
About Datadog
Industry: observability
Size: enterprise
Datadog is a leading observability and security platform for the AI era, providing businesses with unified visibility across the technology stack to manage complexity at scale, using AI to detect and resolve issues.
View company profile →Compensation
Base salary: $276,000 USD
Equity: New hire stock equity (RSUs) and employee stock purchase plan (ESPP)
Bonus: variable compensation