Staff + Sr. Software Engineer, Cloud Inference Launch Engineering
$320,000 – $485,000 USD
Tech Stack
Responsibilities
- Be on the critical path for frontier model launches, bringing up inference for new model architectures and shipping them to cloud platforms in lockstep with our first-party platform.
- Work with the core inference team to bring new inference features to cloud platforms, owning the platform-specific integration that gets them to production.
- Design, build, and own the CI/CD infrastructure for the inference server and load balancer across cloud platforms, with shadow traffic, performance baselines, and correctness checks.
- Drive down merge-to-production cycle time by making validation faster, more parallel, and cost-effective.
- Analyze observability data across providers to identify performance bottlenecks, cost anomalies, and regressions, and drive remediation.
Soft Skills
Cross-Functional Collaboration
Benefits
- Equity
- Parental Leave
- Flexible Hours
- Visa Sponsorship
Culture
Cross-Functional TeamsFast-PacedMission-DrivenCollaborative Space
Requirements
Required: Bachelor’s degree or an equivalent combination of education, training, and/or experience
Regions: Us
Get jobs like this in your inbox
Weekly Distributed Systems, High Performance Computing, Automation hiring trends and salary data — free.
Join 6 engineers getting weekly insights
Get market intelligence in your inbox
Free weekly insights on tech hiring trends, salaries, and in-demand stacks.
Already a subscriber? Sign in
About Anthropic
Industry: ai
Size: small
Anthropic's mission is to create reliable, interpretable, and steerable AI systems to ensure AI is safe and beneficial for users and society. The team is a quickly growing group of researchers, engineers, policy experts, and business leaders committed to building beneficial AI systems.
View company profile →Compensation
Base salary: $320,000 – $485,000 USD
Equity: optional equity donation matching