Staff + Sr. Software Engineer, Cloud Inference Launch Engineering
$320,000 – $485,000 USD
Tech Stack
Responsibilities
- Be on the critical path for frontier model launches, bringing up inference for new model architectures and shipping them to cloud platforms.
- Work with the core inference team to bring new inference features to cloud platforms, owning the platform-specific integration.
- Identify and fix gaps that cause inference to behave differently across first-party and cloud service providers.
- Design, build, and own the CI/CD infrastructure for the inference server and load balancer across cloud platforms.
- Analyze observability data across providers to identify performance bottlenecks, cost anomalies, and regressions.
Soft Skills
Llm ServingHigh-Performance SystemsLarge-Scale Distributed SystemsCross-Functional CollaborationFast Learning
Benefits
- Equity
- Health Insurance
- Parental Leave
- Flexible Hours
- Visa Sponsorship
Culture
Cross-Functional TeamsImpact-OrientedCollaborative SpaceFlexible HoursLearning Budget
Requirements
Required: Bachelor’s degree or an equivalent combination of education, training, and/or experience
Regions: Us
Get jobs like this in your inbox
Weekly Automation Infrastructure, Test Infrastructure, AWS hiring trends and salary data — free.
Join 6 engineers getting weekly insights
Get market intelligence in your inbox
Free weekly insights on tech hiring trends, salaries, and in-demand stacks.
Already a subscriber? Sign in
About Anthropic
Industry: ai
Size: small
Anthropic's mission is to create reliable, interpretable, and steerable AI systems to ensure AI is safe and beneficial for users and society. The team is a quickly growing group of researchers, engineers, policy experts, and business leaders committed to building beneficial AI systems.
View company profile →Compensation
Base salary: $320,000 – $485,000 USD
Equity: optional equity donation matching