Staff + Sr. Software Engineer, Cloud Inference Launch Engineering

Tech Stack

Solid badges = required, outlined = preferred

Responsibilities

• Be on the critical path for frontier model launches, bringing up inference for new model architectures and shipping them to cloud platforms in lockstep with our first-party platform.
• Work with the core inference team to bring new inference features to cloud platforms, owning the platform-specific integration that gets them to production.
• Design, build, and own the CI/CD infrastructure for the inference server and load balancer across cloud platforms, with shadow traffic, performance baselines, and correctness checks.
• Drive down merge-to-production cycle time by making validation faster, more parallel, and cost-effective.
• Analyze observability data across providers to identify performance bottlenecks, cost anomalies, and regressions, and drive remediation.

Soft Skills

Benefits

• Equity
• Flexible Hours
• Parental Leave
• Visa Sponsorship

Culture

Requirements