Staff Backend Software Engineer- (AI Platform)
$192,000 – $260,000 USD
Tech Stack
Responsibilities
- Design and implement core systems and APIs that power Databricks Foundation Model Serving, ensuring scalability, reliability, and operational excellence.
- Partner with product and engineering leadership to define the technical roadmap and long-term architecture for serving workloads.
- Drive architectural decisions and trade-offs to optimize performance, throughput, autoscaling, and operational efficiency for GPU serving workloads.
- Contribute directly to key components across the serving infrastructure — from working in systems like vLLM and SGLang to creating token based rate limiters and optimizers.
- Establish best practices for code quality, testing, and operational readiness, and mentor other engineers through design reviews and technical guidance.
Soft Skills
CommunicationCross-Functional CollaborationTechnical Decision-MakingMentoring
Benefits
- Health Insurance
- Dental
- Vision
- Equity
- 401k
- Parental Leave
- Life Insurance
- Disability Insurance
- Flexible PTO
- Mental Health
Culture
Cross-Functional TeamsMentorship ProgramFast-Paced
Requirements
Regions: Us
Get jobs like this in your inbox
Weekly Distributed Systems, Algorithms, Data Structures hiring trends and salary data — free.
Join 6 engineers getting weekly insights
Get market intelligence in your inbox
Free weekly insights on tech hiring trends, salaries, and in-demand stacks.
Already a subscriber? Sign in
About Databricks
Industry: saas
Size: large
Databricks is a data and AI company that builds and operates the world’s best data and AI infrastructure platform, enabling data teams to turn deep data insights into business impact.
View company profile →Compensation
Base salary: $192,000 – $260,000 USD
Equity: equity
Bonus: eligibility for annual performance bonus