Staff Software Engineer, Foundational Model Serving
Posted
$192,000 USD
Tech Stack
Responsibilities
- Design and implement core systems and APIs that power Databricks Foundation Model Serving, ensuring scalability, reliability, and operational excellence.
- Partner with product and engineering leadership to define the technical roadmap and long-term architecture for serving workloads.
- Drive architectural decisions and trade-offs to optimize performance, throughput, autoscaling, and operational efficiency for GPU serving workloads.
- Contribute directly to key components across the serving infrastructure — from working in systems like vLLM and SGLang to creating token based rate limiters and optimizers — ensuring smooth and efficient operations at scale.
- Establish best practices for code quality, testing, and operational readiness, and mentor other engineers through design reviews and technical guidance.
Benefits
- Equity
- Health Insurance
Culture
Pay TransparencyDiverse LeadershipInclusive Hiring
Requirements
Regions: Us
Get jobs like this in your inbox
Weekly Express, Next.js, TypeScript hiring trends and salary data — free.
Join 6 engineers getting weekly insights
Get market intelligence in your inbox
Free weekly insights on tech hiring trends, salaries, and in-demand stacks.
Already a subscriber? Sign in
About Databricks
Industry: saas
Size: large
Databricks is a data and AI company that builds and operates the world’s best data and AI infrastructure platform, enabling data teams to turn deep data insights into business impact.
View company profile →Compensation
Base salary: $192,000 USD
Equity: equity
Bonus: eligibility for annual performance bonus