Senior Software Engineer, Model Serving

Tech Stack

Responsibilities

• Design and implement core systems and APIs that power Databricks Model Serving, ensuring scalability, reliability, and operational excellence.
• Drive architectural decisions and trade-offs to optimize performance, throughput, autoscaling, and operational efficiency for CPU and GPU serving workloads.
• Contribute directly to key components across the serving infrastructure including model container builds, deployment workflows, routing, caching, observability, and intelligent autoscaling.
• Collaborate cross-functionally with product, platform, and research teams to translate customer needs into reliable and performant systems.
• Lead technical initiatives that improve latency, availability, and cost-effectiveness across both customer-facing and foundational serving layers, and mentor other engineers.

Benefits

• Equity
• Health Insurance

Culture