Sr. Manager, Engineering - Model Serving

Tech Stack

Responsibilities

• Lead, mentor, and grow a high-performing engineering team responsible for the customer-facing Model Serving product and its foundational infrastructure.
• Define and own the product and technical roadmap for Model Serving, balancing customer experience, functionality, and foundational investments.
• Collaborate closely with product, research, platform, and infrastructure teams to drive end-to-end delivery from ideation to operation.
• Ensure Model Serving meets stringent SLAs, SLOs, and performance/reliability goals, continuously improving operational efficiency and customer experience.
• Drive architectural decisions and product design around latency, throughput, autoscaling, GPU/CPU placement, and cost optimization.

Soft Skills

Benefits

• Dental
• Equity
• Health Insurance
• Vision

Culture

Requirements