Member of Technical Staff (TPM, Inference)

Tech Stack

Responsibilities

• Execute the roadmap for the inference platform including request handling, rate limits, usage controls, and reliability
• Coordinate onboarding, launch readiness, and rollout for new models and capacity with model providers and internal teams
• Drive execution metrics around latency, throughput, uptime, and cost-efficiency
• Run the operating model for model-release and optimization programs across performance, infrastructure, and product teams
• Partner with GPU capacity and compute teams to reconcile decisions against cost, capacity, and vendor constraints

Culture

Requirements