Inference Technical Lead, Sora

Tech Stack

Responsibilities

• Perform engineering efforts focused on improving model serving, inference performance, and system efficiency.
• Drive optimizations from a kernel and data movement perspective to improve system throughput and reliability.
• Partner closely with research and product teams to ensure models perform effectively at scale.
• Design, build, and improve critical serving infrastructure to support Sora’s growth and reliability needs.
• Assist researchers in developing inference-friendly models.

Culture

Requirements