Member of Technical Staff — Model Optimization and Inference (Experienced)

Tech Stack

Responsibilities

• Own end-to-end inference optimization across LLMs, audio models, and diffusion-based components.
• Implement and tune KV cache strategies for long-context conversations, including eviction, compression, and memory-efficient attention.
• Evaluate, deploy, and extend inference serving frameworks like vLLM, SGLang, and TensorRT-LLM for specific workloads.
• Profile and benchmark end-to-end latency and throughput; identify and systematically eliminate bottlenecks.
• Build internal tooling for faster and more rigorous optimization, including profiling viewers and end-to-end inference test harnesses.

Benefits

• 401k
• Equity

Culture

Requirements