Lead Member of Technical Staff, Inference Infrastructure

Tech Stack

Responsibilities

• Lead the design and architecture of high-performance, scalable, and reliable machine learning systems for Cohere's AI platform.
• Drive the strategy for deploying optimized NLP models to production in low latency, high throughput, and high availability environments.
• Serve as a key point of contact for customers, leading the design of customized deployments to meet specific needs.
• Mentor engineers to raise the technical bar across the Model Serving team.
• Own compute/storage/network resource and cost management at an organizational level, including optimization strategies.

Benefits

• 401k
• Gym Membership
• Health Insurance
• Learning Budget
• Parental Leave
• Remote Stipend
• Remote Work

Culture

Requirements