LLM Platform Engineer

Tech Stack

Responsibilities

• Own the infrastructure powering LLMs across critical business surfaces supporting growth, recommendations, trust and safety, fraud, seller tooling, and more.
• Create robust and scalable LLM evaluation frameworks to measure model performance, guide iteration, and prevent regression via CI/CD.
• Deploy RAG systems and MCP servers to more effectively ground LLM responses in Whatnot’s business context while enforcing rigorous PII controls.
• Design efficient human-in-the-loop feedback pipelines that can be used to inform scalable LLM evaluation.
• Bridge the gap between research and production, helping to transform experimental ideas into scalable solutions.

Benefits

• 401k
• Equity
• Gym Membership
• Health Insurance
• Parental Leave
• Remote Stipend
• Remote Work

Culture

Requirements