Software Engineer, AI Gateway

Tech Stack

Responsibilities

• Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms.
• Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests.
• Collaborate with cross-functional teams to integrate new AI providers and models while addressing scalability and performance challenges.
• Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools.
• Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights.

Soft Skills

Benefits

• Equity
• Flexible PTO
• Health Insurance
• Learning Budget
• Remote Work

Culture