Senior Staff Software Engineer, Data Infrastructure

Tech Stack

Responsibilities

• Define and drive the multi-year technical vision and roadmap for Instacart’s core data platform, aligning with leadership and evolving the architecture for scale, maturity, and cost.
• Architect the ownership strategy for the data platform, leading technical/business case evaluations, cost-benefit modeling, and risk analysis for major investments (build vs. buy).
• Drive the architecture and delivery of the open lakehouse foundation, including unified table format, compute engine portfolio, storage governance, and multi-engine compute expansion.
• Own the architecture for streaming data, event-driven pipelines, stream processing, and real-time serving for critical use cases, making principled decisions on deployment models.
• Lead the adoption, application, and cultural integration of AI/LLM tools across the data platform lifecycle, setting high standards for AI-augmented workflows and cost optimization.

Soft Skills

Benefits

• 401k
• Dental
• Disability Insurance
• Equity
• Flexible Hours
• Health Insurance
• Life Insurance
• Mental Health
• Parental Leave
• Remote Work
• Vision

Culture

Requirements