Staff Software Engineer, Inference
$188,000 – $275,000 USD
Tech Stack
Responsibilities
- Act as a technical leader driving architecture, performance, and reliability across multiple services and teams.
- Lead cross-team design initiatives and optimize inference performance (latency, throughput, and GPU utilization).
- Improve system reliability at scale, focusing on scheduling, batching, and memory optimization in distributed and Kubernetes-based infrastructure.
- Work hands-on, influencing engineering direction across the organization.
- Design and optimize high-performance distributed systems with a focus on AI inference and GPU systems.
Soft Skills
Metrics-Driven ApproachesTechnical LeadershipCross-Functional CollaborationProblem SolvingCuriosity
Benefits
- Medical
- Dental
- Vision
- Life Insurance
- Disability Insurance
- Flexible Spending Account
- Health Savings Account
- Tuition Reimbursement
- Employee Stock Purchase
- Mental Health
- Parental Leave
- 401k
- Flexible PTO
Culture
Act Like An OwnerEmpower EmployeesDeliver Best-In-Class Client ExperiencesAchieve More TogetherCross-Functional Teams
Requirements
Regions: Us
Get jobs like this in your inbox
Weekly Distributed Systems, Kubernetes, Go hiring trends and salary data — free.
Join 6 engineers getting weekly insights
Get market intelligence in your inbox
Free weekly insights on tech hiring trends, salaries, and in-demand stacks.
Already a subscriber? Sign in
About CoreWeave
Industry: cloud
Size: large
CoreWeave is The Essential Cloud for AI™, providing a platform of technology, tools, and teams to enable innovators to build and scale AI with confidence.
View company profile →Compensation
Base salary: $188,000 – $275,000 USD
Equity: equity awards, Employee Stock Purchase Program (ESPP)
Bonus: discretionary bonus