Senior Software Engineer - AI Inference
$160,000 – $240,000 USD
Tech Stack
Distributed SystemsTensorrtVllmOnnxTritonMachine Learning SystemsBatchingCachingRequest SchedulingPytorchCudaNcclNvlinkInfinibandMpiKubernetesLoad BalancingRequest RoutingTraffic ManagementDebuggingPerformance Optimization
Solid badges = required, outlined = preferred
Responsibilities
- Design and build scalable infrastructure for online and offline AI inference workloads.
- Lead integration of high-performance inference runtimes and serving frameworks.
- Drive architecture and technical decisions across Bloomberg’s inference platform.
- Partner across engineering teams to improve model deployment, observability, and production performance.
- Mentor junior engineers on system design, debugging, and performance optimization.
Soft Skills
Object-Oriented ProgrammingSystem Design
Benefits
- 401k
- Dental
- Disability Insurance
- Health Insurance
- Life Insurance
- Mental Health
- Paid Time Off
- Vision
Culture
Mentorship Program
Requirements
Required: Computer Science or Electrical Engineering or equivalent practical experience
Regions: Us
Get jobs like this in your inbox
Weekly Distributed Systems, Tensorrt, Vllm hiring trends and salary data — free.
Join 8 engineers getting weekly insights
Get market intelligence in your inbox
Free weekly insights on tech hiring trends, salaries, and in-demand stacks.
Already a subscriber? Sign in
About Bloomberg
Industry: fintech
Size: enterprise
Bloomberg is building core infrastructure for AI, providing production-grade managed infrastructure for hosting, deploying, and serving all machine learning models.
View company profile →Compensation
Base salary: $160,000 – $240,000 USD
Bonus: incentive compensation
Similar Jobs
Senior Software Engineer - Public Cloud Engineering Managed Compute
Bloomberg · New York, NY
$160k – $240k
Senior Typescript Software Engineer - Trade Automation & Execution
Bloomberg · New York, NY
$160k – $240k
Senior Software Engineer - Backend-Series B AI Startup -$275K +equity
Benchstack Ai · New York City Metropolitan Area
$200k – $275k
Software Engineer, Model Routing & Inference
Cursor · New York
Senior Software Engineer, Model Serving
Databricks · San Francisco, California
$166k