Senior Software Engineer - AI Inference

BloombergNew York, NYfull_timesenior

$160,000 – $240,000 USD

Tech Stack

Solid badges = required, outlined = preferred

Responsibilities

  • Design and build scalable infrastructure for online and offline AI inference workloads.
  • Lead integration of high-performance inference runtimes and serving frameworks.
  • Drive architecture and technical decisions across Bloomberg’s inference platform.
  • Partner across engineering teams to improve model deployment, observability, and production performance.
  • Mentor junior engineers on system design, debugging, and performance optimization.

Soft Skills

Object-Oriented ProgrammingSystem Design

Benefits

  • 401k
  • Dental
  • Disability Insurance
  • Health Insurance
  • Life Insurance
  • Mental Health
  • Paid Time Off
  • Vision

Culture

Mentorship Program

Requirements

Required: Computer Science or Electrical Engineering or equivalent practical experience
Regions: Us

Get jobs like this in your inbox

Weekly Distributed Systems, Tensorrt, Vllm hiring trends and salary data — free.

Join 8 engineers getting weekly insights

Get market intelligence in your inbox

Free weekly insights on tech hiring trends, salaries, and in-demand stacks.

Already a subscriber? Sign in