GPU Cluster Architect

Tech Stack

Responsibilities

• Architect scalable GPU cluster topologies including compute nodes, interconnect (InfiniBand, Ethernet), storage, and control planes.
• Analyze AI/ML workloads (e.g. LLM training, inference) to inform design tradeoffs across latency, bandwidth, and GPU density.
• Align with network architect relevant design and validate low-latency, high-throughput interconnects (e.g., InfiniBand HDR/NDR, RoCEv2) at POD and DC scale.
• Work with storage teams to optimize performance for training datasets, checkpointing, and others.
• Understand and analyze signal from monitoring systems to detect flows in design, partnering with site reliability, networking, storage, and DC engineering teams to operationalize and scale your architecture.

Soft Skills

Benefits

• 401k
• Dental
• Disability Insurance
• Health Insurance
• Life Insurance
• Parental Leave
• Remote Work
• Vision

Culture

Requirements