Member of Technical Staff - Pre-Training

Tech Stack

Responsibilities

• Research and build solutions across algorithms, scaling laws, data processing, optimizers, and model architecture.
• Design and run scientific experiments to advance understanding of scaling large language models and data efficiency.
• Implement state-of-the-art methods from the deep learning literature.
• Lead small research projects independently while collaborating on larger initiatives.
• Optimize the training infrastructure for efficient scaling and contribute across the entire stack.

Benefits

• Equity
• Gym Membership
• Health Insurance
• Parental Leave

Culture

Requirements