Member of Technical Staff - Pre-Training Data

Tech Stack

Solid badges = required, outlined = preferred

Responsibilities

• Design and implement techniques for sourcing, curating, and filtering large-scale web, text, and code data.
• Develop data quality metrics and analyses that measure coverage, diversity, and representativeness across sources.
• Design and run data experiments with the pre-training research team and scale data systems with infrastructure teams.
• Investigate and mitigate data risks, including privacy, safety, and licensing concerns.
• Evaluate dataset changes through ablations and scaling experiments to trace downstream effects on model behavior.

Soft Skills

Benefits

• Dental
• Equity
• Gym/Wellness
• Health Insurance
• Life Insurance
• Parental Leave
• Unlimited PTO
• Visa Sponsorship
• Vision

Culture

Requirements