Research Scientist, Agent Robustness

Tech Stack

Responsibilities

• Research the science of AI agent capabilities with a focus on how they relate to safety, risk factors, and methodologies for benchmarking them.
• Design and build harnesses to test AI agents’ tendency to take harmful actions when pressured to do so by users or tricked into doing so by elements of their environment.
• Design and build exploits and mitigations for new and unique failure modes that arise as AI agents gain affordances like coding, web browsing, and computer use.
• Characterize and design mitigations for potential failure modes or broader risks of systems involving multiple interacting AI agents.

Benefits

• 401k
• Equity
• Health Insurance
• Learning Budget

Culture

Requirements