Researcher, Safety Training, National Security

OpenAI

Location
San Francisco
Salary range
USD $380,000 – $500,000 base
Workplace
In office
Level
Individual contributor
Job family
Data & Analytics
Posted
4 weeks ago

The T&S Network estimates this role to be P4, Staff. The typical base salary for that level in Safety Engineering & Data Science is $330k to $420k at a frontier lab. Key skills at this level: owns a detection system end to end, including its drift and its retraining, designs for adversarial pressure rather than for a static distribution, and sets evaluation methodology others in the company adopt.

Learn more about this and similar levels
Why this level

Estimated from the posting rather than stated by the employer: asks for 4+ years · posts $380k to $500k base at a frontier lab · the title reads as P2.

Apply on OpenAI

The role, in T&S terms

Written by the T&S Network from OpenAI's posting.

Safety post-training research on AI models built for U.S. government use, with a focus on national security applications. The work improves how models follow nuanced safety policies and resist bad actors while keeping their usefulness and capabilities intact. It sits in the Safety Training research team, which covers safe behavior training, robustness, and privacy and security risks in deployed models.

What you'd do

  • Develop evaluations and identify model failure modes.
  • Use evaluation findings to improve model training.

What it asks for

  • Over four years of AI safety work covering RLHF, adversarial training, or robustness.
  • Solid skills in deep learning research or engineering.
  • Experience making models safer before they ship.
  • Current TS/SCI clearance or an equivalent level.

Worth knowing

  • Requires an active TS/SCI clearance or equivalent.

Terms in this role

RLHF.
Reinforcement learning from human feedback: training an AI model on people's ratings of its answers.

Our best summary of the posting, and it can be wrong. The employer's posting is what counts: read it in full on OpenAI before you apply. If we got something wrong, report this listing.

Tired of job hunting?

Let the roles come to you. Switch on Available, and when a hiring manager or recruiter brings us a role that fits, we'll put you forward. Never to the company you work for.

Join Hidden Talent

Still listed 14 hours ago

About OpenAI

The employer

About OpenAI

AI and model safety · San Francisco, CA · 1,001 to 5,000 people · Founded 2015

Company profile

AI research company behind ChatGPT and the GPT family of models.

Other jobs at OpenAI

34 other jobs open

All 34 jobs at OpenAI

More jobs like this

All jobs

Listed automatically from OpenAI's public job board. Applications go to the employer. The T&S Network isn't involved in hiring for this job.

More free resources