Research Scientist (Seed Model-Alignment&Preparedness)- 2027 Start (PhD)

About the Team&Role
Seed Model–Alignment & Preparedness is dedicated to advancing AI safety alongside frontier model capabilities. Backed by sustained investment and substantial compute resources, we tackle fundamental challenges in alignment, safety evaluation, and preparedness for emerging risks—translating research into safe, reliable AI systems that benefit people.
We’re looking for researchers to make frontier models and agents safer, with a strong focus on agent RL: training agents that stay safe and controllable in tool use, code execution, and long-horizon tasks.
We are looking for talented individuals to join our team. As a graduate, you will get opportunities to pursue bold ideas, tackle complex challenges, and unlock limitless growth.
Successful candidates must be able to commit to an onboarding date by the end of the year. Please state your availability and graduation date clearly in your resume.
Responsibilities
- Agent RL & safety training: Use RL, SFT, and preference optimization to train agents safely. Design environments, rewards, and training data that reduce deception, reward hacking, and unauthorized actions, and teach agents to check authorization, recognize risks, and stop when needed, without sacrificing useful autonomy. Ensure safety generalizes to new tasks and holds up through further training.
- Frontier risk assessment: Partner with domain experts to evaluate dangerous capabilities (e.g., CBRN, cybersecurity), model threats, and build safeguards. Provide empirical evidence to guide development and deployment decisions.
- Automated red teaming: Build automated attack generation and adversarial training methods to harden models against jailbreaks, prompt injection, and other adversarial inputs.
- Monitoring & oversight: Detect risks from inputs and outputs, execution traces, chains of thought, and internal representations. Build oversight models, action review, and permission controls, and measure their effectiveness, evasion resistance, and cost.
- Failure analysis & deployment: Turn real-world failures into reproducible experiments and pinpoint root causes through controlled studies and ablations. Work with pre-training, post-training, infra, and product teams to ship what works at scale.
Requirements
Minimum Qualifications:
- Individuals who are completing or have recently completed a PhD degree in Computer Science, Electrical Engineering, Electrical and Computer Engineering, Physics, Mathematics, or a related discipline.
- Strong foundations in ML, deep learning, and statistics, with research or engineering experience in LLMs, RL, or related fields.
- Proficiency in Python and PyTorch (or similar), with the ability to independently implement algorithms, build experiment pipelines, and debug data, training, and evaluation issues.
- Deep hands-on experience in at least one of the following: agent RL, model training, dataset development, agent systems, evaluation, or ML infrastructure.
- Ability to turn open-ended questions about model behavior into testable hypotheses, run experiments, and clearly communicate results and limitations to research, engineering, and domain partners.
- A genuine commitment to advancing safety alongside capabilities, and comfort with ambiguous, unsolved problems.
Preferred Qualifications
- Experience with agent RL, including environment design, reward design for multi-step tasks, and long-horizon or multi-agent training.
- Experience with SFT, RLHF/RLAIF/RLVR, distributed training, or automated red teaming.
- Research experience in AI control, scalable oversight, CoT monitoring, mechanistic interpretability, or prompt injection defense.
- Experience evaluating or mitigating risks in high-stakes domains such as CBRN or cybersecurity.
- Strong publications, open-source contributions, or a track record of applying research to real-world systems.

Employment type
Regular