Senior Engineer, Agentic Engineering Governance, Open Source

College Board – Technology – Platform Operations
Location: This is a remote role. Candidates who live near CB offices have the option of being fully remote or hybrid (Tuesday and Wednesday in office). All CB employees are required to occasionally travel to meet in person for business purposes.
Role Type: This is a full-time position
About the Team
The Platform Operations team at College Board builds solutions to help reimagine and elevate engineering practices around cloud infrastructure, architecture, networking, CI/CD, IaC, and developer experience. We operationalize the platforms that are core to our development environment within our growing AWS ecosystem. We also lead the organization's approach to agentic and AI-assisted software development, helping engineering teams safely and effectively adopt AI coding agents and tools. Our team consists of engineers with a unique blend of skills and experiences that foster a collaborative working environment where each individual member contributes to the success of the team. We learn and teach. We are creative and value the merit of ideas.
About the Opportunity
As a Senior Engineer focused on Agentic Engineering Governance for Open Source software, you are an idea-generator, a catalyst, and a collaborator who sets the standard for how College Board engineers use AI coding agents and agentic development tools safely, responsibly, and effectively. You understand cloud software delivery, tools, and processes that empower efficient and resilient delivery, and you bring that same rigor to the guardrails, policies, and standards that govern how developers use AI coding assistants (such as Claude Code, GitHub Copilot, and similar agentic tools). You are technologically curious and seek opportunities to research emerging technologies and trends, standards, and products. Your eagerness and vision enable you to create and learn complex solutions.
Your focus will be on the fast-moving area of agentic governance for open-source software, where you build the program for license compliance, dependency risk, and review of the code we publish externally. You thrive in an environment with a strong mix of creativity and productivity, splitting your time between hands-on building and setting the standards others follow. You work closely with Security, Legal, and the developers who rely on us. Your excellent communication and mentoring skills allow you to effectively articulate solutions and policies to the team, enabling all to make healthy, well-governed contributions. The result is that the teams building for 7 million students each year can adopt AI with confidence.
In this role, you will:
Design & Implementation (60%)
Design and implement guardrails, permission models, and policy-as-code controls that govern how AI coding agents (e.g., Claude Code, GitHub Copilot, and similar agentic tools) interact with source code, infrastructure, and production systems
Build solutions using the best practices of Agile, CI/CD, and DevOps
Build and maintain tooling for sandboxing, audit logging, and rollback of agent-driven code and infrastructure changes
Continuously develop the skills required to work as part of the agile team in a poly-skilled development environment, including hands-on use of agentic coding tools
Be a subject matter expert in current technological capabilities such as cloud networking, API integrations, infrastructure resiliency, cloud design, and agentic/AI-assisted development patterns
Write code to automate the infrastructure lifecycle, create and support internal tools utilizing IaC, and be able to use CLIs
Evaluate and pilot emerging agentic programming tools, frameworks, and protocols (e.g., MCP, agent orchestration frameworks), and make adoption recommendations
Partner with domain SMEs (Delivery Team Software Engineers, Security, Infrastructure, Network, Observability and Operations) to analyze features, capabilities, and risks of agentic tooling
Contribute to the development and growth of the Cloud Engineering Program, through thought leadership, design and implementation of tools and processes
Participate in the Enterprise Architecture Review process, with a focus on proposals involving AI coding agents and agentic tooling
Governance & Strategy (25%)
Establish and maintain organization-wide standards, guardrails, and acceptable-use policies for agentic and AI-assisted software development
Partner with Security, Legal/Compliance, and Architecture Review stakeholders to assess risk and approve new use cases for AI coding agents
Contribute to technology strategy and planning; conduct research on emerging agentic and AI development technologies and recommend approaches that increase safety, cost effectiveness, and systems flexibility
Author documentation, playbooks, and governance frameworks for developers using AI coding assistants
Participate in agile scrum ceremonies (Sprint Planning, Grooming, Daily SCRUM, Demo, Retro) and contribute to team deliverables
Participate in peer reviews of software engineering artifacts, including code produced or assisted by AI agents
Assist in the identification and resolution of production and production-like issues, including those arising from agentic tooling, as part of the team’s daytime on-call rotation
Team Coordination & Enablement (15%)
Mentor team members on the safe, effective, and compliant use of agentic coding tools
Design and deliver training materials and office hours to help developers adopt agentic engineering practices
Lead technical efforts and mentor technical staff in the development and usage of technology architectures and solutions, with a primary focus on agentic engineering governance for open source software
Serve as an escalation point for questions on AI coding tool policy and governance
About You
To qualify for this role, you must have:
5+ years of experience with Infrastructure as Code, CI/CD framework, immutable infrastructure, automation, orchestration, and other modern DevOps patterns
Significant hands-on experience with AI coding agents or assistants (e.g., Claude Code, GitHub Copilot, Cursor, Windsurf) or other LLM-based developer tooling
Experience with LLM platforms and APIs such as Anthropic Claude or OpenAI, including agent orchestration and tool-use concepts like function calling and MCP
Understanding of AI/LLM security considerations such as prompt injection, data exfiltration, permission scoping, and sandboxing
Experience establishing technical standards, guardrails, or review processes across an engineering organization, in responsible AI governance or an adjacent discipline such as security
Technical knowledge of Cloud Computing, DevOps, and Microservices, with strong experience in distributed cloud infrastructure (AWS preferred, with experience in services such as Lambda, SNS, SQS, S3, Step Functions, EC2, ECS, VPC, IAM, CloudWatch, and DynamoDB a plus)
Experience building event-driven cloud-based serverless applications
A strong background in a language such as Python, JavaScript, React.js/Node.js, or Java, with the logic and problem-solving skills to pick up new languages quickly
Excellent communication, collaboration, and documentation skills; ability to present ideas in business-friendly and user-friendly language, including to non-technical stakeholders on AI governance topics
Experience supporting developers as internal customers, gathering their requirements and feedback, and earning adoption of the standards you set
Curiosity and discipline to research emerging technologies, standards, and products, and the ability to prioritize and execute in a high-pressure environment
All roles at College Board require:
A passion for expanding educational and career opportunities and mission-driven work
Authorization to work in the United States for any employer
Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and comfort learning and applying new digital tools independently and proactively.
Clear and concise communication skills, written and verbal
A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving through iterative learning and user input
A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking
A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success
About Our Process
Application review will begin immediately and will continue until the position is filled. This role is expected to accept applications for a minimum of 5 business days.
While the hiring process may vary,