Software Engineer in Test

Built is seeking an experienced Software Engineer in Test to support an AI-first software development environment where AI agents generate unit and integration tests at scale.
This is not a traditional QA role. We are looking for a strong Software Engineer with deep testing expertise who can evaluate, improve, and validate AI-generated test suites to ensure they accurately reflect expected system behavior.
You will serve as the human quality layer between AI-generated test output and the CI/CD pipeline. Working with approximately 150–250 tests per module, you will consolidate overlapping scenarios into behavioral specifications, eliminate redundant or low-value tests, strengthen incomplete coverage, and develop additional tests for critical behaviors AI agents may have missed.
The objective is to ensure every test entering the pipeline provides meaningful value, accurately validates software functionality, and contributes to a reliable, maintainable codebase.
Work is organized into module-based assignments, typically lasting 2–3 weeks per module.
Key Responsibilities
Review, analyze, and improve AI-generated unit and integration tests in Golang codebases.
Evaluate test suites of approximately 150–250 tests per module, identifying redundancies, weaknesses, and coverage gaps.
Consolidate overlapping use-case tests into clear, maintainable behavioral specifications.
Remove duplicate, ineffective, or low-value tests while documenting the reasoning behind each decision.
Strengthen existing tests by improving assertions and expanding coverage of important behaviors.
Write additional unit and integration tests for scenarios overlooked by AI-generated test suites.
Evaluate testing coverage across happy paths, failure scenarios, boundary conditions, null and empty states, concurrency, and error propagation.
Maintain curated test suites directly within version-controlled codebases.
Document test consolidation decisions, removed tests, added coverage, unresolved edge cases, and recurring AI-generated testing limitations.
Collaborate with senior engineering leadership to review curated tests and obtain approval before CI/CD integration.
Investigate and address tests requiring substantive updates following changes to expected system behavior.
Escalate ambiguous or unclassifiable test scenarios to engineering leadership.
Required Skills
Strong, hands-on development experience in production environments.
Experience writing, reviewing, debugging, and maintaining unit and integration tests.
4+ years of experience developing and maintaining unit and integration tests in production software environments.
Strong software engineering background with the ability to independently understand and navigate unfamiliar codebases.
Hands-on experience with unit testing frameworks, mocking techniques, and assertion design.
Strong understanding of software testing principles, including:
Happy and unhappy paths
Boundary conditions
Null and empty-state handling
Error handling and propagation
Concurrency scenarios
Ability to identify redundant, misleading, or ineffective tests and determine whether they provide meaningful behavioral value.
Experience designing tests that validate expected system behavior rather than merely implementation details.
Strong analytical thinking and independent problem-solving skills.
Ability to document technical decisions clearly and communicate effectively with engineering stakeholders.
Nice-to-Have Skills
Experience with behavior-driven development (BDD) or specification-driven testing.
Experience reviewing AI- or LLM-generated code and tests.
Exposure to AI-assisted software development workflows and AI coding agents.
Familiarity with HTMX and PostgreSQL.
Experience improving test-suite quality and maintainability within CI/CD environments.
Golang experience

Work arrangement
Yes