Live opening · Posted 13 hours ago
At a glance
The key details from the original listing.
About the role
Description supplied by the original job listing.
Location: Annapolis Junction, MD
Category: Test Engineer 3
Travel Required: No
Remote Type: No
Clearance: TS/SCI w/ Polygraph
Position Requirements
We are seeking a Senior Test Automation Engineer to design, build, and maintain automated test solutions across both back-end services (REST APIs) and web user interfaces. This role requires strong hands-on engineering skills in Linux command-line tooling, Python-based automation, containerized test execution (Docker/Podman), and CI/CD integration using Jenkins and GitLab pipelines. The successful candidate will also help evolve our existing in-house automation framework, including planning and executing migration efforts from legacy Robot Framework implementations to newer platforms.
Analyzes system requirements and concept of operations documents, acquisition plans, and system descriptions to develop evaluation and test plans and procedures, prepare for and conduct the data collection and analysis, and report status and results. Supports the development of Government test and evaluation documentation e.g., Test & Evaluation (T&E) Strategy, Test & Evaluation Master Plan, Event Test Plans, Test Readiness Assessments, and T&E Reports. Works with other test organizations to support T&E program integration. Provides specialized T&E capabilities tailored to system functions, level, maturity, and performance area as assigned in the SOW
Position Responsibilities
Develop, maintain, and enhance automated test suites for back-end REST APIs and web-based user interfaces.
Build and maintain a scalable, reliable test automation harness (framework) including execution, reporting, data setup/teardown, and CI/CD integration.
Implement and expand Python-based test automation using Pytest, including fixtures, test data strategies, and robust assertions/validation.
Create and maintain Docker/Podman container images used to run automation consistently across developer environments and CI pipelines.
Integrate automated test execution into Jenkins and GitLab CI/CD pipelines, ensuring repeatable runs, clear reporting, and actionable results.
Use Linx command-line tools and Bash shell scripting to locate, parse, transform, and report on large volumes of logs, test output, and system data.
Support and extend UI automation using Robot Framework and the Python Selenium library, including test stability improvements and best practices.
Collaborate with stakeholders to plan, estimate, and break down work for migrating the current in-house test harness from legacy Robot Framework to a modern alternative (e.g., Robot Framework AIO or Microsoft Playwright).
Write and maintain SQL queries (using SQL Developer or similar tooling) and integrate database validation steps into automated tests were appropriate.
Troubleshoot CI failures and test irregularity/volatility, improve test reliability, and contribute to continuous improvement of the overall QA automation approach.
Assist with any or all of the Level I tasks as constrained by technical training and previous testing experience
Conduct research into and apply knowledge of Government test and evaluation concepts all related engineering acquisition and operations activities as needed to suppo1t the T&E activities
Plan and Execute Performance Analysis
Review planned acquisition approaches to support T&B schedule alignment with decision maker needs for T&E support
Analyze performance risk areas to focus T&B planning
Specify, validate, and adapt Modeling and Simulation for T&E use
Apply Statistical Analysis of variations in performance behavior to characterize confidence in
performance estimates
Select, develop, & use analysis tools
Execute the evaluation plan of data collected by the Testing Task
Plan and Execute Performance Data Collection
Plan program and event level testing for collection of data required for analysis and to synch T&E events with supported decision points
Establish and employ Data & Configuration Management capabilities
Support Data Authentication group functions; and comply with program Discrepancy Reporting criteria and processes
Assess operational and system performance requirements for testability and criticality to frame and prioritize T&E objectives and enable evaluation planning
Coordinate with program Systems Engineering (SE) and review T&E-related SE information to leverage functional analysis, system descriptions parameter selection and dependencies, Modeling and Simulation, and initial performance risk assessments to inform evaluation planning
Assess operational environments and priorities for evaluation attention and scenario selection, and to coordinate user participation in T&E
Plan program and event level risk-tailored performance estimation and analysis of system and operational Effectiveness and Suitability metrics & conditions· levels of T&E include inspection, demonstration paper analysis, survey simulation, and physical test
Design surveys for evaluation of Subject Matter Expert (SE input and user as estimates of performance)
Participate in the T&E Working-level Integrated Product Team (WIPT) and/or Integrated Test Team for coordination of evaluation plans
Produce Evaluation Plans (metric framework, scenarios/threads, timelines, requirements/T&E cross-walk), Analysis Plans Data Requirements Risk Assessments, Evaluation Reports Status reports; provide input to Government T&E products (e.g., Technology Readiness Assessments, Test & Evaluation Strategy, Test & Evaluation Master Plan, T&E Plans & Procedures and Test
Readiness Reports)
Design data sampling schemes to optimize the information/resource balance and to control testing uncertainties
Select, coordinate. and calibrate Instrumentation, collection and data management tools, targets, and facilities
Ensure test readiness including training of test event participants re conduct of the event; equipment readiness, and security legal, and privacy compliance arrangements
Participate in T&E WIPT and/or Integrated Test Team for coordination of data collection plan -
Execute Testing and Data Collection per plan
Produce associated Test Plans, Procedures, and Reports /Briefings, Data Management Plan
Define and
Employment type
Full-Time
Work arrangement
No
Your early-applicant advantage
Live timing from JobBeeper.
More openings worth a look
Recently tracked roles with full details and direct application links.