AI & Analytics Quality Engineer

AI & Analytics Quality Engineer
Our client is a non-profit in Tysons Corner. This is a non-profit that is trying to help people with disabilities - so the people who work here are truly trying to do the right thing. Their mission is to increase the employment of people with disabilities by building strong partnerships with the federal government and engaging a national network of nonprofit agencies and experts. It's a great place to work and feel good about what you're doing. We have been asked to help them identify a great AI & Analytics Quality Engineer who knows the associated functionality.
Job Summary:
We are seeking an AI & Analytics Quality Engineer responsible for ensuring the quality, accuracy, and reliability of AI-enabled solutions, Microsoft Fabric data products, and enterprise reporting platforms for our client.
This role will validate AI outputs, reporting solutions, data pipelines, integrations, and analytics while driving test automation to improve quality, coverage, and efficiency.
Key Responsibilities
Test and validate AI-enabled solutions, Microsoft Copilot capabilities, and AI-generated outputs.
Evaluate, pilot, and implement AI-enabled testing solutions to increase automation, improve test efficiency, and strengthen quality validation for AI-powered applications, data platforms, and reporting products.
Validate Microsoft Fabric, Power BI, and enterprise reporting solutions.
Verify data quality, business rules, calculations, KPIs, and report accuracy.
Perform data reconciliation, source-to-target validation, and integration testing.
Design, develop, and maintain automated tests for AI, data, and reporting solutions.
Execute functional, integration, regression, and user acceptance testing.
Partner with Product Owners, Data Engineers, Developers, and business stakeholders to ensure high-quality delivery.
Required Qualifications
5+ years of Quality Assurance, Quality Engineering, or Software Testing experience.
3+ years testing data, analytics, business intelligence, or reporting solutions.
Experience testing AI-enabled applications, Copilot solutions, or AI-generated outputs.
Experience with Microsoft Fabric, Power BI, or similar analytics platforms.
Experience designing and implementing test automation solutions.
Strong SQL, data validation, and analytical testing skills.
Experience testing APIs and system integrations.
Experience working in Agile environments.
Preferred Qualifications
Experience with Generative AI, prompt engineering, and AI output evaluation.
Experience with Dynamics 365 CE, Dynamics 365 F&O, Dataverse, and the Power Platform.
Experience with test automation tools such as Playwright, Mabl, or similar frameworks.
Experience supporting CI/CD pipelines and quality engineering practices.
Knowledge of data governance, data lineage, and enterprise reporting.
Microsoft Fabric, Power BI, Data Engineering, or AI certifications.
Preferred Certifications
Highly Preferred
Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
Microsoft Certified: Fabric Data Engineer Associate (DP-700)
Microsoft Certified: Azure AI Fundamentals (AI-900)
Nice to Have
Microsoft Certified: Power BI Data Analyst Associate (PL-300)
Microsoft Certified: Azure AI Engineer Associate (AI-102)
Education
Bachelor’s degree in Computer Science, Information Systems, Data Analytics, Engineering, or a related field, or an equivalent combination of education and experience.
This will be a long-term contract opportunity. The initial contract will be for 12 months. There is a high likelihood that this is a multiyear opportunity – with the possibility of conversion to being a full-time employee of our client.
Location: The client would prefer candidates local to Northern Virginia or Chicago (near O’Hare). If you live in either location, you may be required to be in the office 2 days/week. They would consider 100% remote great candidates, but you must be readily available and willing to travel to one of the main offices in Virginia or Illinois on a quarterly basis.
If this sounds like you, please respond with your Salary/Hourly rate requirements as soon as possible.
=============================================
AAJ Interactive Technologies, established in 1997 by cutting-edge technology executives, is a technology professional-services company supplying project-based consulting, staff augmentation and recruiting services to leading firms throughout Metropolitan Washington, DC area.
We work differently from most of our competition. We have been in both a position of hiring, mentoring and managing large staff inside a corporate culture, as well as consultants for hire. This unique perspective allows us to understand both sides of this business. We take the time to ensure our consultants/candidates placed will be successful.
We believe that because of our principles we have succeeded where others have failed. The recruiting/technology space can be full of companies that are not really looking out for your interests - ask around ... we're not one of them! We want you to succeed, and we'll do everything we can to help you do just that!

Work arrangement
Yes