Senior Tester (AI)

About Us
We are a well-established and trusted health economy partner, saving millions for reinvestment in health and social care through our Workforce, Financial, Care and Specialty Transformation businesses.
We are dedicated to improving the health economy through expert advisors, established technology, and best practice process improvement. Our work has also been recognised with numerous HR and Finance industry awards.
As a base all our employees work from the comfort of their own home. We now have over 400 employees based across the length and breadth of the UK, enjoying the flexibility of working remotely.
We are proud to say that we are currently the:
#1 Best Large Company To Work For in the UK
#1 Best Consultancy To Work For in the UK
We are a 3-star (out of 3) rated company by Best Companies, recognising Liaison Group as a 'World-class Company to Work For'.
Job Summary
We're looking for a talented Senior Tester (AI) to play a key role in the implementation, testing, and continuous improvement of Liaison Care's innovative AI-powered products. Working closely with developers, product owners, and stakeholders, you'll ensure our AI solutions are robust, reliable, and deliver an outstanding user experience.
You'll lead both manual and automated testing activities, help drive quality throughout the development lifecycle, and champion best practices including test-driven development.
PRINCIPAL TASKS & ACTIVITIES
Continuously adopt proven AI testing strategies, techniques and industry best practices, proactively improving the quality, reliability, safety and performance of AI-powered solutions.
Undertake test planning activities for Agile deliveries.
Add test scripts and maintain Automated test framework.
Plan own workload and scope/requirements.
Analyse functional and technical specifications and user stories to derive test cases and scenarios.
Participate in document and peer reviews.
Agree test scope and scenarios with key stakeholder/clients.
Identify issues and risks relating to workload, escalate these appropriately and provide suggested mitigating actions.
Review own test conditions, test scripts / user stories, input test data, and expected results for all test phases.
Effectively prepare regression, ad hoc and re-tests as required.
Ensure software meets functional and non-functional requirements.
Write test cases and document results in accordance with company standards.
Maintain comprehensive and auditable test documentation to support regulatory compliance, including requirement for medical device standards where applicable.
Help refine user stories by working with the product owner and developers.
Experience
Essential:
Experience of testing and evaluating non-deterministic AI systems using statistical and dataset-based techniques to assess quality, reliability, accuracy and performance.
Experience testing Generative AI or Copilot solutions.
Knowledge of AI security testing and red-teaming practices, including OWASP LLM Top 10 style risks.
Familiarity with common AI failure modes, including hallucination, retrieval failures, grounding issues, prompt injection, safety concerns, model drift and regression following prompt or model changes.
Previous experience in web-based Software and API testing.
Experience testing products that process highly sensitive data, for example NHS Patient Identifiable Data.
Experience in, and understanding of, the software development process, preferably in a web based (SAAS) environment.
Knowledge and practical experience of test tools and industry standard best practice.
Knowledge or experience of the agile development processes (e.g. Scrum).
Desirable:
Experience of Microsoft's AI evaluation and testing tools.
Experience testing RAG and agent-based solutions
Experience performing bias, safety and security testing
Experience testing Power Apps, Power Automate, Copilot Studio agents.
Experience testing and validating data across Microsoft Fabric, SQL, Cosmos and Dataverse, including processes, integrations and end-to-end data flows.
Experience working with the NHS or within the health technology sector.
Working knowledge of Test Automation (e.g. Copilot Studio Agents Evaluations, Playwright (C#), Cucumber, Selenium, Appium).
Experience using Azure DevOps.
Skills & Competencies
Ability to work in a dynamic and fast paced environment.
Highly motivated self-starter.
Strong verbal and written communication skills.
Ability to work within an agile team and communicate detailed feedback to developers constructively.
Good attention to detail.
Be self-motivated and inquisitive, able to work independently.
Qualifications & Training
Essential:
ISTQB Foundation Level Certification
BSc in Computer Science or equivalent.
Desirable:
ISTQB CT-AI
Microsoft AI-900: Azure AI Fundamentals.
Microsoft AI-102: Azure AI Engineer.
OUR VALUES
You will be expected to demonstrate Liaison's core values: Care, Honesty, Inspire and Guide, and embody our behaviours-be present, choose your attitude, make someone's day, and have fun.
FURTHER INFORMATION
We are proud to support our colleagues and will offer an interview to any candidate with a disability, should they match the skills and experience required for the role.
Liaison Group is committed to creating a diverse and inclusive environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment regardless of race, colour, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. We pride ourselves on being a place where we can all be ourselves and succeed on merit.
Liaison Group are committed to the Good Recruitment Campaign and are official signatories for the Good Recruitment Charter.
We reserve the right to close this vacancy early if we receive a high volume of applications.
Thank you for your interest in joining Liaison Group
If you have any questions or require any further information, please feel free to contact us at jobs@liaisongroup.com.

Work arrangement
Yes