Senior Quality Assurance Automation Engineer

We are looking for a Senior AQA to join a skilled development squad. You will be joining a department of 70+ engineers across 8 squads, each with ownership for specific domains within our flagship SaaS based enterprise architecture product, OrbusInfinity. OrbusInfinity is at the forefront of AI-driven enterprise transformation – combining strategy, architecture, process, and portfolio management into a unified intelligence platform, with AI-driven features and a growing suite of AI agents via OrbusInfinity CoPilot. As we scale our AI services into production, quality engineering has never been more critical or more exciting. As part of the role, you will work closely within your squad alongside other Automation QAs, full-stack Developers, a dedicated Product Owner and Scrum Master, to ensure that high-quality solutions are produced to solve real user problems. We have well-established testing solutions – Functional UI Testing, API Integration Tests, UI Component Integration Tests, API Performance Tests and Unit Tests – and we are now extending these practices into AI service validation, LLM output testing, and agentic workflow quality assurance. As an Automation QA, you will be designing test scenarios and choosing the appropriate test solution to ensure high quality and repeatable testing of application components. We operate Scrum for day-to-day development, wrapped with quarterly strategic alignments. We follow leading practices: TDD, automated CI/CD, a “shift-left” testing mindset, and a focus on S.O.L.I.D maintainable code. We also embrace AI-assisted development workflows – from AI-augmented code review to agent-assisted test generation – and we expect our senior engineers to lead the way in adopting and shaping these practices. We have Communities of Practice (Guilds) covering architecture, quality, agile practices, and DevOps. As a Microsoft Gold partner we benefit from early access to the latest tooling. We host regular Tech Talks and Knowledge Sharing cross-team – and our QA Guild is actively building out best practices for AI quality engineering. If this sounds like you, we’d love to hear from you. The role is fully remote, with some office time encouraged during onboarding along with the rest of the team to get some face time both in the office and socially. Core Responsibilities:

• Working in a Scrum Squad of 3-4 other Developers and 1 other Automation QA
• Following and maintaining established QA best practices within the squad
• Collaborating with the Product Owner and Squad to refine Stories and Acceptance Criteria, including criteria for AI-driven features
• Collaborating with the squad to design and review test scenarios and develop C# Integration Tests, React tests in Playwright, Contract Tests (Pact) and UI Functional Tests in C# with Playwright
• Quickly identifying high-level test strategies and quality risks, including those unique to AI/ML systems (hallucination, drift, latency)
• Monitor and report on quality trends such as bug churn
• Leveraging AI tooling (e.g. GitHub Copilot, AI test generation tools) to accelerate test authoring and analysis
• Analyze automation test run results
• Adhering to existing coding standards and practices
• Partaking in code review culture and technical collaboration
• Attending squad meetings such as daily Stand-ups, Retrospectives, Planning, Refinements, and technical discussions
• Partaking in presentations and code workshops

Essential:

• 5+ years in a Quality Assurance role
• C# .Net/Net Core – 3+ years
• Typescript knowledge
• API Integration Test experience supporting regular production releases
• Functional UI Test experience with Playwright
• Excellent testing fundamentals, such as test design, defect management and high attention to detail
• Understanding of object-oriented programming (OOP) and S.O.L.I.D principles
• Experience with Scrum and development in an agile environment
• Understanding of CI/CD processes that support automated testing
• Demonstrated use of AI tools in day-to-day engineering work (e.g. AI-assisted coding, test generation, or analysis)

Desirable:

• Experience testing AI services or LLM-powered features in a production environment
• Familiarity with AI agent frameworks (e.g. AutoGen, LangChain, Semantic Kernel) and understanding of agentic system behaviours
• Awareness of non-deterministic testing strategies: probabilistic assertions, golden-set evaluation, adversarial prompt testing
• Playwright, React exposure
• Experience working on an existing production SaaS platform
• Azure familiarity
• Exposure to Micro-frontends and Microservices
• Confidence with git and branching

Orbus Tech Stack/Environment:

• Development for modern browsers
• .NET 10 / C#
• React, Typescript, HTML, SASS
• SQL Server (T-SQL), CosmosDB
• MSTEST v2, XUnit, Mock, NSubstitute, Jest, Playwright
• Azure DevOps with Git, and CI/CD pipelines in YAML
• IAC (ARM, Helm, Terraform)
• Containers, Kubernetes
• Azure native technologies (i.e. App Services, Functions etc.)
• AI/ML tooling: Azure OpenAI, Semantic Kernel, LLM evaluation frameworks

What’s in it for you!

• A massive opportunity for you to develop your skills and knowledge in a supportive environment that thrives on growth and change.
• An opportunity to develop skills in AI quality engineering, a rapidly growing discipline
• Competitive salary and benefits (in line with experience)
• Fully remote working policy or the option to work hybrid model
• Curious, open culture, with teams collaborating across geographies

Apply To This Job