Senior Test Analyst - AI Projects | Brisbane CBD | Hybrid Working | $1,000 - $1,200 + GST per day | Initial 12-Month Contract (with strong extension potential)

About The Company

I'm currently partnering with a large Brisbane organisation undergoing a significant AI transformation and looking for a Senior AI Test Analyst to join a growing team delivering a portfolio of AI-focused initiatives.

This is a unique opportunity to work across multiple projects leveraging Agentic AI, helping ensure solutions are robust, reliable, and fit for purpose before being rolled out to end users. You'll play a key role in testing AI-driven applications, validating outputs, identifying risks, and contributing to the delivery of responsible AI solutions at scale.

About The Role

You'll be involved across the full testing lifecycle, working closely with delivery teams, developers, architects and business stakeholders to ensure AI solutions meet both technical and business requirements.

You'll be responsible for designing and executing testing strategies across AI-enabled solutions, ensuring functionality, reliability and quality throughout the delivery lifecycle. The role will involve evaluating AI-generated outputs, conducting exploratory testing to identify edge cases, and validating AI components across integrated systems and end-to-end workflows.

You'll also perform API and integration testing, manage defects through to resolution, contribute to test planning and acceptance criteria, and provide clear reporting on test outcomes, risks and recommendations.

Skills

• Demonstrated Experience as a Test Analyst in complex system environments.
• Demonstrated Hands-on experience testing AI, data-driven, or machine learning-based systems.
• Hands-on experience with agentic AI systems and autonomous behaviour testing.
• Familiarity with agentic frameworks such as LangChain, CrewAI, and AutoGen.
• Knowledge of AI-specific risks including bias, hallucinations, and explainability.
• Experience with observability tools like Langfuse, Maxim AI, and Arize AI.
• Exposure to prompt engineering and scenario-based testing methodologies.
• Effective use of tools like JIRA, Zephyr Scale, Confluence, and CI/CD pipelines.

This role would suit someone who enjoys working on emerging technologies and wants to be part of one of the more innovative AI programs currently being delivered in the Brisbane market.

**deadline for applications Thursday 4th June**

Senior Test Analyst - AI Projects | Brisbane CBD | Hybrid Working | $1,000 - $1,200 + GST per day | Initial 12-Month Contract (with strong extension potential)