AI QA Engineer

 Posted 2 hours ago
     
2-5 years experience
Apply Now

Please mention DailyRemote when applying

AI Summary

The role involves evaluating AI agent conversations for accuracy and alignment with customer experience while performing structured manual QA during release cycles. Additionally, the engineer will improve automated test coverage and investigate production issues to distinguish between configuration errors and genuine defects.

Job title: AI QA Engineer
Type: Full-time, Contract running until September
Location: Anywhere in the EU | Flexible remote, hybrid, or office working

The role

We’re looking for a QA Engineer to work across product quality, AI behaviour evaluation, and defect investigation.

This is not a traditional QA role focused purely on scripted testing or automation. A key part of the role involves reviewing AI agent conversations and assessing whether responses were accurate, appropriate, and aligned to the expected customer experience. Because AI behaviour is not always deterministic, strong judgement, attention to detail, and communication skills are essential.

You’ll support release testing and regression prevention across the platform, carrying out structured manual QA across key journeys during release cycles to improve release confidence and reduce production issues. Outside release periods, you’ll help improve automated coverage, refine QA processes, and investigate product or AI-related issues raised internally.

You’ll also investigate production and customer-reported issues, identifying whether problems are expected behaviour, configuration issues, or genuine defects before escalating clear issues to engineering teams.

Required experience

  • Strong manual QA experience

  • Experience building or maintaining automated test coverage

  • Experience working with AI, LLM, or agentic products as part of your day-to-day workflow

  • Strong written English and communication skills

  • The ability to assess nuanced conversations and provide clear feedback

  • Confidence investigating issues independently and making sound judgement calls

Desirable experience

  • Experience working with AI tooling, agent frameworks, or conversational AI platforms is a plus


What you’ll get

  • A varied role combining QA, AI evaluation, automation improvement, and product investigation rather than repetitive manual testing.

  • The opportunity to work on AI-driven products where quality depends on judgement and context, not just predefined test cases.

  • Real ownership over how quality processes evolve as AI capabilities continue to grow.

  • Exposure to modern AI and agentic systems in a production environment.

  • The chance to work closely with Product, Engineering, and AI teams on complex problems where there often isn’t a single correct answer.

About hedgehog lab

We’re a digital product consultancy with 20 years of experience, helping organisations solve complex problems through technology, design, and delivery.


Ready to apply?

Submit your application below.

Please note: we're unable to offer visa sponsorship for this role.

Similar Jobs

See all Remote Software Development jobs →

Personalize your Remote Job Search in 3 Easy Steps!

Discover remote opportunities in QA Engineer

Answer easy questions

Answer easy questions

200,000+ jobs across 15+ categories

Get your best job matches

Get your best job matches

Only hand-screened, legit jobs

Find a remote job faster

Find a remote job faster

No ads, scams, or junk

I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!

Sarah J. — Sarah J. · Marketing Manager ★★★★★ Verified