This is a remote position.

Job Description:

• Design and execute test plans and test cases for AI/LLM-based applications

• Perform functional, regression, and performance testing for AI models and LLM integrations

• Validate prompt engineering techniques to ensure accurate and relevant model outputs

• Identify, track, and report defects in AI behavior and LLM responses

• Collaborate with AI/ML engineers to analyze model limitations and improve quality

• Develop automated testing frameworks for AI workflows and output validation

• Monitor model performance metrics such as accuracy, relevance, bias, and reproducibility

• Stay updated on the latest trends in AI/LLM testing and best practices

Required Skills:

• 5–6 years of experience in software testing, including 2+ years in AI/ML or LLM testing

• Strong understanding of Large Language Models (LLMs) and evaluation methods

• Hands-on experience in prompt engineering and generative AI output validation

• Familiarity with AI testing frameworks and model validation techniques

• Proficiency in Python, Java, or similar scripting languages

• Experience with automation tools like Selenium or PyTest is a plus

• Strong analytical, problem-solving, and documentation skills

Preferred Qualifications:

• BE / BTech / MCA

• Experience with AI models, NLP applications, or generative AI platforms

• Knowledge of AI ethics and responsible AI testing practices

Indium

Employees 5,001-10,000 employees Industry IT Services and IT Consulting

View More Jobs From Indium

Indium

Team Lead