Please mention DailyRemote when applying
AI Summary
Design and execute test plans for AI/LLM-based applications, focusing on prompt engineering and model output validation. Collaborate with engineers to identify defects and develop automated testing frameworks to monitor model performance metrics.
This is a remote position.
Job Description:
• Design and execute test plans and test cases for AI/LLM-based applications
• Perform functional, regression, and performance testing for AI models and LLM integrations
• Validate prompt engineering techniques to ensure accurate and relevant model outputs
• Identify, track, and report defects in AI behavior and LLM responses
• Collaborate with AI/ML engineers to analyze model limitations and improve quality
• Develop automated testing frameworks for AI workflows and output validation
• Monitor model performance metrics such as accuracy, relevance, bias, and reproducibility
• Stay updated on the latest trends in AI/LLM testing and best practices
Required Skills:
• 5–6 years of experience in software testing, including 2+ years in AI/ML or LLM testing
• Strong understanding of Large Language Models (LLMs) and evaluation methods
• Hands-on experience in prompt engineering and generative AI output validation
• Familiarity with AI testing frameworks and model validation techniques
• Proficiency in Python, Java, or similar scripting languages
• Experience with automation tools like Selenium or PyTest is a plus
• Strong analytical, problem-solving, and documentation skills
Preferred Qualifications:
• BE / BTech / MCA
• Experience with AI models, NLP applications, or generative AI platforms
• Knowledge of AI ethics and responsible AI testing practices
Automatically Apply to the Best Remote Jobs
Stop the endless job search. Our AI finds and applies to the best jobs for you.
