Quality Assurance Analyst - Conversational AI Testing

 Posted an hour ago
     
5-10 years experience
Apply Now

Please mention DailyRemote when applying

AI Summary

Define and execute comprehensive test strategies for a conversational AI platform, covering functional, performance, and usability testing. Collaborate with developers to optimize AI models and manage the end-to-end User Acceptance Testing process.
Summary
We are seeking a skilled Quality Assurance Analyst to join our team and support testing activities for Kore AI's conversational AI platform. The ideal candidate will have a strong background in software testing, with a focus on AI and natural language processing technologies. The resource will report to the Senior Director, Analysis, Change & Quality and will follow the best practices and standard operating procedures established by the quality assurance team.


Responsibilities
  • Define functional and non-functional test strategies for the conversational AI platform.
  • Collaborate with AI developers and product owner to design comprehensive test cases covering various user scenarios, edge cases, and potential failure points.
  • This is a Remote (work from home) position.
  • Conduct rigorous testing of conversational AI models, including:
    • Functional testing to verify correct behavior, assess the accuracy, relevance, and coherence of AI-generated responses.
    • Performance testing to evaluate response times, system load, and resource utilization.
    • Usability testing to assess the user experience and identify areas for improvement.
    • Coordinate security testing with the Information Technology Security team to identify and mitigate potential vulnerabilities.
    • Integration testing to ensure the product is integrated with various platforms and that data integrity is maintained between various back-end systems.
    • Coordinate with cross-functional quality assurance resources to conduct end to end testing between other systems/platforms.
  • Generate detailed reports on test executions, including bug reports, performance metrics, and user experience insights.
  • Analyze test results to identify trends, patterns, and areas requiring improvement and work with the product owner for prioritization in the product backlog.
  • Track and manage bug resolution and feature enhancements.
  • Provide actionable feedback to AI developers to improve model performance, accuracy, and user satisfaction.
  • Collaborate with the team to refine training data, adjust model parameters, and optimize algorithms.
  • Own User Acceptance Testing (UAT) and facilitate by providing demos and test data of the product to the UAT testers.
  • Keep up to date with the latest developments in conversational AI, natural language processing, and machine learning.
  • Research and explore new testing methodologies and tools to enhance the QA process.

Requirements
  • Bachelor’s degree in computer science, information technology, or related field.
  • At least 5 years of experience in software testing and quality assurance methodologies.
  • Knowledge of AI and machine learning concepts, particularly in natural language processing.
  • Expertise in testing conversational AI or chatbot systems.
  • Excellent analytical and problem-solving abilities.
  • Strong communication and collaboration skills.

Preferred Qualifications
  • Experience in testing Chatbots such as Microsoft Bot and Kore AI platform.
  • Certifications in software testing or AI (e.g., ISTQB, AI Testing certification).

 

Similar Jobs

See all Remote Software Development jobs →

Personalize your Remote Job Search in 3 Easy Steps!

Discover remote opportunities in Software Development

Answer easy questions

Answer easy questions

200,000+ jobs across 15+ categories

Get your best job matches

Get your best job matches

Only hand-screened, legit jobs

Find a remote job faster

Find a remote job faster

No ads, scams, or junk

I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!

Sarah J. — Sarah J. · Marketing Manager ★★★★★ Verified