AI Summary

The role involves establishing quality engineering best practices, defining testing strategies, and driving shift-left testing across product teams. You will also design automated test frameworks, validate complex enterprise workflows, and support the testing of AI-powered capabilities.

Test Engineering

Key Responsibilities

Quality Engineering Leadership

. Serve as a senior member of the engineering organization responsible for establishing

and promoting quality engineering best practices.

. Define quality standards, testing strategies, and automation frameworks across product

teams.

. Drive shift-left testing practices throughout the software development lifecycle.

. Participate in architecture, design, and requirements reviews to identify quality risks early.

. Mentor QA engineers and developers on testing and quality engineering practices.

. Advocate for continuous improvement and quality-first development culture.

Test Automation

. Design, develop, and maintain robust automated test frameworks and test suites.

. Implement automated testing across:

o Functional Testing

o API Testing

o Ul Testing

o Integration Testing

o Regression Testing

o Performance Testing

o Security Testing

. Integrate automated testing into CI/CD pipelines.

. Improve automation coverage and reduce manual testing effort.

. Analyze test failures and drive root-cause resolution.

Enterprise Application Testing

. Validate complex business workflows and enterprise application functionality.

. Develop comprehensive test plans, test cases, and test scenarios.

. Ensure requirements are testable and traceable throughout the development lifecycle.

. Perform exploratory, system, integration, and end-to-end testing.

. Verify software meets functional and non-functional requirements.

Cloud-Native Quality Assurance

. Test cloud-native applications running within Microsoft Azure.

. Validate reliability, scalability, resiliency, and fault-tolerance requirements.

. Verify integrations across distributed systems, APIs, messaging platforms, and databases.

. Ensure applications meet enterprise security, compliance, and operational standards.

. Participate in release validation and production-readiness assessments.

Al & Intelligent Application Testing

. Support testing of Al-powered product capabilities.

. Validate outputs from Generative Al and Large Language Model (LLM) integrations.

· Develop test strategies for:

o Al Chatbots

o Al Assistants

o Al Agents

o Retrieval-Augmented Generation (RAG) Solutions

o Intelligent Search Experiences

. Evaluate Al output quality, consistency, accuracy, and reliability.

. Support Responsible Al practices including fairness, transparency, and governance.

. Partner with Al engineers to establish Al evaluation methodologies and testing

Frameworks.

DevOps & Continuous Testing

. Integrate quality gates into CI/CD pipelines.

. Develop automated validation processes for software releases.

. Support infrastructure validation and deployment testing.

. Monitor quality metrics and test coverage.

. Contribute to DevSecOps and continuous delivery initiatives.

Required Qualifications

Education

. Bachelor's degree in Computer Science, Software Engineering, Information Technology, or

a related field.

. Equivalent professional experience will be considered.

Experience

. 7+ years of software quality assurance experience.

. 5+ years of hands-on automated testing experience.

. Experience supporting enterprise-scale software products.

. Experience working within Agile and Scrum delivery environments.

. Experience collaborating directly with development teams throughout the SDLC.

Required Technical Skills

Test Automation

Expertise in one or more of:

. Playwright

· Selenium

. Cypress

. Puppeteer

Experience with:

. Test automation architecture

. Automated regression testing

. CI/CD-based test execution

. Automated reporting and dashboards

API Testing

Experience with:

. REST APIs

. Postman

· Swagger/OpenAPI

. Automated API validation

. Contract testing

. Integration testing

Programming & Scripting

Hands-on experience with:

. C#

. .NET

. Python

. JavaScript / TypeScript

. PowerShell

Ability to develop maintainable automation frameworks and supporting utilities.

Performance & Security Testing

Experience with:

. Load testing tools

. Performance test design

. API performance validation

. Security testing fundamentals

. Vulnerability assessment processes

Microsoft Azure Experience

Working knowledge of:

. Azure App Services

. Azure Functions

. Azure Kubernetes Service (AKS)

. Azure SQL Database

. Azure Cosmos DB

· Azure Storage

. Azure API Management

. Azure DevOps

. Azure Monitor

. Application Insights

. Azure Entra ID

Ability to test applications operating in cloud-native Azure environments.

DevOps & CI/CD Experience

Experience with:

. Azure DevOps Pipelines

. GitHub Actions

. Automated build and deployment pipelines

. Test execution within CI/CD workflows

. Quality gates and release validation processes

Al Knowledge

Working knowledge of:

. Generative Al concepts

. Large Language Models (LLMs)

. Prompt engineering fundamentals

. Al-assisted software development

. Al quality evaluation techniques

. Al Agents and agentic workflows

. Retrieval-Augmented Generation (RAG)

. Azure OpenAl Service

. Azure Al Search

. Responsible Al principles

Understanding of the unique testing challenges associated with Al-generated outputs,

probabilistic systems, hallucinations, grounding, and Al governance.

Preferred Qualifications

. ISTQB Advanced Certification

. Certified Software Test Engineer (CSTE)

. Azure Fundamentals (AZ-900)

. Azure Developer Associate (AZ-204)

. Experience testing Al-enabled business applications.

. Experience testing distributed microservices architectures.

. Experience with containerized applications and Kubernetes.

. Experience implementing quality engineering practices in cloud-native environments.

Leadership Competencies

. Quality-first mindset

. Strong analytical and problem-solving skills

. Technical leadership and mentoring

. Attention to detail

. Risk assessment and mitigation

. Continuous improvement orientation

. Collaboration and teamwork

. Strong written and verbal communication

. Customer-focused thinking

Success Measures

. Increased automated test coverage

. Reduced production defects and escaped issues

. Improved release quality and deployment confidence

. Faster testing cycles and feedback loops

. Increased reliability and performance of Azure-hosted applications

. Successful validation of Al-powered capabilities

. Strong collaboration across engineering, product, and operations teams

. Continuous improvement of overall software quality metrics

Ideal Candidate Profile

The ideal Senior Quality Assurance Engineer combines strong software engineering and test

automation expertise with a passion for delivering exceptional product quality. They are

comfortable testing complex Azure-based enterprise applications, building scalable

automation frameworks, and helping teams confidently adopt Al-powered capabilities while

maintaining rigorous standards for reliability, security, performance, and user experience.

REMOTE

NOTE The ideal Senior Quality Assurance Engineer combines strong software engineering and test

automation expertise with a passion for delivering exceptional product quality. They are

comfortable testing complex Azure-based enterprise applications, building scalable

automation frameworks, and helping teams confidently adopt Al-powered capabilities while

maintaining rigorous standards for reliability, security, performance, and user experience.

Similar Jobs

See all Remote Others jobs →

Personalize your Remote Job Search in 3 Easy Steps!

Discover remote opportunities in Others

Answer easy questions

Answer easy questions

200,000+ jobs across 15+ categories

Get your best job matches

Get your best job matches

Only hand-screened, legit jobs

Find a remote job faster

Find a remote job faster

No ads, scams, or junk

I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!

Sarah J. — Sarah J. · Marketing Manager ★★★★★ Verified