Senior Software Engineer, Incident Lifecycle

The Developer Experience (DX) organization is seeking a Senior Software Engineer to join the Incident Lifecycle team. The Incident Lifecycle team builds software and workflows that help teams prepare for, respond to, and learn from incidents. Our work helps teams coordinate responses, reduce manual effort, and improve operational readiness. The team’s work includes supporting business continuity and disaster recovery, providing visibility into service reliability and service-level commitments, and facilitating communication among technical responders, customer-facing teams, and business teams during incidents. Making these systems reliable and easy to use when teams need them most is central to our engineering work. 

As a Senior Software Engineer, you’ll own work from end to end, from identifying operational needs to building, measuring, and operating the solution. You’ll work on problems that are not always well-defined, with room to explore options, make tradeoffs, and deliver improvements incrementally. You’ll build AI agents that connect production and observability tools to surface issues earlier, accelerate investigation and mitigation, automate routine tasks, and improve incident coordination. Working with teams across GitHub, you’ll help them adopt AI-assisted workflows that improve the speed, consistency, and quality of incident response. The team owns the systems it builds and participates in an on-call rotation to keep them reliable. 

• Design, build, and iteratively ship services, integrations, and workflows that help teams prepare for, coordinate, and learn from incidents, balancing delivery speed with long-term maintainability.

• Build AI skills, agents, and AI-assisted workflows that connect production and observability tools to help responders gather context, investigate issues, and reduce repetitive work, using feedback and outcomes to improve them over time.

• Drive sound architectural decisions and secure, resilient, high-quality systems through design proposals, prototypes, and code review.

• Communicate technical direction, progress, tradeoffs, and risks clearly, and help other engineers grow through mentoring and collaboration.

• Partner with responders, service teams, and stakeholders across GitHub to understand incident-response challenges and align on the problems worth solving.

• Improve how the right people are informed and involved during incidents, including technical, customer-facing, and business partners.

• Own the health of the systems the team builds, including participating in an on-call rotation and following through on improvements. 

• A bias for action: you take ownership, communicate clearly across roles, and move work forward 

• Curiosity and a growth mindset: you seek out unfamiliar problems and enjoy learning new tools, languages, and domains.

• Resilience in ambiguity: you remain effective when requirements are unclear or priorities shift.

• 3+ years of experience working remotely as part of a distributed software engineering team.

• Experience developing tools or products that integrate AI capabilities, particularly agents, skills or MCP servers, into production workflows.

• Experience building and operating production infrastructure on a major cloud platform, with exposure to infrastructure as code and container orchestration tooling.