Come keep one of the world's largest Apache Kafka fleets healthy, secure, and always on. On Amazon MSK, you will build the automation that maintains hundreds of thousands of streaming hosts, so customers never have to think about the infrastructure underneath their applications.
This is infrastructure engineering at a scale where every change has to be safe by design. MSK is stateful: every host holds customer data that must stay replicated and in sync, so routine maintenance is never as simple as rebooting or replacing a host. Patching, repairing, and replacing nodes across a fleet this size means coordinating each action against the availability guarantees customers depend on, so that maintenance stays invisible to them.
You will design and build the automation that does this, turning hard operational problems into systems that run themselves. If you enjoy distributed systems, large-scale automation, and work whose reliability countless streaming applications quietly depend on, this is a rare place to do it.
Key job responsibilities
- Design, build, and operate automation that patches and maintains hundreds of thousands of stateful hosts, keeping fleet maintenance invisible to customers.
- Build systems that automatically detect unhealthy hosts and remediate them, balancing fast recovery against avoiding needless disruption.
- Develop rollout and rollback mechanisms that keep the blast radius of any change small at fleet scale, and that let changes be tested before they reach customers and reversed if something goes wrong.
- Own your services end to end: take part in on-call, debug production issues, and continually reduce the manual effort needed to operate the fleet.
- Write design documents, collaborate with engineers across MSK, and raise the engineering bar through design and code reviews.
A day in the life
No two days look the same, but most blend building with operating. You might spend the morning designing a safer way to roll out a fleet-wide change, pairing with a teammate on the review, and writing the automation that carries it out. In the afternoon you might dig into a signal that a small set of hosts is unhealthy, trace it to root cause, and improve the automation so it handles that case on its own next time. You will write design documents, review your teammates' code, and steadily push routine operational work out of human hands and into systems that run themselves. When you are on call, you keep the fleet healthy and feed every manual step you take back into automation, so the same issue does not page anyone twice.
Our team keeps Amazon MSK's managed Kafka fleet healthy, secure, and available, so customers never have to think about the infrastructure beneath their streaming applications. People choose MSK because they want Apache Kafka without the burden of operating it. Our mission is to make that promise real at very large scale: keeping the fleet patched and secure, automatically recovering hosts that become unhealthy, and renewing the certificates that protect data in transit, all without interrupting the applications running on top.
We believe operations should be automated, not heroic. We invest in systems that detect and resolve problems on their own, so the team spends its time building durable automation instead of reacting to pages, and we are increasingly using generative AI to strengthen those mechanisms. You will build alongside teammates who jointly own these systems, and you will partner with the wider MSK engineering, product, and operations groups that depend on the fleet staying healthy as the service grows. Your work shapes the reliability every MSK customer feels, and you will have real ownership of meaningful problems from design through operation.
About the team
AWS values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.
Why AWS? Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.
Inclusive Team Culture Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon conferences, inspire us to never stop embracing our uniqueness.
Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.
Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.