Every dollar spent on AWS passes through our pipelines. We're looking for a Senior Software Development Engineer to build and optimize the distributed systems that process cost and usage data at massive scale — with the goal of delivering it to customers within minutes. You'll work on batch and streaming pipelines that are the foundation for AWS Cost Explorer, Budgets, Cost Anomaly Detection, and more, tackling hard problems in data freshness, query performance, and cost efficiency using technologies like Spark and EMR.
Key job responsibilities
- Design and implement large-scale distributed data processing systems handling trillions of records
- Build and optimize batch and streaming pipelines for throughput, latency, and cost efficiency
- Drive technical decisions on architecture, data modeling, and system design
- Mentor engineers, lead design reviews, and contribute to team-wide engineering standards
- Own operational excellence for your systems — including monitoring, alarming, runbooks, and on-call
- Collaborate with product, science, and partner teams to deliver customer-facing features
A day in the life
You'll spend your time deep in the code — designing, building, and optimizing the distributed systems that deliver cost and usage data to AWS customers. On any given day you might be profiling a Spark job on EMR to cut processing time, working with teammates to reduce end-to-end data freshness from hours to minutes, or finding ways to serve the same workloads at lower infrastructure cost. You'll collaborate closely with partner teams across Billing, AWS, and product managers and service owners to ensure the data customers see is accurate, timely, and complete. This is a hands-on engineering role where you're both shipping code and helping the engineers around you ship better code.
About the team
Few teams at AWS touch every single customer. AWS Insights Data Services is one of them. We process and allocate cost management data at massive scale — quadrillions of billing data points, trillions of records, and petabytes of storage. Our batch and streaming systems are the foundation for Cost Explorer, Cost and Usage Reports (CUR), Budgets, Cost Anomaly Detection, RI/SP Coverage and Utilization, Recommendations, and Forecasting. Our ambition: deliver cost visibility to customers within minutes.
