The Data Engineer serves as a critical individual contributor responsible for enabling analytics for our daily operations. You are responsible for designing, automating, and maintaining scalable data solutions that drive operational efficiency and strategic decision-making. This role emphasizes cross-functional collaboration, architectural innovation, and delivering actionable insights through secure, high-quality datasets.
Key job responsibilities
- Work closely with the Business Intelligence Engineer to create robust data architectures, pipelines, and dashboards.
- Simplify and enhance the accessibility, clarity, and usability of datasets through the development of advanced BI dashboards and applications.
- Take ownership of the design, creation, and upkeep of metrics, reports, analyses, and dashboards to inform key business decisions.
- Navigate ambiguous environments by evaluating various options using both data-driven insights and business expertise.
- Develop data solutions using technologies such as Python, pandas, SQL, AWS Glue, Step Functions, Airtable, S3, QuickSight, Athena, CloudWatch, IAM, and Git.
- Create robust data models to manage and operationalize data.
- Design, implement, and maintain end-to-end data pipelines using APIs to integrate diverse data sources (Airtable, Quip, Slack) into S3-based data lake.
- Develop automated workflows via Step Functions, Glue, and Athena to streamline data ingestion, transformation, and delivery to QuickSight.
- Architect and optimize the data platform to ensure scalability, security, and accessibility for stakeholders.
- Collaborate with non-technical stakeholders to gather requirements and translate them into technical solutions.
- Provide technical guidance to peers and establish best practices for data engineering within the team.
- Implement data quality checks and governance protocols to maintain dataset accuracy and compliance with security standards.
A day in the life
As part of this nimble team, you'll roll up your sleeves and unlock your entrepreneurial spirit to tackle complex operational challenges, eliminate inefficiencies, and build solutions that create outsized impact. This team works to reduce bureaucracy, improve processes, and create mechanisms that work within our organization.
You will balance operational support (e.g., troubleshooting pipeline issues, cleaning data, answering questions regarding our data or data platform) with strategic projects like delivering datasets to support the creation of new dashboards and redesigning the data platform to support evolving business requirements.
About the team
Consistent with Amazon’s Leadership Principles that are core to the company, the ESU’s mission is to assemble a team of security industry professionals who provide unique and valuable services focused on prevention, deterrence, rapid response, and the safe resolution of high-consequence problems. We use data, customer feedback, and high judgement to be in the right place at the right time.
