Are you interested in building Agentic AI solutions that solve complex builder experience challenges with significant global impact? The Security Tooling team designs and builds high-performance AI systems using LLMs and machine learning that identify builder bottlenecks, automate security workflows, and optimize the software development lifecycle—empowering engineering teams worldwide to ship secure code faster while maintaining the highest security standards.
As a Data Scientist on our Security Tool team, you will focus on building state-of-the-art ML models to enhance builder experience and productivity. You will identify builder bottlenecks and pain points across the software development lifecycle, design and apply experiments to study developer behavior, and measure the downstream impacts of security tooling on engineering velocity and code quality. Our team rewards curiosity while maintaining a laser-focus on bringing products to market that empower builders while maintaining security excellence. Competitive candidates are responsive, flexible, and able to succeed within an open, collaborative, entrepreneurial, startup-like environment. At the forefront of both academic and applied research in builder experience and security automation, you have the opportunity to work together with a diverse and talented team of scientists, engineers, and product managers and collaborate with other teams. This role offers a unique opportunity to work on projects that could fundamentally transform how builders interact with security tools and how organizations balance security requirements with developer productivity.
Key job responsibilities
Design and run rigorous experiments to evaluate and improve security tooling performance, builder experience, and adoption across hundreds of thousands of builders, multiple security tools, and diverse business verticals.
Lead the end-to-end lifecycle of data science and ML models — from research and experimentation through production launch — including defining success metrics, obtaining stakeholder sign-off, and managing rollout.
Conduct online and offline analyses to measure the real-world impact of security tooling improvements beyond adoption metrics, including downstream effects on vulnerability resolution, builder productivity, and organizational security posture.
Develop and deploy production-grade machine learning and statistical models using Python, SQL, and related tools to automate insights, detect patterns, and drive decision-making across STF's security tool ecosystem.
Perform large-scale exploratory data analysis on builder feedback, ticket resolution, tool usage, and customer satisfaction data to uncover patterns, identify opportunities, and inform product and tooling decisions.
Translate complex research findings into clear insights and recommendations for technical and non-technical stakeholders at all levels, including STF leadership metric reporting and customer satisfaction publications.
Contribute to Amazon's scientific community and the broader research field through collaboration and publication in top-tier venues.
A day in the life
Morning
- Review overnight pipeline health — nudge systems, ticket classification models, and adoption dashboards running as expected
- Join daily standup with the SDI team to align on priorities and flag blockers
- Dive into exploratory analysis — investigating a spike in unresolved tickets or segmenting builder feedback to understand adoption gaps
Midday
- Partner with security tool owners (e.g., Shepherd, Talos, Scorecard) to review experiment results — did the latest nudge improve resolution rates?
- Translate findings into actionable recommendations for leadership reviews or WBR updates
- Analyze CSAT survey data to surface emerging dissatisfaction themes
Afternoon
- Write production code — building features for the classification pipeline, optimizing SQL for the metrics scorecard, or iterating on a model for predicting resolution timelines
- Collaborate with STF stakeholders to define success metrics for an upcoming model launch
- Document findings, update trackers, and queue next steps
About the team
Diverse Experiences
Amazon Security values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.
Why Amazon Security?
At Amazon, security is central to maintaining customer trust and delivering delightful customer experiences. Our organization is responsible for creating and maintaining a high bar for security across all of Amazon’s products and services. We offer talented security professionals the chance to accelerate their careers with opportunities to build experience in a wide variety of areas including cloud, devices, retail, entertainment, healthcare, operations, and physical stores.
Inclusive Team Culture
In Amazon Security, it’s in our nature to learn and be curious. Ongoing DEI events and learning experiences inspire us to continue learning and to embrace our uniqueness. Addressing the toughest security challenges requires that we seek out and celebrate a diversity of ideas, perspectives, and voices.
Training & Career Growth
We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, training, and other career-advancing resources here to help you develop into a better-rounded professional.
Work/Life Balance
We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why flexible work hours and arrangements are part of our culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve.
