One of the key bottlenecks in training capable code agents today is the environment the model is trained on. You can't RL your way to a better coding agent if your training rollouts are running against environments that don't actually reflect how software gets built, have flaky rewards, are prone to reward hacking, or rely on unreliable verification methodology.
We're building and improving ๐๐ถ๐ฟ๐ผ โ Amazon's next-gen AI coding agent โ and we're building ๐๐ฒ๐ฟ๐ถ๐ณ๐ถ๐ฒ๐ฑ (๐ฒ๐
๐ฒ๐ฐ๐๐๐ถ๐ผ๐ป-๐ฏ๐ฎ๐๐ฒ๐ฑ ๐ผ๐ฟ ๐ป๐ฒ๐๐ฟ๐ผ๐๐๐บ๐ฏ๐ผ๐น๐ถ๐ฐ) ๐ฅ๐ ๐ฒ๐ป๐๐ถ๐ฟ๐ผ๐ป๐บ๐ฒ๐ป๐๐ ๐ฎ๐ ๐๐ฐ๐ฎ๐น๐ฒ.
We're looking for someone excited about the problem. The strongest candidates have depth in at least one of:
๐ฃ๐ฟ๐ผ๐ด๐ฟ๐ฎ๐บ๐บ๐ถ๐ป๐ด ๐๐ฎ๐ป๐ด๐๐ฎ๐ด๐ฒ๐ / ๐ฆ๐ โ type systems, compilers, build systems, dependency analysis, program analysis
๐๐ฝ๐ฝ๐น๐ถ๐ฒ๐ฑ ๐๐๐ ๐ ๐ฎ๐ป๐ฑ T๐ฟ๐ฎ๐ถ๐ป๐ถ๐ป๐ด โ post-training, RLHF / RLVR / RLAIF, distillation, evaluation harnesses, agent scaffolds
๐ฅ๐ ๐๐๐บ ๐ฑ๐ฒ๐๐ฒ๐น๐ผ๐ฝ๐บ๐ฒ๐ป๐ โ Gymnasium, custom verifiers, reward design, sandboxing
๐ฆ๐ผ๐ณ๐๐๐ฎ๐ฟ๐ฒ ๐๐ป๐ด๐ถ๐ป๐ฒ๐ฒ๐ฟ๐ถ๐ป๐ด ๐ฎ๐ ๐๐ฐ๐ฎ๐น๐ฒ โ containerization, deterministic execution, CI/CD systems, hermetic builds
Key job responsibilities
๐ช๐ต๐ฎ๐ ๐๐ผ๐'๐น๐น ๐๐ผ๐ฟ๐ธ ๐ผ๐ป:
โข Designing verified RL environments built from real codebases and post training with these environments
โข Reward functions that survive Goodhart's law on F2P / P2P / mutation tests
โข Scaling environment generation pipelines that stay fresh against contamination
โข Publishing at NeurIPS / ICML / ICLR / ICSE / OOPSLA / ACL
About the team
The AWS Developer Agents and Experiences (DAE) team is reimagining the builder experience through generative AI and foundation models. We're leveraging the latest advances in AI to transform how engineers work from IDE environments to web-based tools and services, empowering developers to tackle projects of any scale with unprecedented efficiency.
Broadly, AWS Utility Computing (UC) provides product innovations โ from foundational services such as Amazonโs Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWSโs services and features apart in the industry. As a member of the UC organization, youโll support the development and management of Compute, Database, Storage, Internet of Things (Iot), Platform, and Productivity Apps services in AWS. Within AWS UC, Amazon Dedicated Cloud (ADC) roles engage with AWS customers who require specialized security solutions for their cloud services.
Why AWS?
Amazon Web Services (AWS) is the worldโs most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating โ thatโs why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.
Inclusive Team Culture
Here at AWS, itโs in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon conferences, inspire us to never stop embracing our uniqueness.
Mentorship & Career Growth
Weโre continuously raising our performance bar as we strive to become Earthโs Best Employer. Thatโs why youโll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.
Work/Life Balance
We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, thereโs nothing we canโt achieve in the cloud.
Hybrid Work
We value innovation and recognize this sometimes requires uninterrupted time to focus on a build. We also value in-person collaboration and time spent face-to-face. Our team affords employees options to work in the office every day or in a flexible, hybrid work model near one of our U.S. Amazon offices.
