AI Innovation Center Software Development Engineer

About the Job:

This role offers an opportunity to innovate at the forefront of AI, tackling end-to-end LLM training pipelines at massive scale and delivering next-generation AI solutions for top Amazon clients.

As a software development engineer in our Generative AI Innovation Center, you will drive the development of custom Large Language Models (LLMs) across languages, domains, and modalities.

You will be responsible for fine-tuning state-of-the-art LLMs for diverse use cases while optimizing models for high-performance deployment on AWS's custom AI accelerators.

Key Responsibilities:

Design and implement scalable and efficient training pipelines for LLMs using FSDP and DeepSpeed.

Customize LLMs for new languages, domains, and vision applications through continued pre-training, fine-tuning, and RLHF.

Optimize AI models for deployment on AWS Inferentia and Trainium, leveraging the AWS Neuron SDK and developing custom kernels.

Collaborate with customers and foundational model providers to develop tailored generative AI solutions.

About Us:

Amazon is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating.

Our inclusive culture empowers Amazonians to deliver the best results for our customers.