Distributed Training & Advanced Application

Ends soon! Get $70+ in savings and build skills with Coursera Plus. Save 40% for 3 months.

Distributed Training & Advanced Application

This course is part of Microsoft Deep Learning Engineering with Azure Professional Certificate

Instructor: Microsoft

Included with Learn more

Intermediate level

Recommended experience

Flexible schedule

Learn at your own pace

Intermediate level

Recommended experience

Flexible schedule

Learn at your own pace

What you'll learn

Build PyTorch DDP and FSDP pipelines for multi-node distributed training, profiling communication overhead, and scaling GPU throughput.
Configure DeepSpeed ZeRO optimization stages and apply Microsoft Olive and Azure Container for PyTorch to accelerate large model training.
Build computer vision and NLP pipelines for object detection, NER, classification, and QA using Florence-2, CLIP, and Hugging Face Transformers.
Design multimodal fusion architectures combining vision, text, and audio using Microsoft Phi-4 and OpenAI Whisper on Azure ML.

Details to know

Shareable certificate

Add to your LinkedIn profile

Taught in English

See how employees at top companies are mastering in-demand skills

Learn more about Coursera for Business

logos of Petrobras, TATA, Danone, Capgemini, P&G and L'Oreal

Build your Machine Learning expertise

This course is part of the Microsoft Deep Learning Engineering with Azure Professional Certificate

When you enroll in this course, you'll also be enrolled in this Professional Certificate.

Learn new concepts from industry experts
Gain a foundational understanding of a subject or tool
Develop job-relevant skills with hands-on projects
Earn a shareable career certificate from Microsoft

Explore more from Machine Learning

Microsoft
Model Optimization, Inference & End-to-End Engineering
Course
Microsoft
Deep Learning Foundations & Azure Environments
Course
Microsoft
Launch Your Deep Learning Career
Course
Microsoft
Core Neural Architectures & Generative Models
Course

Why people choose Coursera for their career

Felipe M.

Learner since 2018

"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."

Jennifer J.

Learner since 2020

"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."

Larry W.

Learner since 2021

"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Break down barriers to learning with big savings
Get Coursera Plus
Start with easy savings for hard-working teams
Save 30% today

Frequently asked questions

To access course materials, assignments, and earn a Certificate, you'll need to purchase the Certificate experience when you enroll in a course. Eligible learners may also have the option to start with a Free Trial. Some courses may also offer a Full Course, No Certificate option. This lets you access course materials, submit required assessments, and receive a final grade, but you won't be able to earn or purchase a Certificate.

When you enroll in the course, you get access to all of the courses in the Certificate, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.