Microsoft

Experiment Management, Tuning & Debugging

Ends soon! Get $70+ in savings and build skills with Coursera Plus. Save 40% for 3 months.

Microsoft

Experiment Management, Tuning & Debugging

 Microsoft

Instructor: Microsoft

Included with Coursera PlusLearn more

Gain insight into a topic and learn the fundamentals.
Advanced level

Recommended experience

1 hour to complete
Flexible schedule
Learn at your own pace
Gain insight into a topic and learn the fundamentals.
Advanced level

Recommended experience

1 hour to complete
Flexible schedule
Learn at your own pace

What you'll learn

  • Apply LoRA and QLoRA fine-tuning to large language models using Hugging Face PEFT, comparing VRAM usage, throughput, and task performance.

  • Design and execute hyperparameter optimization sweeps on Azure ML using Bayesian sampling, early termination, and MLflow experiment tracking.

  • Diagnose training failure modes, including gradient explosion, overfitting, and normalization errors, using PyTorch Profiler and ablation studies.

  • Build high-throughput data pipelines using WebDataset, LMDB, and Azure ML Data Assets to eliminate I/O bottlenecks and maximize GPU utilization.

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

1 assignment¹

AI Graded see disclaimer
Taught in English

See how employees at top companies are mastering in-demand skills

 logos of Petrobras, TATA, Danone, Capgemini, P&G and L'Oreal

Build your Machine Learning expertise

This course is part of the Microsoft Deep Learning Engineering with Azure Professional Certificate
When you enroll in this course, you'll also be enrolled in this Professional Certificate.
  • Learn new concepts from industry experts
  • Gain a foundational understanding of a subject or tool
  • Develop job-relevant skills with hands-on projects
  • Earn a shareable career certificate from Microsoft

There is 1 module in this course

Synthesize your model-tuning and experiment-management skills to engineer an automated, memory-efficient fine-tuning pipeline. You will write a Python script that loads a large foundation model in 4-bit precision, configures Low-Rank Adaptation (LoRA) target modules, and instruments a custom training loop with MLflow metric tracking. You will then write the Azure ML SDK v2 configuration code to orchestrate a distributed hyperparameter sweep over your pipeline, utilizing a Bandit early stopping policy to optimize compute cluster resource allocations.

What's included

2 readings1 assignment

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.

Instructor

 Microsoft
424 Courses2,859,128 learners

Offered by

Microsoft

Why people choose Coursera for their career

Felipe M.

Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."

Jennifer J.

Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."

Larry W.

Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Frequently asked questions

¹ Some assignments in this course are AI-graded. For these assignments, your data will be used in accordance with Coursera's Privacy Notice.