Course Hive
Search

Welcome

Sign in or create your account

Continue with Google
or
New course with Hugging Face: Quantization in Depth 🤗
Play lesson

DeepLearning.AI Courses - New course with Hugging Face: Quantization in Depth 🤗

5.0 (2)
18 learners

What you'll learn

This course includes

  • 5.5 hours of video
  • Certificate of completion
  • Access on mobile and TV

Summary

Full Transcript

Enroll now: https://bit.ly/44nXDNa We’re excited to introduce Quantization in Depth, a new short course built in collaboration with Hugging Face, taught by Younes Belkada and Mark Sun, and designed to provide a deep technical understanding of quantization. This course lets you build and customize your own linear quantizer from scratch, going beyond standard open source libraries such as PyTorch and Quanto, which were the focus of our previous course, Quantization Fundamentals. Join in to: - Implement and customize linear quantization from scratch, trading off between space and performance, and choosing between two "modes:" asymmetric and symmetric; and three granularities: per-tensor, per-channel, and per-group quantization. - Measure the quantization error of each of these options as you balance the performance and space tradeoffs for each option. - Build your own quantizer in PyTorch, to quantize any open source model's dense layers from 32 bits to 8 bits. - Go beyond 8 bits, and pack four 2-bit weights into one 8-bit integer, and also, learn to unpack them. Quantization in Depth gives you the foundation to study more advanced quantization methods, some of which are recommended at the end of the course. Learn more: https://bit.ly/44nXDNa

Course Hive

Continue this lesson in the app

Install CourseHive on Android or iOS to keep learning while you move.

Related Courses

FAQs

Course Hive
Download CourseHive
Keep learning anywhere