How does Graph Mode Affect Quantization? FX Graph Mode Quantization Coding tutorial - Part 2/3

How does Graph Mode Affect Quantization? FX Graph Mode Quantization Coding tutorial - Part 2/3

326 Lượt nghe
How does Graph Mode Affect Quantization? FX Graph Mode Quantization Coding tutorial - Part 2/3
If you need help with anything quantization or ML related (e.g. debugging code) feel free to book a 30 minute consultation session! https://calendly.com/oscar-savolainen I'm also available for long-term freelance work, e.g. for training / productionizing models, teaching AI concepts, etc. *Video Summary:* In this video (part 2/3) we continue our work on doing FX Graph Mode quantization on a ResNet model. We investigate how qconfigs will be assigned via the qconfig mapper, as well as when the FX trace will opt to share requantization modules across graph nodes. *Timestamps:* 00:00 Intro 00:51 Back to coding 03:00 Assigning module-level QConfigs 06:20 Check which quantization modules are Learnable Fake Quantize 11:02 Shared quantization modules *Links:* Github for code: https://github.com/OscarSavolainen/Quantization-Tutorials/tree/main/Resnet-FX-Graph-Mode-Quant Connect on LinkedIn: https://www.linkedin.com/in/oscar-savolainen-phd-b88277121/