Knowledge Graph — Coursera Notes › Academic disciplines › Computer Science / Information Technology › Artificial Intelligence › Machine Learning & Data

Model Optimization

concept · part of Machine Learning & Data

Techniques to improve machine learning model efficiency and performance, such as pruning and quantization.

Inside Model Optimization (3)

• Knowledge Distillation — A model optimization technique where a smaller student model is trained to mimic a larger teacher model, reducing complexity while retaining performance.
• Pruning — Removing redundant weights from a neural network to make it smaller and faster.
• Quantization — Reducing numeric precision from 32-bit float to 16-bit or 8-bit integer for faster inference with minimal accuracy loss.

Connections

• Uses Pruning
• Uses Quantization
• Related to Pruning
• Related to Quantization

This is the text view of an interactive 3D knowledge graph — open this page with JavaScript enabled to explore it visually.