Auto Differentiation

Intro to Automatic Differentiation

In this blog, we will go through the foundations behind Automatic Differentiation.

The Breakdown of The Video Into Parts

Introduction Topic 1 - Diff in ML Topic 2 - Numerical Diff Topic 2 - Gradient Checking Topic 3 - Symbolic Diff Topic 4 - Computational Graphs Topic 5 - Forward Automatic Diff Topic 6 - Reverse Auto Diff Topic 6 - Reverse AD Algorithm Topic 7 - RAD vs Backprop

Important Transcripts of the Video