NYU Deep Learning SP21 - 02 – Neural nets: rotation and squashing

Course website: http://bit.ly/DLSP21-web Playlist: http://bit.ly/DLSP21-YouTube Speaker: Alfredo Canziani Chapters 00:00 – Welcome! 02:30 – Affine transformations and non-linearities 03:42 – Affine transformation: intuition 13:47 – Summary slide 14:06 – Jupyter and PyTorch 18:47 – Input data 24:39 – Coding a 2×2 linear transformation & Gilbert Strang 30:15 – Coding a 2×2 linear transformation w/ PyTorch 33:03 – Hyperbolic tangent 47:02 – Rotation + squashing + rotation: ooooh, a neural net 49:28 – Rectifying linear unit (ReLU) 51:10 – Shoutout to @vcubingx and his animation 52:09 – Spiky transformation: what happen here? 54:23 – A *very deep* neural net 56:30 – A deep net with tanh 56:43 – Summary of today lesson