NYU Deep Learning SP21 - 08 – From LV-EBM to target prop to (vanilla, denoising, contractive, variational) autoencoder

Course website: http://bit.ly/DLSP21-web Playlist: http://bit.ly/DLSP21-YouTube Speaker: Alfredo Canziani Chapters 00:00 – 2021 edition disclaimer 00:49 – Conditional and unconditional LV EBM 02:08 – Variables' name: x, y, z, h, ỹ 03:34 – LV EBM training recap, warm case 10:54 – LV EBM training recap, zero-temperature limit 11:30 – Today's plan: the missing step 12:08 – Target prop(agation) 19:01 – From target prop to autoencoder 20:54 – Reconstruction costs 21:06 – Loss functional 21:22 – Under and over complete hidden layer 24:40 – Denoising autoencoder 32:00 – Contractive autoencoder 37:50 – Autoencoders recap 38:38 – From autoencoder to variational autoencoder 45:17 – Comparison between variational autoencoder and denoising autoencoder 45:54 – How a variational autoencoder actually works 48:29 – The bubble-of-bubble variational autoencoder interpretation 1:00:08 – And that was it :)