Neural Networks / Deep Learning - Neural Networks Pt. 3: ReLU In Action!!!

The ReLU activation function is one of the most popular activation functions for Deep Learning and Convolutional Neural Networks. However, the function itself is deceptively simple. This StatQuest walks you through an example, step-by-step, that uses the ReLU activation function so you can see exactly what it does and how it works. NOTE: This StatQuest assumes that you are already familiar with the main ideas behind Neural Networks. If not, check out the 'Quest: https://youtu.be/CqOfi41LfDw For a complete index of all the StatQuest videos, check out: https://statquest.org/video-index/ If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 1:45 ReLU in the Hidden Layer 5:35 ReLU right before the Output 7:38 The derivative of ReLU #StatQuest #NeuralNetworks #ReLU