Course Hive
Search

Welcome

Sign in or create your account

Continue with Google
or
Lecture 6 - Coding Neural Network Activation Functions from scratch
Play lesson

Building Neural Networks from Scratch - Lecture 6 - Coding Neural Network Activation Functions from scratch

4.0 (7)
47 learners

What you'll learn

This course includes

  • 17.5 hours of video
  • Certificate of completion
  • Access on mobile and TV

Summary

Full Transcript

In this lecture, we learn about coding activation functions in Python. I cover the ReLU and Softmax activation, and also explain the detailed intuition behind both of these. 0:00 Last lecture recap 3:40 Activation functions introduction 9:28 ReLU activation function and it’s power 17:40 Implementing ReLU Class in Python 19:35 ReLU and Classification 24:00 Softmax activation function 30:06 Implementing Softmax Class in Python 38:32 Coding a forward pass with 2 layers and 2 activations Jupyter Notebook: https://drive.google.com/file/d/1se3rUBfOfphtqmKueWFE5wRY8dfx-BQr/view?usp=sharing ================================================= ✉️ Join our FREE Newsletter: https://vizuara.ai/our-newsletter/ ================================================= As we learn AI/ML/DL the material, we will share thoughts on what is actually useful in industry and what has become irrelevant. We will also share a lot of information on which subject contains open areas of research. Interested students can also start their research journey there. Students who are confused or stuck in their ML journey, maybe courses and offline videos are not inspiring enough. What might inspire you is if you see someone else learning and implementing machine learning from scratch. No cost. No hidden charges. Pure old school teaching and learning. ================================================= 🌟 Meet Our Team: 🌟 🎓 Dr. Raj Dandekar (MIT PhD, IIT Madras department topper) 🔗 LinkedIn: https://www.linkedin.com/in/raj-abhijit-dandekar-67a33118a/ 🎓 Dr. Rajat Dandekar (Purdue PhD, IIT Madras department gold medalist) 🔗 LinkedIn: https://www.linkedin.com/in/rajat-dandekar-901324b1/ 🎓 Dr. Sreedath Panat (MIT PhD, IIT Madras department gold medalist) 🔗 LinkedIn: https://www.linkedin.com/in/sreedath-panat-8a03b69a/ 🎓 Sahil Pocker (Machine Learning Engineer at Vizuara) 🔗 LinkedIn: https://www.linkedin.com/in/sahil-p-a7a30a8b/ 🎓 Abhijeet Singh (Software Developer at Vizuara, GSOC 24, SOB 23) 🔗 LinkedIn: https://www.linkedin.com/in/abhijeet-singh-9a1881192/ 🎓 Sourav Jana (Software Developer at Vizuara) 🔗 LinkedIn: https://www.linkedin.com/in/souravjana131/

Course Hive

Continue this lesson in the app

Install CourseHive on Android or iOS to keep learning while you move.

Related Courses

FAQs

Course Hive
Download CourseHive
Keep learning anywhere