Summary
Full Transcript
In this lecture, we code the entire neural network from scratch, in 100 minutes. We don’t use any machine learning library (PyTorch or TensorFlow or sci-kit learn). Everything is coded from scratch. We train the neural network to solve a classification problem. Everything is explained on a whiteboard, and then in Python code. 0:00:00 Table of Contents 0:02:16 Problem Description 0:06:05 Layers architecture 0:14:42 Layers forward pass 0:24:36 Layers backward pass 0:43:00 Activation functions introduction 0:46:06 ReLU forward and backward pass 0:51:55 Softmax forward pass 1:00:48 Cross entropy loss forward pass 1:14:16 Combined softmax-loss backward pass 1:20:25 Optimisers 1:35:23 Train the entire neural network 1:40:14 Visualising the results Jupyter Notebook to access full code: https://drive.google.com/file/d/12smc_dRmc9Dtc03srs6WQDVDdQSIk2SD/view?usp=sharing ================================================= ✉️ Join our FREE Newsletter: https://vizuara.ai/our-newsletter/ ================================================= Philosophy of Vizuara channel: As we learn AI/ML/DL the material, we will share thoughts on what is actually useful in industry and what has become irrelevant. We will also share a lot of information on which subject contains open areas of research. Interested students can also start their research journey there. Students who are confused or stuck in their ML journey, maybe courses and offline videos are not inspiring enough. What might inspire you is if you see someone else learning and implementing machine learning from scratch. No cost. No hidden charges. Pure old school teaching and learning. ================================================= 🌟 Meet Our Team: 🌟 🎓 Dr. Raj Dandekar (MIT PhD, IIT Madras department topper) 🔗 LinkedIn: https://www.linkedin.com/in/raj-abhijit-dandekar-67a33118a/ 🎓 Dr. Rajat Dandekar (Purdue PhD, IIT Madras department gold medalist) 🔗 LinkedIn: https://www.linkedin.com/in/rajat-dandekar-901324b1/ 🎓 Dr. Sreedath Panat (MIT PhD, IIT Madras department gold medalist) 🔗 LinkedIn: https://www.linkedin.com/in/sreedath-panat-8a03b69a/ 🎓 Sahil Pocker (Machine Learning Engineer at Vizuara) 🔗 LinkedIn: https://www.linkedin.com/in/sahil-p-a7a30a8b/ 🎓 Abhijeet Singh (Software Developer at Vizuara, GSOC 24, SOB 23) 🔗 LinkedIn: https://www.linkedin.com/in/abhijeet-singh-9a1881192/ 🎓 Sourav Jana (Software Developer at Vizuara) 🔗 LinkedIn: https://www.linkedin.com/in/souravjana131/
