Building Neural Networks from Scratch - Lecture 28 -Neural network testing, generalization and overfitting

In this lecture, we look at neural network generalisation and overfitting. When training neural networks, it is not just enough to minimize the training loss. It is important to make sure that the neural network makes correct predictions on the test data as well. As a machine learning engineer, we need to make sure to avoid overfitting. Training a neural network to 98% accuracy does not mean anything if it performs poorly on the test data. 0:00 Importance of generalisation 5:37 Good vs Poor generalisation 7:00 Overfitting 11:50 Python code walkthrough 15:48 How to prevent overfitting? Jupyter Notebook to access full code: https://drive.google.com/file/d/1g8-dJS_m6nch_84NRB_8B88VIYEd2GL8/view?usp=sharing ================================================= ✉️ Join our FREE Newsletter: https://vizuara.ai/our-newsletter/ ================================================= As we learn AI/ML/DL the material, we will share thoughts on what is actually useful in industry and what has become irrelevant. We will also share a lot of information on which subject contains open areas of research. Interested students can also start their research journey there. Students who are confused or stuck in their ML journey, maybe courses and offline videos are not inspiring enough. What might inspire you is if you see someone else learning and implementing machine learning from scratch. No cost. No hidden charges. Pure old school teaching and learning. ================================================= 🌟 Meet Our Team: 🌟 🎓 Dr. Raj Dandekar (MIT PhD, IIT Madras department topper) 🔗 LinkedIn: https://www.linkedin.com/in/raj-abhijit-dandekar-67a33118a/ 🎓 Dr. Rajat Dandekar (Purdue PhD, IIT Madras department gold medalist) 🔗 LinkedIn: https://www.linkedin.com/in/rajat-dandekar-901324b1/ 🎓 Dr. Sreedath Panat (MIT PhD, IIT Madras department gold medalist) 🔗 LinkedIn: https://www.linkedin.com/in/sreedath-panat-8a03b69a/ 🎓 Sahil Pocker (Machine Learning Engineer at Vizuara) 🔗 LinkedIn: https://www.linkedin.com/in/sahil-p-a7a30a8b/ 🎓 Abhijeet Singh (Software Developer at Vizuara, GSOC 24, SOB 23) 🔗 LinkedIn: https://www.linkedin.com/in/abhijeet-singh-9a1881192/ 🎓 Sourav Jana (Software Developer at Vizuara) 🔗 LinkedIn: https://www.linkedin.com/in/souravjana131/