Intro to Deep Learning and Generative Models Course - L19.5.2.3 BERT: Bidirectional Encoder Representations from Transformers

Sebastian's books: https://sebastianraschka.com/books/ Slides: https://sebastianraschka.com/pdf/lecture-notes/stat453ss21/L19_seq2seq_rnn-transformers__slides.pdf 0:00 Introduction 0:29 BERT (Bidirectional Encoder Representations from Transformers) 1:44 BERT Inputs 4:18 BERT Pre-Training Task #1 9:47 BERT Pre-Training & Downstream Tasks 11:51 Transformer Training Approach 12:16 BERT Pre-Training & Fine-Tuning Approach 13:49 BERT vs GPT-v1 Performance 14:59 BERT Pre-Training & Feature-based Training ------- This video is part of my Introduction of Deep Learning course. Next video: https://youtu.be/BXv1m9Asl7I The complete playlist: https://www.youtube.com/playlist?list=PLTKMiZHVd_2KJtIXOW0zFhFfBaJJilH51 A handy overview page with links to the materials: https://sebastianraschka.com/blog/2021/dl-course.html ------- If you want to be notified about future videos, please consider subscribing to my channel: https://youtube.com/c/SebastianRaschka