Artificial Intelligence - Stanford Webinar - GPT-3 & Beyond

GPT3 & Beyond: Key concepts and open questions in a golden age for natural language understanding Listen in as Professor Christopher Potts discusses the significance and implications of recent Natural Language Understanding developments including GPT-3. He describes the fundamental building blocks of these systems and describes how we can reliably assess and understand them. Learn more about the AI Professional Program: https://stanford.io/3kYThd2 View the slides for this webinar here: https://stanford.io/potts-GPT3-webinar2023 #gpt3 #stanfordwebinar Chapters: 0:00 Opening 00:09 Introduction for Chris Potts 1:09 Chris Potts - Welcome to the webinar 03:43 Quick Demo of GPT-3 06:41 GLUE benchmark 10:26 How can you contribute to NLU in this era of these gargantuan models? 11:44 The last mile problem 13:35 GPT example 14:50 Contrast In-Context learning with the standard paradigm of standard supervision 16:47 What are the mechanisms behind this? 18:18 Why does this work so well? 18:35 Self-Supervision 21:08 The role of human feedback 21:32 Chat GPT Diagram 23:42 Step-by-step reasoning 28:13 LLMs for everything approach 41:29 AI Courses at Stanford 46:28 Predictions about the future