DPI-681 Class 1 - Introduction to Large Language Models

hi I'm Char Goyle and I'm really excited to be teaching this online course with Dan and Teddy I'm going to tell you a little bit about the science behind generative Ai and I'm going to give you a quick overview of it right now and then later in the course we'll see some we'll dive into some more of the details so at a high level large language models like chat gbt um are built in three steps so the first step is collect a large Corpus of data and typically this is a corpus written by humans the

second step is based on this Corpus that you've collected learn to predict the next word in then a given sequence of words so