Generative Pre-trained Transformers (GPT)

University of Glasgow via Coursera

Coursera based on 31 ratings

Likes

Overview

Large language models such as GPT-3.5, which powers ChatGPT, are changing how humans interact with computers and how computers can process text. This course will introduce the fundamental ideas of natural language processing and language modelling that underpin these large language models. We will explore the basics of how language models work, and the specifics of how newer neural-based approaches are built. We will examine the key innovations that have enabled Transformer-based large language models to become dominant in solving...

Syllabus

Language Modeling

This module introduces the concept of language modelling, which is the foundation of models like GPT.

Transformers and GPT

This module describes the technical background for neural language models and an overview of how they are used to generate text.

Applications and Implications

This module discusses considerations that are necessary when using GPT and similar models in real-world contexts, specifically discussing the risks of using these models and approaches to mitigating these risks.