September 29, 2023

Transformers: the architecture of ChatGPT Workshop

In our second workshop we will be going over transformers. Transformers are used in numerous applications but most notably ChatGPT and GPT 1 through 4. You will find that a lot of large language models such as ChatGPT have similar architectures and tend to reuse the same core concepts. The main differences in ChatGPT versus a language model you can run on your laptop is primarily due to scale and the methods in which larger models are trained. Join us in this workshop to explore transformers: the architecture of ChatGPT.
Minimum Prerequisites:

* Basic coding experience in an object oriented language such as python.

This post was originally published on this site