Series

Implementing GPT-style transformer from scratch

Implementing GPT Architecture From Scratch: Training and Output
This is a follow-up of my previous post "Implementing GPT Architecture From Scratch: A Deep Dive into Transformers and Attention" This will be a very short post explaining how i trained the untrained
Mar 8, 20266 min read2
Implementing GPT Architecture From Scratch: A Deep Dive into Transformers and Attention
I highly recommend to have a knowledge of machine learning models or atleast the basics The Core Idea: Transformers Before transformers, the industry relied on RNNs and LSTMs. The paper "Attention
Mar 6, 202613 min read49