Neural Networks to GPT: Zero to Hero · Tapelearn
Neural Networks to GPT: Zero to Hero
3/9
Chapter 3 of 9 · 14 h 15 min left
Theater
T
Loading player…
Previous
2 · The spelled-out intro to language modeling: building makemore
Sign in to track progress
Next
4 · Building makemore Part 3: Activations & Gradients, BatchNorm
1×
Loop
Chapter 3 of 9 · 14 h 15 min left
Building makemore Part 2: MLP
Andrej Karpathy · 1:15:40
Copy link to this moment
Chapters
· 9 chapters
Backprop and language models
1
The spelled-out intro to neural networks and backpropagation: building micrograd
2:25:52
2
The spelled-out intro to language modeling: building makemore
1:57:45
3
Building makemore Part 2: MLP
1:15:40
Training deep nets properly
4
Building makemore Part 3: Activations & Gradients, BatchNorm
1:55:58
5
Building makemore Part 4: Becoming a Backprop Ninja
1:55:24
6
Building makemore Part 5: Building a WaveNet
56:22
Building GPT
7
Let's build GPT: from scratch, in code, spelled out.
1:56:20
8
Let's build the GPT Tokenizer
2:13:35
9
Let's reproduce GPT-2 (124M)
4:01:26