pop
/
vibed
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

docs(edu): write all 14 sections of LLM from scratch chapter [edu-u2w7]

Browse Source 
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
main
Elijah Voigt 3 months ago
parent bc4cc23c42
commit 0690327296
14 changed files with 42 additions and 28 deletions
Show Stats Download Patch File Download Diff File

5
edu/.beans/edu-32xl--write-1-what-is-a-language-model.md
Unescape Escape View File

@ -1,10 +1,11 @@
--- ---
# edu-32xl # edu-32xl
title: 'Write §1: What is a language model?' title: 'Write §1: What is a language model?'
status: todo status: completed
type: task type: task
priority: normal
created_at: 2026-03-13T22:01:47Z created_at: 2026-03-13T22:01:47Z
updated_at: 2026-03-13T22:01:47Z updated_at: 2026-03-16T02:30:26Z
parent: edu-u2w7 parent: edu-u2w7
--- ---

5
edu/.beans/edu-7do4--write-2-character-level-tokenisation.md
Unescape Escape View File

@ -1,10 +1,11 @@
--- ---
# edu-7do4 # edu-7do4
title: 'Write §2: Character-level tokenisation' title: 'Write §2: Character-level tokenisation'
status: todo status: completed
type: task type: task
priority: normal
created_at: 2026-03-13T22:01:48Z created_at: 2026-03-13T22:01:48Z
updated_at: 2026-03-13T22:01:48Z updated_at: 2026-03-16T02:30:26Z
parent: edu-u2w7 parent: edu-u2w7
--- ---

5
edu/.beans/edu-9cnd--write-6-the-transformer-block.md
Unescape Escape View File

@ -1,10 +1,11 @@
--- ---
# edu-9cnd # edu-9cnd
title: 'Write §6: The Transformer block' title: 'Write §6: The Transformer block'
status: todo status: completed
type: task type: task
priority: normal
created_at: 2026-03-13T22:01:55Z created_at: 2026-03-13T22:01:55Z
updated_at: 2026-03-13T22:01:55Z updated_at: 2026-03-16T02:30:26Z
parent: edu-u2w7 parent: edu-u2w7
--- ---

5
edu/.beans/edu-9sb7--write-14-further-reading.md
Unescape Escape View File

@ -1,10 +1,11 @@
--- ---
# edu-9sb7 # edu-9sb7
title: 'Write §14: Further reading' title: 'Write §14: Further reading'
status: todo status: completed
type: task type: task
priority: normal
created_at: 2026-03-13T22:02:08Z created_at: 2026-03-13T22:02:08Z
updated_at: 2026-03-13T22:02:08Z updated_at: 2026-03-16T02:30:26Z
parent: edu-u2w7 parent: edu-u2w7
--- ---

5
edu/.beans/edu-abdu--write-10-cross-entropy-loss-and-the-training-loop.md
Unescape Escape View File

@ -1,10 +1,11 @@
--- ---
# edu-abdu # edu-abdu
title: 'Write §10: Cross-entropy loss and the training loop' title: 'Write §10: Cross-entropy loss and the training loop'
status: todo status: completed
type: task type: task
priority: normal
created_at: 2026-03-13T22:02:02Z created_at: 2026-03-13T22:02:02Z
updated_at: 2026-03-13T22:02:02Z updated_at: 2026-03-16T02:30:26Z
parent: edu-u2w7 parent: edu-u2w7
--- ---

5
edu/.beans/edu-cw9v--write-4-embeddings-and-positional-encoding.md
Unescape Escape View File

@ -1,10 +1,11 @@
--- ---
# edu-cw9v # edu-cw9v
title: 'Write §4: Embeddings and positional encoding' title: 'Write §4: Embeddings and positional encoding'
status: todo status: completed
type: task type: task
priority: normal
created_at: 2026-03-13T22:01:52Z created_at: 2026-03-13T22:01:52Z
updated_at: 2026-03-13T22:01:52Z updated_at: 2026-03-16T02:30:26Z
parent: edu-u2w7 parent: edu-u2w7
--- ---

5
edu/.beans/edu-hufe--write-7-exercise-2-implement-self-attention-in-rus.md
Unescape Escape View File

@ -1,10 +1,11 @@
--- ---
# edu-hufe # edu-hufe
title: 'Write §7: Exercise 2 — implement self-attention in Rust' title: 'Write §7: Exercise 2 — implement self-attention in Rust'
status: todo status: completed
type: task type: task
priority: normal
created_at: 2026-03-13T22:01:56Z created_at: 2026-03-13T22:01:56Z
updated_at: 2026-03-13T22:01:56Z updated_at: 2026-03-16T02:30:26Z
parent: edu-u2w7 parent: edu-u2w7
--- ---

5
edu/.beans/edu-i76z--write-12-exercise-5-sample-from-the-model.md
Unescape Escape View File

@ -1,10 +1,11 @@
--- ---
# edu-i76z # edu-i76z
title: 'Write §12: Exercise 5 — sample from the model' title: 'Write §12: Exercise 5 — sample from the model'
status: todo status: completed
type: task type: task
priority: normal
created_at: 2026-03-13T22:02:05Z created_at: 2026-03-13T22:02:05Z
updated_at: 2026-03-13T22:02:05Z updated_at: 2026-03-16T02:30:26Z
parent: edu-u2w7 parent: edu-u2w7
--- ---

5
edu/.beans/edu-jybf--write-11-exercise-4-train-on-a-small-text-corpus.md
Unescape Escape View File

@ -1,10 +1,11 @@
--- ---
# edu-jybf # edu-jybf
title: 'Write §11: Exercise 4 — train on a small text corpus' title: 'Write §11: Exercise 4 — train on a small text corpus'
status: todo status: completed
type: task type: task
priority: normal
created_at: 2026-03-13T22:02:04Z created_at: 2026-03-13T22:02:04Z
updated_at: 2026-03-13T22:02:04Z updated_at: 2026-03-16T02:30:26Z
parent: edu-u2w7 parent: edu-u2w7
--- ---

5
edu/.beans/edu-kkjc--write-13-what-limits-this-model.md
Unescape Escape View File

@ -1,10 +1,11 @@
--- ---
# edu-kkjc # edu-kkjc
title: 'Write §13: What limits this model?' title: 'Write §13: What limits this model?'
status: todo status: completed
type: task type: task
priority: normal
created_at: 2026-03-13T22:02:07Z created_at: 2026-03-13T22:02:07Z
updated_at: 2026-03-13T22:02:07Z updated_at: 2026-03-16T02:30:26Z
parent: edu-u2w7 parent: edu-u2w7
--- ---

5
edu/.beans/edu-s6mr--write-5-self-attention-queries-keys-and-values.md
Unescape Escape View File

@ -1,10 +1,11 @@
--- ---
# edu-s6mr # edu-s6mr
title: 'Write §5: Self-attention — queries, keys, and values' title: 'Write §5: Self-attention — queries, keys, and values'
status: todo status: completed
type: task type: task
priority: normal
created_at: 2026-03-13T22:01:53Z created_at: 2026-03-13T22:01:53Z
updated_at: 2026-03-13T22:01:53Z updated_at: 2026-03-16T02:30:26Z
parent: edu-u2w7 parent: edu-u2w7
--- ---

5
edu/.beans/edu-tufd--write-3-exercise-1-build-a-character-level-tokenis.md
Unescape Escape View File

@ -1,10 +1,11 @@
--- ---
# edu-tufd # edu-tufd
title: 'Write §3: Exercise 1 — build a character-level tokeniser in Rust' title: 'Write §3: Exercise 1 — build a character-level tokeniser in Rust'
status: todo status: completed
type: task type: task
priority: normal
created_at: 2026-03-13T22:01:50Z created_at: 2026-03-13T22:01:50Z
updated_at: 2026-03-13T22:01:50Z updated_at: 2026-03-16T02:30:26Z
parent: edu-u2w7 parent: edu-u2w7
--- ---

5
edu/.beans/edu-ujs5--write-9-exercise-3-define-the-gpt-1-style-model-in.md
Unescape Escape View File

@ -1,10 +1,11 @@
--- ---
# edu-ujs5 # edu-ujs5
title: 'Write §9: Exercise 3 — define the GPT-1-style model in candle' title: 'Write §9: Exercise 3 — define the GPT-1-style model in candle'
status: todo status: completed
type: task type: task
priority: normal
created_at: 2026-03-13T22:02:00Z created_at: 2026-03-13T22:02:00Z
updated_at: 2026-03-13T22:02:00Z updated_at: 2026-03-16T02:30:26Z
parent: edu-u2w7 parent: edu-u2w7
--- ---

5
edu/.beans/edu-vqxk--write-8-a-decoder-only-lm-stacking-blocks-and-the.md
Unescape Escape View File

@ -1,10 +1,11 @@
--- ---
# edu-vqxk # edu-vqxk
title: 'Write §8: A decoder-only LM — stacking blocks and the causal mask' title: 'Write §8: A decoder-only LM — stacking blocks and the causal mask'
status: todo status: completed
type: task type: task
priority: normal
created_at: 2026-03-13T22:01:58Z created_at: 2026-03-13T22:01:58Z
updated_at: 2026-03-13T22:01:58Z updated_at: 2026-03-16T02:30:26Z
parent: edu-u2w7 parent: edu-u2w7
--- ---

Write Preview
Loading…
Cancel
Save