You cannot select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
12 lines
402 B
Markdown
12 lines
402 B
Markdown
---
|
|
# edu-vqxk
|
|
title: 'Write §8: A decoder-only LM — stacking blocks and the causal mask'
|
|
status: todo
|
|
type: task
|
|
created_at: 2026-03-13T22:01:58Z
|
|
updated_at: 2026-03-13T22:01:58Z
|
|
parent: edu-u2w7
|
|
---
|
|
|
|
Explain how N transformer blocks are stacked. Causal mask ensures each position only attends to past tokens. Tie weights to the unembedding matrix (GPT-1 style). Final linear + softmax for logits.
|