---
# edu-cw9v
title: 'Write §4: Embeddings and positional encoding'
status: completed
type: task
priority: normal
created_at: 2026-03-13T22:01:52Z
updated_at: 2026-03-16T02:30:26Z
parent: edu-u2w7
---

Token embedding table (vocab_size × d_model). Learned positional embeddings (GPT-1 style). Explain why position matters for attention.