This file contains ambiguous Unicode characters that may be confused with others in your current locale. If your use case is intentional and legitimate, you can safely ignore this warning. Use the Escape button to highlight these characters.
---
# edu-cw9v
title: 'Write §4: Embeddings and positional encoding'
status: todo
type: task
created_at: 2026-03-13T22:01:52Z
updated_at: 2026-03-13T22:01:52Z
parent: edu-u2w7
---
Token embedding table (vocab_size × d_model). Learned positional embeddings (GPT-1 style). Explain why position matters for attention.