This file contains ambiguous Unicode characters that may be confused with others in your current locale. If your use case is intentional and legitimate, you can safely ignore this warning. Use the Escape button to highlight these characters.
---
# edu-cw9v
title: 'Write §4: Embeddings and positional encoding'
status: completed
type: task
priority: normal
created_at: 2026-03-13T22:01:52Z
updated_at: 2026-03-16T02:30:26Z
parent: edu-u2w7
---
Token embedding table (vocab_size × d_model). Learned positional embeddings (GPT-1 style). Explain why position matters for attention.