Modern LLM Pipeline
The full path from raw text to generated tokens: tokenization, embeddings, positional encodings, attention, sampling, and perplexity evaluation. A compact tour of the stack behind a modern language model.
12 problems
Your progress
0/12 · 0%Continue collection · Tokenization
Problems
- TokenizationEasynlp-001NLP
- Easy
- Easy
- BPE Merge StepMediumnlp-020NLP
- Medium
- Medium
- Medium
- Greedy DecodingMediumnlp-077NLP
- Medium
- Medium
- Medium
- BPE Encode with MergesHardnlp-021NLP