Modern Post-Training

Preference data, reward models, and the algorithms that fine-tune on top of them: DPO, GRPO, PPO-RLHF, and KL control against a reference model. Covers Bradley-Terry likelihood, best-of-N selection, and reward-model evaluation.

12 problems