Skip to main content

Prerequisite chain

Prerequisites for Reward Hacking

Topics you need before working through Reward Hacking. Direct prerequisites are listed first; transitive prerequisites (the chain reachable through them) follow.

Direct prerequisites (4)

  1. Reward Models and Verifierslayer 5, tier 2
  2. RLHF and Alignmentlayer 4, tier 2
  3. Hallucination Theorylayer 4, tier 1
  4. Reward Design and Reward Misspecificationlayer 3, tier 1

Reachable through the chain (416)

These topics are not directly cited as prerequisites but are reached transitively by following the chain upward. Working through the direct prerequisites pulls these in.