Induction Heads

2 selectedDifficulty 5-92 unseenView topic

IntermediateNew

0 answered

1 intermediate1 advancedAdapts to your performance

Question 1 of 2

120sintermediate (5/10)conceptual

Induction heads are a two-layer circuit in transformers that implement a specific in-context learning algorithm. What pattern do they detect and complete?