Unlock: Residual Stream and Transformer Internals
The residual stream as the central computational highway in transformers: attention and FFN blocks read from and write to it. Pre-norm vs post-norm, FFN as key-value memory, and the logit lens for inspecting intermediate representations.
175 Prerequisites0 Mastered0 Working146 Gaps
Prerequisite mastery17%
Recommended probe
Chernoff Bounds is your weakest prerequisite with available questions. You haven't been assessed on this topic yet.
Not assessed3 questions
McDiarmid's InequalityAdvanced
Not assessed13 questions
Not assessed2 questions
Not assessed15 questions
Symmetrization InequalityAdvanced
Not assessed3 questions
VC DimensionCore
Not assessed58 questions
Contraction InequalityAdvanced
Not assessed1 question
Not assessed7 questions
Forgetting Transformer (FoX)Research
No quiz
Transformer ArchitectureResearch
Not assessed11 questions
Sign in to track your mastery and see personalized gap analysis.