Skip to main content
Theorem
Path
Curriculum
Paths
Labs
Diagnostic
Case Study
Blog
Search
Sign in
Quiz Hub
/
Efficient Transformers Survey
Efficient Transformers Survey
3 selected
Difficulty 5-7
3 unseen
View topic
Intermediate
New
0 answered
2 intermediate
1 advanced
Adapts to your performance
Question 1 of 3
120s
intermediate (5/10)
state theorem
Tay et al. 'Efficient Transformers: A Survey' (2022) groups methods into several categories. Which categorization is standard?
Hide and think first
A.
Neural-network-based versus closed-form analytical methods, with the analytical methods avoiding training while the neural ones require gradient updates.
B.
A single binary axis of exact versus approximate methods, with all efficient methods classified as approximate by definition of using fewer FLOPs.
C.
Sparse patterns, low-rank, kernel methods, recurrent-style, downsampling, IO-aware — each tackling a different aspect of the
O
(
n
2
d
)
cost.
D.
Slow, medium, and fast tiers ranked purely by measured wall-clock speed on a fixed sequence-length benchmark used across all reported methods.
Submit Answer
I don't know