Self-Attention Weight Heatmap & Q·K Routing
Concept 01 Demo
Selected Query Token:
"it" (Index 6)
Scaling Factor √(d_k):
8.0
Select "it"
Select "scored"
Primary Attended Token
"Note"
Top Attention Weight
74.2%
Attention Entropy / Focus
Sharp Coreference