Rotary Position Embeddings (RoPE) in 2D Space
Concept 01 Demo
Token A Position (m):
2
Token B Position (n):
5
Shift Both (+4)
Relative Distance (m - n)
-3 positions
Relative Angle Difference Δθ
-54.0°
Relative Dot Product Score
+0.588 (Invariant)