(a) Before: the full activation vector

(b) After: dimension 443 set to 0 (y-axis zoomed in)

Hover over a plot to see the value of each dimension.

Figure 3. One activation vector from Gemma-3-4B (layer 13, one token position), with one bar per dimension. (a) Dimension 443 has a value of 25,984, about 2,600× the median absolute value (9.9), and carries 99.8% of the vector’s squared length. At this scale, the other 2,559 dimensions are too small to see. (b) After setting dimension 443 to 0 and zooming in, the rest of the vector becomes visible. The next-largest value is −540, at dimension 1365.