VINDEX3

A CONCEPT · PROJECTED FROM THE VINDEX KNOWLEDGE GRAPH

ATTENTION

each token reads the past

The first move of a layer: every token asks questions of the tokens before it, and information flows back where the questions match.

Attention gives each token three faces made by three tensors — a query, a key, a value — plus an output projection that writes the gathered result back to the stream.

IN THE GRAPH

attentioncontainsq — q_proj

attentioncontainsk — k_proj

attentioncontainsv — v_proj

attentioncontainso — o_proj

attentionbelongs tolayer

attentionbelongs totoken mixer

attentionspecialised bygated attention