A CONCEPT · PROJECTED FROM THE VINDEX KNOWLEDGE GRAPH
Q — q_proj
what am I looking for
Turns this token's state into the questions it asks of every token before it.
A verb asking for its subject; a pronoun asking who it stands for. The query is compared against every earlier token's key, and where they agree strongly, that token's value flows back.
IN THE GRAPH
q — q_proj— belongs to →attention
q — q_proj— compared against →k — k_proj