THE VINDEX KNOWLEDGE GRAPH · 63 ENTITIES

ONE GRAPH, EVERY SURFACE

These are not glossary entries anyone maintains. Each page is a projection of one knowledge-graph entity — the same record Ask answers from, the Anatomy renders, and the Explorer's DESCRIBE reaches. Definitions cannot drift, because there is one set of them.

layer

LAYER RESIDUAL NORM EMBEDDING TOKEN MIXER

attention

ATTENTION Q — q_proj K — k_proj V — v_proj O — o_proj QUERY SCALE vs SCORE SCALE PARAMETER-FREE QK NORM ATTENTION OUTPUT GATE

feed-forward

FEED-FORWARD GATE — gate_proj UP — up_proj DOWN — down_proj GATE_UP — the paired bank

moe

ROUTER EXPERT MIXTURE OF EXPERTS

attention-families

GATED ATTENTION LINEAR ATTENTION GATED DELTANET KDA — KIMI DELTA ATTENTION MLA — MULTI-HEAD LATENT ATTENTION RECURRENT STATE HYBRID ATTENTION POLICY KV STATE vs RECURRENT STATE MAMBA2 — THE SSD MIXER CONV-QKV ATTENTION