A CONCEPT · PROJECTED FROM THE VINDEX KNOWLEDGE GRAPH
GATE_UP — the paired bank
stores paired expert gate-up weights
The physical representation that stores gate and up together, because the gated feed-forward programme consumes them together.
A semantic fact became a physical layout: gate and up are read in the same operation, so the container stores them as one bank per expert — and down separately, because it is consumed separately. The layout is an argument, not a habit.
IN THE GRAPH
gate_up — the paired bank— represents →gate — gate_proj
gate_up — the paired bank— represents →up — up_proj
gate_up — the paired bank— physical reason →feed-forward