A CONCEPT · PROJECTED FROM THE VINDEX KNOWLEDGE GRAPH
DOWN — down_proj
returns intermediate representation home
Compresses the judged wide representation back to the hidden width, and the result joins the stream for the next layer.
The closing move of the feed-forward network. In a VINDEX3 container it is stored as its own bank — unlike gate and up, which are consumed together and stored together.
IN THE GRAPH
down — down_proj— belongs to →feed-forward
down — down_proj— stored apart from →gate_up — the paired bank