VINDEX3

A CANONICAL ANSWER · FROM THE VINDEX KNOWLEDGE GRAPH

Decode is bandwidth-bound, not compute-bound

To produce one token, every participating weight must cross from memory to compute, and that trip has a hard speed limit. Divide bytes per token by bandwidth and you have the byte floor — the fastest a token can possibly arrive before computation counts at all. That single fact is why precision, residency, and placement are the levers that matter, and why the file format is where they are all decided.