A model architecture claim should name the active compute
by•
Parameter count alone has become a bad shortcut for explaining conditional models. If a system uses experts or sparse memory, I want four numbers: total parameters, parameters active per token, routing or retrieval overhead, and measured throughput on named hardware.
Without those, a large number can describe storage capacity while readers assume every parameter contributes to every token. That muddles both cost and capability.
Which number do you wish model announcements reported by default?
1 view
Replies