I gave a 21M model a 6.4B-parameter lookup table. It matches a 114M dense model and runs with the table on an SSD (RX 9070)
2.70T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1wz7tvs/i_gave_a_21m_model_a_64bparameter_lookup_table_it/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA Reddit user reports attaching a 6.4B-parameter lookup table to a 21M model, matching the accuracy of a 114M dense model while running on an RX 9070 GPU with the table stored on an SSD.
Why it mattersConcrete memory-compute tradeoff: a tiny model plus an SSD-resident table beats a model orders of magnitude larger on consumer hardware, with a specific recipe.
Cited by
No citations on record.