What a £300, 35W Snapdragon mini PC can actually do 👀: 35B coder at ~30 tok/s, and an 80B model that doesnt even fit in RAM running at 17 tok/s
2.70T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1x6stod/what_a_300_35w_snapdragon_mini_pc_can_actually_do/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA £300, 35W Snapdragon mini PC reportedly runs a 35B coding model at roughly 30 tokens/second and an 80B model (which exceeds RAM) at about 17 tokens/second, based on hands-on local testing.
Why it mattersConcrete throughput numbers on cheap ARM hardware give a useful baseline for sizing local LLM inference outside a dedicated GPU setup.
Cited by
No citations on record.