Running Next Flash IQ3_XXS at ~70 tok/s with 100k context or 2 instances of Qwen 3.6 35B A3B IQ4 at ~145 tok/s with 256k all on $500 of ex mining BC-250 boards
2.55T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1x2yv1b/running_next_flash_iq3_xxs_at_70_toks_with_100k/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA user reports running a quantized Next Flash model at ~70 tokens/second with 100k context, or two instances of Qwen 3.6 35B A3B IQ4 at ~145 tok/s with 256k context, on $500 worth of repurposed BC-250 mining boards.
Why it mattersConcrete token/sec numbers on repurposed mining hardware give a clear cost reference for anyone planning a budget local-LLM inference rig.
Cited by
No citations on record.