Qwen3.8-Flash-Next (125B) on a single Strix Halo mini PC: 44-59 tok/s with speculative decoding, ~1,400 tok/s prefill, engine is open
2.70T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1wybesy/qwen38flashnext_125b_on_a_single_strix_halo_mini/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryReddit report of running a 125B parameter Qwen3.8-Flash-Next model on a single Strix Halo mini PC, achieving 44-59 tok/s with speculative decoding and roughly 1,400 tok/s prefill, using an open inference engine.
Why it mattersConcrete local-inference benchmark on emerging mini PC silicon; a useful reference datapoint for sizing a local AI workstation against a 100B+ class model.
Cited by
No citations on record.