Qwen3.8-Flash-Next-GSQ-RCO (IQ3_S): ~40-50 tok/sec decode & 1300-1500 tok/sec prefill at 131k ctx on 12GB VRAM + 32GB RAM + NVME
2.40T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1x7sbdc/qwen38flashnextgsqrco_iq3_s_4050_toksec_decode/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryReddit post reports a Qwen3.8-Flash-Next model in IQ3_S quantization running at roughly 40-50 tok/sec decode and 1300-1500 tok/sec prefill at a 131k context window on a 12GB VRAM + 32GB RAM + NVMe setup.
Why it mattersConcrete per-stage token throughput for a tight 12GB VRAM build at long context, useful as a sizing baseline for local LLM rigs.
Cited by
No citations on record.