Qwen 3.8 Flash Next-GSQ-RCO-IQ2_XS at ~21 tok/s on just an RTX 3060 12GB + 16GB DDR4 RAM(No gate pruning, 100% bit-exact)
2.70T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1x1tclb/qwen_38_flash_nextgsqrcoiq2_xs_at_21_toks_on_just/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryBenchmark post reporting a Qwen 3.8B Flash model at IQ2_XS quantization running at approximately 21 tokens per second on an RTX 3060 12GB GPU paired with 16GB DDR4 RAM, with the author noting no gate pruning and 100% bit-exact results.
Why it mattersFirsthand, hardware-specific inference benchmark for a heavily quantized model on a common budget GPU; useful reference for sizing local LLM setups.
Cited by
No citations on record.