[GUIDE] Qwen3.8 Flash-Next on a single RTX 5080 + 64GB RAM: >250 tok/s tg and 5700 tok/s prefill in real agent coding sessions (Basalt + new Unsloth UD-IQ3_XXS + Lamina drafter),+ how it compares to llama.cpp
3.30T2 sourcer/LocalLLaMA
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1xomy0i/guide_qwen38_flashnext_on_a_single_rtx_5080_64gb/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA guide to running Qwen3.8 Flash-Next on one RTX 5080 with 64 GB RAM using Basalt, Unsloth UD-IQ3_XXS, and Lamina drafter. It reports over 250 tokens per second generation and 5,700 tokens per second prefill during agent coding, with a comparison to llama.cpp.
Why it mattersProvides a concrete local-agent inference stack, measured throughput, and a llama.cpp comparison that readers can reproduce or test on similar hardware.
Cited by
No citations on record.