Qwen3.8-Flash-Next on six 3090s with vLLM: 7 users at 262k, 6.5k t/s prefill, 57 t/s decode solo / 206 t/s aggregate with all 7 generating. Fixes for the upstream included.
2.85T2 sourcer/LocalLLaMA
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1x3wjzf/qwen38flashnext_on_six_3090s_with_vllm_7_users_at/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA r/LocalLLaMA post reports running Qwen3.8-Flash-Next on six RTX 3090 GPUs with vLLM, serving seven concurrent users at 262k context. It documents 6.5k t/s prefill, 57 t/s solo decode, 206 t/s aggregate decode, and includes upstream fixes contributed by the author.
Why it mattersConcrete multi-GPU serving benchmarks and upstream patches for a specific model, useful for anyone replicating a similar local LLM deployment on mid-range hardware.
Cited by
No citations on record.