$2800 rig with 8x Radeon Pro V620 (256 GB VRAM) + custom vLLM fork = Qwen3.8-Flash-Next at 60 to 100 t/s decode and 3000+ t/s prefill
2.70T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1x0wnz1/2800_rig_with_8x_radeon_pro_v620_256_gb_vram/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryUser built a $2800 inference rig using 8x Radeon Pro V620 GPUs with 256 GB total VRAM and a custom vLLM fork, achieving 60-100 t/s decode and 3000+ t/s prefill on a Qwen3.8 model.
Why it mattersConcrete price-to-performance data point for AMD-based local LLM serving, with a custom vLLM fork relevant to anyone building self-hosted inference on Radeon hardware.
Cited by
No citations on record.