4 coding agents on one RTX 3090: ~290 tok/s total from a custom CUDA engine for Qwen3.8-27B (3-4x llama-server --parallel)
2.85T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1xgs8hp/4_coding_agents_on_one_rtx_3090_290_toks_total/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA custom CUDA inference engine reportedly runs four coding agents concurrently on one RTX 3090 with Qwen3.8-27B, delivering about 290 tokens per second in total and three to four times llama-server’s parallel throughput.
Why it mattersA specific local-inference setup with concurrent-agent throughput and a comparison baseline, useful for estimating GPU capacity and agent concurrency.
Cited by
No citations on record.