Qwen3.8-27B on a single 3090: 140 tok/s on code with a custom megakernel
2.40T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1x2erdj/qwen3827b_on_a_single_3090_140_toks_on_code_with/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA r/LocalLLaMA post claims to run a Qwen3.8-27B model on a single RTX 3090 at 140 tokens per second for code generation using a custom megakernel implementation.
Why it mattersConcrete local-inference recipe on consumer GPU with a custom kernel approach; useful baseline for anyone sizing self-hosted code models, though no excerpt is available to verify the method.
Cited by
No citations on record.