KFlash: Benchmarks of newly released versions of Apple Silicon optimized engines: 1.4.0 Splash (DFlash2 ~ 50 tok/s) vs 0.2 Kapitsa (KFlash ~65 tok/s), MLX(MTP) & more on Qwen 3.8 27b/4b/35b 4Q on Macbook Pro M4 Pro 48 GB 2024, 48GB & Macbook Pro M1 Pro 16GB 2021
2.70T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1xbdxg3/kflash_benchmarks_of_newly_released_versions_of/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryBenchmarks comparing newly released Apple Silicon optimized inference engines — KFlash 0.2 Kapitsa (~65 tok/s) and DFlash2 1.4.0 Splash (~50 tok/s) against MLX(MTP) — on Qwen 4B/8B/27B at 4Q quantization, tested on MacBook Pro M4 Pro 48GB and M1 Pro 16GB.
Why it mattersFirsthand tok/s numbers for newly released local-inference engines on Apple Silicon help readers pick a runtime and match model size to their Mac.
Cited by
No citations on record.