Splash fork optimised for M5 Max: ~1.5× faster (1.25× single request)
1.95T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1wrd1p1/splash_fork_optimised_for_m5_max_15_faster_125/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA fork of the Splash inference engine optimized for Apple M5 Max silicon reports roughly 1.5× faster batch performance and 1.25× faster single-request inference compared to the baseline.
Why it mattersConcrete speedup numbers for a specific Apple Silicon chip; useful reference for anyone running local model inference on M5 Max hardware.
Cited by
No citations on record.