I clustered two old Android phones to run a 27B LLM locally. Bypassed RAM limits via C++ RPC split and Hadamard Ternary math (No overheating)
2.85T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1x4mrty/i_clustered_two_old_android_phones_to_run_a_27b/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA user reports clustering two old Android phones to run a 27B parameter language model locally, bypassing device RAM limits through a C++ RPC split and Hadamard Ternary math, with no overheating observed.
Why it mattersConcrete, unusual mobile-cluster setup for local LLM inference. Documents specific memory and quantization workarounds relevant to anyone exploring edge inference on consumer hardware.
Cited by
No citations on record.