LFM3-Omni-2B running fully offline on my iPhone 18 Pro Max at ~80 tok/s, powered by custom WebGPU kernels in a React Native app.
3.15T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1xntou1/lfm3omni2b_running_fully_offline_on_my_iphone_18/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA developer reports running LFM3-Omni 2B entirely offline on an iPhone 18 Pro Max at about 80 tokens per second, using custom WebGPU kernels within a React Native application.
Why it mattersCombines model selection, custom kernel work, and mobile integration, providing a concrete reference architecture for private, on-device inference.
Cited by
No citations on record.