Ternary Bonsai 2 (2B, 4B, and 9B) just released on Hugging Face. The 2B can run entirely locally in the browser at up to 500 tok/s on an M4 Max with custom WebGPU kernels.
2.40T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1x6w658/ternary_bonsai_2_2b_4b_and_9b_just_released_on/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA new "Ternary Bonsai 2" model family with 2B, 4B, and 9B parameter sizes was released on Hugging Face. The 2B variant reportedly runs entirely in-browser via custom WebGPU kernels at up to 500 tokens/second on an M4 Max.
Why it mattersConcrete data point on browser-native local inference speeds; useful for assessing whether edge setups are viable, though 2B remains small for substantive agent tasks.
Cited by
No citations on record.