Using the Bonsai 27b 1b quant locally - regularly.
1.65T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1v5etch/using_the_bonsai_27b_1b_quant_locally_regularly/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA Reddit user reports regularly running the Bonsai 27b model at a 1-bit quantization locally. No further details or excerpt are available.
Why it mattersAnecdotal local-usage note for a niche quantized model. Worth a glance for tinkerers benchmarking small quant models, little beyond that.
Cited by
No citations on record.