Source record

Published by Hacker News · Show HN (50+ points) (T2 source). The original is at https://github.com/leonickson1/Swiftlet.

Pipeline notes

The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.

Show HN for Swiftlet, an open-source project that runs an 80B Qwen model in 4.3 GB of RAM on macOS and a 35B model on an iPhone, using aggressive quantization. GitHub repo linked, 50+ points on Hacker News.

Concrete open-source tool pushing the floor on memory needed for local LLM inference on Apple silicon. Useful for readers exploring on-device AI setups without cloud APIs.

Cited by

No citations on record.