Qwen3.5-9B running on a PS4’s GPU, offline, using its own MTP head for speculative decoding
2.85T2 sourcer/LocalLLaMA
r/LocalLLaMAoriginal source ↗
Source record
Published by r/LocalLLaMA (T2 source). The original is at https://www.reddit.com/r/LocalLLaMA/comments/1xvbn2m/qwen359b_running_on_a_ps4s_gpu_offline_using_its/.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryThe post reports running Qwen3.5-9B locally on a PlayStation 4 GPU, using the model’s multi-token prediction head to accelerate speculative decoding.
Why it mattersDemonstrates a low-cost route for repurposing obsolete console hardware for local model inference, with a concrete configuration others can examine or reproduce.
Cited by
No citations on record.