Jailbroken PS5s can now run local AI models at over 100+ tokens per second

The list of things a jailbroken PS5 can do gets longer, as Reddit user u/AdIllustrious7246 posted his fork of PS5LM, a llama.cpp port on the PS5 to run AI LLMs locally, with a massive improvement, allowing PS5LM to run natively on the PS5 and utilize the GPU to run bigger AI models such as Qwen3.8-27B at 20 tokens per second.

GitHub user cobanov posted their unofficial port of llama.cpp on Reddit 14 days ago to enable jailbroken PS5s to run AI chat models locally and offline. cobanov’s version, according to u/AdIllustrious7246, runs as a payload on the CPU, limiting it to 6 GiB of memory. Running it as a payload is basically hijacking the CPU, inserting the LLM into its instructions alongside the home screen and system services; however, RAM access is limited to about 6.25 GiB because holding more would freeze the home screen. …