Llama.cpp on a jailbroken PS5: run any GGUF model natively on the console

(github.com)

56 points | by Anon84 1 hour ago

7 comments

pwython 2 minutes ago
With this in mind, having LLM-powered NPCs would be a beautiful thing. There's been limited testing on PC games (PUBG Ally), but I can imagine it will be the standard.
kevmo314 55 minutes ago
Not long until Anthropic's dreams of self-replicating models starts taking over PS5s!
[-]
- crorella 44 minutes ago
  Haha, I was thinking the same, I think we will see the most random devices being able to host models in the near future. An army for the techno core.
randomblock1 44 minutes ago
Relevant: https://en.wikipedia.org/wiki/PlayStation_3_cluster
[-]
- russellbeattie 38 minutes ago
  Obligatory... "Can you imagine a Beowulf cluster of these?"
  [-]
  - Anon84 23 minutes ago
    Those were relatively big for scientific computing in the PS2 days
    https://www.ncsa.illinois.edu/2003/05/27/playing-the-superco...
armcat 30 minutes ago
The toaster is next!
Kurtz79 52 minutes ago
Don't give Sony ideas...
ThrowawayTestr 57 minutes ago
11.4G of shared memory. Could do something interesting if you don't have a GPU.
[-]