LLM hardware acceleration—on a Raspberry Pi

LLM hardware acceleration—on a Raspberry Pi

The Raspberry Pi is a compelling low-power option for running GPU-accelerated LLMs locally. For my main test setup, here’s the hardware I used (some links are affiliate links): – Raspberry Pi 5 8GB ($80):...
Raspberry Pi 5 Battlestation: 6 displays!

Raspberry Pi 5 Battlestation: 6 displays!

How many displays can you plug into a Raspberry Pi? Six! How I did it: https://www.jeffgeerling.com/blog/2024/amd-radeon-pro-w7700-running-on-raspberry-pi Support me on Patreon: https://www.patreon.com/geerlingguy Sponsor me on GitHub:...
4K Gaming on Raspberry Pi 5

4K Gaming on Raspberry Pi 5

It works! I got an AMD GPU running externally on the Pi 5’s PCI Express bus, and it lets me game in 4K. At least with games as old as the card I’m using. But there’s a lot of promise here. Can we do hardware video transcoding? Maybe! More info in my...