LLM hardware acceleration—on a Raspberry Pi

LLM hardware acceleration—on a Raspberry Pi

The Raspberry Pi is a compelling low-power option for running GPU-accelerated LLMs locally. For my main test setup, here’s the hardware I used (some links are affiliate links): – Raspberry Pi 5 8GB ($80):...
4K Gaming on Raspberry Pi 5

4K Gaming on Raspberry Pi 5

It works! I got an AMD GPU running externally on the Pi 5’s PCI Express bus, and it lets me game in 4K. At least with games as old as the card I’m using. But there’s a lot of promise here. Can we do hardware video transcoding? Maybe! More info in my...
4K Gaming… on Raspberry Pi!

4K Gaming… on Raspberry Pi!

Yes, it is possible. But can it play DOOM? Yes, it can, at 4K and on Ultra. Check out more details about how this was achived in my blog post: – https://www.jeffgeerling.com/blog/2024/use-external-gpu-on-raspberry-pi-5-4k-gaming Here are the parts I used in my...
PoE+ NVMe beats Raspberry Pi to the punch

PoE+ NVMe beats Raspberry Pi to the punch

Go to https://surfshark.com/redshirtjeff for 4 extra months of Surfshark. Raspberry Pi hasn’t released their PoE+ HAT after pre-announcing it a year ago—but third parties are taking the idea and getting creative, combining NVMe + PoE+ on one HAT! How do...
You can use external GPUs on the Raspberry Pi 5

You can use external GPUs on the Raspberry Pi 5

GitHub issue: https://github.com/geerlingguy/raspberry-pi-pcie-devices/issues/564 Thanks to EVERYONE who’s helped along this long journey (and it’s not quite over yet!). Will AMD or Nvidia—or maybe even INTEL!?—support their cards on the Pi 5...