LLM hardware acceleration—on a Raspberry Pi

LLM hardware acceleration—on a Raspberry Pi

The Raspberry Pi is a compelling low-power option for running GPU-accelerated LLMs locally. For my main test setup, here’s the hardware I used (some links are affiliate links): – Raspberry Pi 5 8GB ($80):...
My Raspberry Pi has a better GPU than Apple’s M4 Pro

My Raspberry Pi has a better GPU than Apple’s M4 Pro

Go to https://surfshark.com/redshirtjeff for 4 extra months of Surfshark at an unbeatable price! The Pi 5 can now game at 4K Ultra, with Ray Tracing: ON. Check out my blog post for the complete guide to setting up your own AMD 7000-series graphics card on a Pi:...
4K Gaming… on Raspberry Pi!

4K Gaming… on Raspberry Pi!

Yes, it is possible. But can it play DOOM? Yes, it can, at 4K and on Ultra. Check out more details about how this was achived in my blog post: – https://www.jeffgeerling.com/blog/2024/use-external-gpu-on-raspberry-pi-5-4k-gaming Here are the parts I used in my...
You can use external GPUs on the Raspberry Pi 5

You can use external GPUs on the Raspberry Pi 5

GitHub issue: https://github.com/geerlingguy/raspberry-pi-pcie-devices/issues/564 Thanks to EVERYONE who’s helped along this long journey (and it’s not quite over yet!). Will AMD or Nvidia—or maybe even INTEL!?—support their cards on the Pi 5...
Testing the 4090 on a Raspberry Pi

Testing the 4090 on a Raspberry Pi

Exploring the possibilities in tech sometimes leads us to unforeseen innovations and seemingly pointless but fascinating adventures. This journey is one of perseverance, resilience, and the relentless pursuit to mount a graphics card to a Raspberry Pi. The Obscenely...