LLM hardware acceleration—on a Raspberry Pi

LLM hardware acceleration—on a Raspberry Pi

The Raspberry Pi is a compelling low-power option for running GPU-accelerated LLMs locally. For my main test setup, here’s the hardware I used (some links are affiliate links): – Raspberry Pi 5 8GB ($80):...
You can use external GPUs on the Raspberry Pi 5

You can use external GPUs on the Raspberry Pi 5

GitHub issue: https://github.com/geerlingguy/raspberry-pi-pcie-devices/issues/564 Thanks to EVERYONE who’s helped along this long journey (and it’s not quite over yet!). Will AMD or Nvidia—or maybe even INTEL!?—support their cards on the Pi 5...
FINALLY! NVMe SSDs on the Raspberry Pi

FINALLY! NVMe SSDs on the Raspberry Pi

The Pineberry Pi HatDrive! is a series of HATs that use the new PCIe connection on the Raspberry Pi 5. How fast can we get our SSD to go? Can you overclock the Raspberry Pi’s PCIe bus? Special thanks to Pineberry Pi for sending these two evaluation boards (they...