LLM hardware acceleration—on a Raspberry Pi

LLM hardware acceleration—on a Raspberry Pi

The Raspberry Pi is a compelling low-power option for running GPU-accelerated LLMs locally. For my main test setup, here’s the hardware I used (some links are affiliate links): – Raspberry Pi 5 8GB ($80):...
Tiny Radxa X4 unites Intel x86 with Raspberry Pi GPIO

Tiny Radxa X4 unites Intel x86 with Raspberry Pi GPIO

The Radxa X4 unites an Intel N100 SoC with a Raspberry Pi RP2040. The best of both worlds, right? Let’s explore thermals, power delivery, peripheral and OS support, and even take Linux and Windows for a spin on the PCIe Gen 3×4 NVMe SSD! I purchased all the...
Is This The Best Case For A Raspberry Pi 5? #raspberrypi5

Is This The Best Case For A Raspberry Pi 5? #raspberrypi5

The new Pironman 5 case by Sunfounder is an all-in-one case for the Raspberry Pi 5 that includes a cooler, NVMe hat and some neat features. I assembled the case and then tested the cooling performance and the NVMe drive carrier’s speed to see how it compares to...
Is This The Best Raspberry Pi 5 Case Yet? Meet the Pironman 5!

Is This The Best Raspberry Pi 5 Case Yet? Meet the Pironman 5!

The new Pironman 5 case by Sunfounder is an all-in-one case for the Raspberry Pi 5 that includes a cooler, NVMe hat and some neat features. I assembled the case and then tested the cooling performance and the NVMe drive carrier’s speed to see how it compares to...
NUMA NUMA make Raspberry Pi go ZOOMA

NUMA NUMA make Raspberry Pi go ZOOMA

Raspberry Pi 5 gets 10-15% speedup with 100 line Linux kernel patch. And what if we could save 50 megawatt-hours of power annually, just with a software patch for older Pis? I’ll walk through the NUMA Emulation patch that supposedly boosts Pi 5 performance, as...