LLM hardware acceleration—on a Raspberry Pi

LLM hardware acceleration—on a Raspberry Pi

The Raspberry Pi is a compelling low-power option for running GPU-accelerated LLMs locally. For my main test setup, here’s the hardware I used (some links are affiliate links): – Raspberry Pi 5 8GB ($80):...
Tiny Radxa X4 unites Intel x86 with Raspberry Pi GPIO

Tiny Radxa X4 unites Intel x86 with Raspberry Pi GPIO

The Radxa X4 unites an Intel N100 SoC with a Raspberry Pi RP2040. The best of both worlds, right? Let’s explore thermals, power delivery, peripheral and OS support, and even take Linux and Windows for a spin on the PCIe Gen 3×4 NVMe SSD! I purchased all the...
Raspberry Pi Pico 2: a RISC-V bet!

Raspberry Pi Pico 2: a RISC-V bet!

The Pico 2 has Raspberry Pi’s latest silicon, the RP2350. But there’s more than meets the eye, like RISC-V and an additional PIO. The Raspberry Pi Pico 2 tested in this video was sent by Raspberry Pi for review, they did not pay anything or have any input...
EXTREME Overclock (requires hacking Raspberry Pi firmware)

EXTREME Overclock (requires hacking Raspberry Pi firmware)

WARNING: DO NOT TRY THIS AT HOME! Code is here: https://github.com/geerlingguy/pi-overvolt If you attempt to replicate this experiment, your warranty will most certainly be void, and there’s a good chance you kill your Pi attempting this overclock. You’ll...
NUMA NUMA make Raspberry Pi go ZOOMA

NUMA NUMA make Raspberry Pi go ZOOMA

Raspberry Pi 5 gets 10-15% speedup with 100 line Linux kernel patch. And what if we could save 50 megawatt-hours of power annually, just with a software patch for older Pis? I’ll walk through the NUMA Emulation patch that supposedly boosts Pi 5 performance, as...