LLM hardware acceleration—on a Raspberry Pi

LLM hardware acceleration—on a Raspberry Pi

The Raspberry Pi is a compelling low-power option for running GPU-accelerated LLMs locally. For my main test setup, here’s the hardware I used (some links are affiliate links): – Raspberry Pi 5 8GB ($80):...
Tiny Radxa X4 unites Intel x86 with Raspberry Pi GPIO

Tiny Radxa X4 unites Intel x86 with Raspberry Pi GPIO

The Radxa X4 unites an Intel N100 SoC with a Raspberry Pi RP2040. The best of both worlds, right? Let’s explore thermals, power delivery, peripheral and OS support, and even take Linux and Windows for a spin on the PCIe Gen 3×4 NVMe SSD! I purchased all the...
EXTREME Overclock (requires hacking Raspberry Pi firmware)

EXTREME Overclock (requires hacking Raspberry Pi firmware)

WARNING: DO NOT TRY THIS AT HOME! Code is here: https://github.com/geerlingguy/pi-overvolt If you attempt to replicate this experiment, your warranty will most certainly be void, and there’s a good chance you kill your Pi attempting this overclock. You’ll...
Overclocking Raspberry Pi 5 to 3.14 GHz on Pi Day

Overclocking Raspberry Pi 5 to 3.14 GHz on Pi Day

Some said it couldn’t be done. In fact, *I* said it couldn’t be done, this morning! Then I did it! Happy Pi Day, here are some resources if you want to try overclocking *your* Pi 5 beyond 3.0 GHz—but be warned, you will be running experimental...
This is what’s inside a Raspberry Pi

This is what’s inside a Raspberry Pi

Visit https://brilliant.org/JeffGeerling to start your 30-day free trial, and get 20% off your annual subscription! The Raspberry Pi 5 can’t be overclocked past 3 GHz. Why? The secret is hidden in the silicon deep inside. X-rays don’t go deep enough. This...