LLM hardware acceleration—on a Raspberry Pi

LLM hardware acceleration—on a Raspberry Pi

The Raspberry Pi is a compelling low-power option for running GPU-accelerated LLMs locally. For my main test setup, here’s the hardware I used (some links are affiliate links): – Raspberry Pi 5 8GB ($80):...
This is how you destroy Raspberry Pi

This is how you destroy Raspberry Pi

LattePanda’s Mu is the latest entrant in the ‘Pi Killer’ battle, but it has a trick up its sleeve. LattePanda sent me the Mu and carrier board for review, so I’m marking this video as having a ‘product placement’—however,...
GPS and a Raspberry Pi over PCI—the new Time Card mini!

GPS and a Raspberry Pi over PCI—the new Time Card mini!

Special thanks to Timebeat for sending the Time Card, the GPS modules, and the tiny little time oven chip! If you want to buy one of these things, Timebeat sent me a discount code for you to use, for 20% off: https://store.timebeat.app/discount/IKNOWREDJEFF Some of...
The Raspberry Pi that came back from the dead (CM4S)

The Raspberry Pi that came back from the dead (CM4S)

Thanks to Revolution Pi for sending this RevPi Connect S along with the Compute Module 4S. Go check out their industrial computing products: https://revolutionpi.com Also mentioned in this video: – Why are Industrial Pis so expensive?...
Raspberry Pi demolished by monster 128-core ARM CPU!

Raspberry Pi demolished by monster 128-core ARM CPU!

The collab nobody knew we needed. I took my 6-node Raspberry Pi cluster to @ServeTheHome and faced it off against a 128-core monster ARM server. Huge thanks to Micro Center for making this possible! Shop Micro Center’s Top Deals: https://micro.center/1yz Check...