OpenAI's nightmare: Deepseek R1 on a Raspberry Pi

DeepSeek R1 runs on a Pi 5, but don't believe every headline you read.

Resources referenced in this video:

- DeepSeek R1: https://github.com/deepseek-ai/DeepSeek-R1
- Ollama and llama.cpp benchmarks on Pi 5: https://github.com/geerlingguy/ollama-benchmark/issues/9
- Reuters article on DeepSeek: https://www.reuters.com/technology/artificial-intelligence/what-is-deepseek-why-is-it-disrupting-ai-sector-2025-01-27/
- DeepSeek FAQ from Stratchery: https://stratechery.com/2025/deepseek-faq/

Support me on Patreon: https://www.patreon.com/geerlingguy
Sponsor me on GitHub: https://github.com/sponsors/geerlingguy
Merch: https://www.redshirtjeff.com
2nd Channel: https://www.youtube.com/@GeerlingEngineering
3rd Channel: https://www.youtube.com/@Level2Jeff

Contents:

00:00 - OpenAI's Nightmare
01:00 - What can a Pi 5 do, really?
01:39 - 671b on AmpereOne
02:00 - Pi 5 14b - CPU inference
02:20 - Pi 5 14b - GPU inference
03:05 - GPUs on Pi (and year of the Arm PC)
03:37 - Still in an AI bubble