Dave Plummer installs Deepseek on a Jetson Orin Nano and a Threadripper and explores the self-hosted editions of Deepseek R1 and evaluates their performance on a wide range of hardware. Free Sample of my Book on the Spectrum: https://amzn.to/3zBinWM
Secrets of the Autistic Millionaire: https://amzn.to/3WNDDkJ
Watch ShopTalk Now on Dave's Attic:
https://youtu.be/5Emgx0lhllE
Follow me on X: https://x.com/davepl1968
Facebook: https://www.facebook.com/davepl
Introduction to the Affordable NVIDIA Jetson Orin Nano Super:
00:00
Why Run AI Locally?:
00:31
Advantages of Self-Hosted AI:
01:02
Jetson Nano Specifications:
01:33
Setting Up DeepSeek R1 with Olama:
02:04
Privacy Benefits of Local AI:
03:06
Running Queries Locally:
03:57
Use Cases for Home Automation:
05:09
Cost-Effectiveness of Jetson Nano:
05:40
Reasoning Models vs Traditional LLMs:
06:42
7B Parameter Model Performance Review On Affordable Jetson Orin Nano:
8:53
Running the full DeepSeek-R1 671B on $10,000+ machine
9:20
Outro -
11:58