How to run Deepseek R1 671B model on a desktop PC

https://huggingface.co/unsloth/DeepSeek-R1-GGUF

Download Deepseek R1 671B model from Huggingface.co to C:\AIModels

Open Huggingface.co
Figure 1 - Open Huggingface.co

Open model page
Figure 2 - Open model page

Download model files
Figure 3 - Download model files

Paste model file into AIModels folder
Figure 4 - Paste model file into C:\AIModels folder

Create Ozeki AI server model and Chatbot

Open Ozeki AI studio
Figure 5 - Open Ozeki AI studio

Create newm GGUF model
Figure 6 - Create newm GGUF model

Select model file
Figure 7 - Select model file

Open model details
Figure 8 - Open model details

Set GPU layer options
Figure 9 - Set GPU layer options

Create new AI chatbot
Figure 10 - Create new AI chatbot

Select model
Figure 11 - Select model

Ask a question from the model
Figure 12 - Ask a question from the model

Model response
Figure 13 - Model response

Chat communication log
Figure 14 - Chat communication log

More information