How to use a Llama 3.1 Model

https://huggingface.co/bartowski/Meta-Llama-3.1-8B-Instruct-GGUF

Download Llama 3.1 model from Huggingface to C:\AIModels

Open Huggingface.co
Figure 1 - Open Huggingface.co

Open model page
Figure 2 - Open model page

Download model file
Figure 3 - Download model file

Paste model file into AIModels folder
Figure 4 - Paste model file into C:\AIModels folder

Setup model and create AI Chat bot

Open AI Studio
Figure 5 - Open AI Studio

Create new GGUF model
Figure 6 - Create new GGUF model

Select model file
Figure 7 - Select model file

Create new AI chatbot
Figure 8 - Create new AI chatbot

Select model
Figure 9 - Select model

Enable chatbot
Figure 10 - Enable chatbot

Conversation with mopdel
Figure 11 - Conversation with mopdel

More information