How to setup the Qwen Coder 7B model

Download Qwen Coder 7B model from Huggingface to C:\AIModels

Setup model in Ozeki AI studio

Create HTTP API user for Qwen Coder 7B model

Test Qwen Coder 7B model with Postman

{
	"model": "qwen_coder",
	"messages": [
		{"role": "user", "content": "Write me an example C# function, that adds two numbers"}
	]
}

{
    "id": "chatcmpl-LAKKHDFTWPYROXHMMHPAXNYJCDNWJ",
    "object": "chat.completion",
    "created": 1739274728,
    "model": "qwen_coder",
    "choices": [
        {
            "index": 0,
            "message": {
                "role": "assistant",
                "content": "Here's an example C# function that adds two numbers:\n```\npublic static ...
                "refusal": null
            },
            "logprobs": null,
            "finish_reason": "stop"
        }
    ],
    "usage": {
        "prompt_tokens": 0,
        "completion_tokens": 0,
        "total_tokens": 0,
        "completion_tokens_details": {
            "reasoning_tokens": 0
        }
    },
    "system_fingerprint": "fp_f85bea6784"
}

More information

• How to use a DeepSeek R1 distilled model
• How to use Phi-4 locally
• How to use LLama locally
• How to setup the Qwen Coder 7B model
• How to run Deepseek R1 671B model on a desktop PC
• How to run LLama 405B model on a desktop PC