Qwen/QwQ-32B · Hugging Face
Qwen/QwQ-32B · Hugging Face

huggingface.co
Qwen/QwQ-32B · Hugging Face

Qwen/QwQ-32B · Hugging Face
Qwen/QwQ-32B · Hugging Face
You're viewing a single thread.
GGUF quants are already out: https://huggingface.co/bartowski/Qwen_QwQ-32B-GGUF
Yay! let's try
ollama run hf.co/bartowski/Qwen_QwQ-32B-GGUF:Q4_K_M
/set parameter num_ctx 32768