下载模型

wget -c "https://huggingface.co/HauhauCS/Qwen3.5-9B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-Q4_K_M.gguf" -O Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-Q4_K_M.gguf
wget -c "https://huggingface.co/HauhauCS/Qwen3.5-9B-Uncensored-HauhauCS-Aggressive/resolve/main/mmproj-Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-BF16.gguf" -O mmproj-Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-BF16.gguf

工具加载模型

• https://github.com/LostRuins/koboldcpp
• https://github.com/a-ghorbani/pocketpal-ai