Instructions to use pcuenq/MiMo-V2.6-Pro-MOPD-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use pcuenq/MiMo-V2.6-Pro-MOPD-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf pcuenq/MiMo-V2.6-Pro-MOPD-GGUF:MXFP4 # Run inference directly in the terminal: llama cli -hf pcuenq/MiMo-V2.6-Pro-MOPD-GGUF:MXFP4
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf pcuenq/MiMo-V2.6-Pro-MOPD-GGUF:MXFP4 # Run inference directly in the terminal: llama cli -hf pcuenq/MiMo-V2.6-Pro-MOPD-GGUF:MXFP4
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf pcuenq/MiMo-V2.6-Pro-MOPD-GGUF:MXFP4 # Run inference directly in the terminal: ./build/bin/llama cli -hf pcuenq/MiMo-V2.6-Pro-MOPD-GGUF:MXFP4
Use Docker
docker model run hf.co/pcuenq/MiMo-V2.6-Pro-MOPD-GGUF:MXFP4
- Llama new
- LM Studio
- Jan
- vLLM
How to use pcuenq/MiMo-V2.6-Pro-MOPD-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "pcuenq/MiMo-V2.6-Pro-MOPD-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "pcuenq/MiMo-V2.6-Pro-MOPD-GGUF", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/pcuenq/MiMo-V2.6-Pro-MOPD-GGUF:MXFP4
- Ollama
How to use pcuenq/MiMo-V2.6-Pro-MOPD-GGUF with Ollama:
ollama run hf.co/pcuenq/MiMo-V2.6-Pro-MOPD-GGUF:MXFP4
- Unsloth Desktop
- Pi
How to use pcuenq/MiMo-V2.6-Pro-MOPD-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf pcuenq/MiMo-V2.6-Pro-MOPD-GGUF:MXFP4
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "pcuenq/MiMo-V2.6-Pro-MOPD-GGUF:MXFP4" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use pcuenq/MiMo-V2.6-Pro-MOPD-GGUF with Docker Model Runner:
docker model run hf.co/pcuenq/MiMo-V2.6-Pro-MOPD-GGUF:MXFP4
- Lemonade
How to use pcuenq/MiMo-V2.6-Pro-MOPD-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull pcuenq/MiMo-V2.6-Pro-MOPD-GGUF:MXFP4
Run and chat with the model
lemonade run user.MiMo-V2.6-Pro-MOPD-GGUF-MXFP4
List all available models
lemonade list
- Hermes Agent
How to use pcuenq/MiMo-V2.6-Pro-MOPD-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf pcuenq/MiMo-V2.6-Pro-MOPD-GGUF:MXFP4
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default pcuenq/MiMo-V2.6-Pro-MOPD-GGUF:MXFP4
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use pcuenq/MiMo-V2.6-Pro-MOPD-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf pcuenq/MiMo-V2.6-Pro-MOPD-GGUF:MXFP4
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "pcuenq/MiMo-V2.6-Pro-MOPD-GGUF:MXFP4" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
sidecars (#3)
Browse files- sidecars (23c6446cd917b9516484a48f50f4b251d6e0c51a)
- .gitattributes +7 -0
- dflash-MiMo-V2.6-Pro-MOPD-BF16.gguf +3 -0
- dflash-MiMo-V2.6-Pro-MOPD-Q8_0.gguf +3 -0
- mmproj-MiMo-V2.6-Pro-MOPD-BF16.gguf +3 -0
- mmproj-MiMo-V2.6-Pro-MOPD-Q8_0.gguf +3 -0
- mtp-MiMo-V2.6-Pro-MOPD-BF16.gguf +3 -0
- mtp-MiMo-V2.6-Pro-MOPD-Q4_0.gguf +3 -0
- mtp-MiMo-V2.6-Pro-MOPD-Q8_0.gguf +3 -0
.gitattributes
CHANGED
|
@@ -63,3 +63,10 @@ MiMo-V2.6-Pro-MOPD-Q3_K-00012-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
|
|
| 63 |
MiMo-V2.6-Pro-MOPD-Q3_K-00013-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
|
| 64 |
MiMo-V2.6-Pro-MOPD-Q3_K-00014-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
|
| 65 |
MiMo-V2.6-Pro-MOPD-Q3_K-00015-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 63 |
MiMo-V2.6-Pro-MOPD-Q3_K-00013-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
|
| 64 |
MiMo-V2.6-Pro-MOPD-Q3_K-00014-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
|
| 65 |
MiMo-V2.6-Pro-MOPD-Q3_K-00015-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
|
| 66 |
+
dflash-MiMo-V2.6-Pro-MOPD-BF16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 67 |
+
dflash-MiMo-V2.6-Pro-MOPD-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 68 |
+
mmproj-MiMo-V2.6-Pro-MOPD-BF16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 69 |
+
mmproj-MiMo-V2.6-Pro-MOPD-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 70 |
+
mtp-MiMo-V2.6-Pro-MOPD-BF16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 71 |
+
mtp-MiMo-V2.6-Pro-MOPD-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 72 |
+
mtp-MiMo-V2.6-Pro-MOPD-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
dflash-MiMo-V2.6-Pro-MOPD-BF16.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c73f95ace173c4c22714f5908fd96ffe23ccea77be75cadf6a8975e5060956df
|
| 3 |
+
size 5542735104
|
dflash-MiMo-V2.6-Pro-MOPD-Q8_0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d4730cd2eb45b9ac6bea082ef831113bc4be3e47e8dbb260620fc6a02f6da722
|
| 3 |
+
size 2947509504
|
mmproj-MiMo-V2.6-Pro-MOPD-BF16.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6de093c1bcc1331d830216c37d6c76eabf57b661636bce8b4cb4fc5c39cc49ed
|
| 3 |
+
size 2836590176
|
mmproj-MiMo-V2.6-Pro-MOPD-Q8_0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4e477e8c4051d6e980f69352c516882920f0a33817ec3b3ff1ac92b329a0039d
|
| 3 |
+
size 1611230816
|
mtp-MiMo-V2.6-Pro-MOPD-BF16.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bc8e649446f0b20a9dd78817eac8b8941b72b16e10261d3125c6f8ab5510e474
|
| 3 |
+
size 7625299104
|
mtp-MiMo-V2.6-Pro-MOPD-Q4_0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:79266332d5094fd758e6df3805f4758633a38b7bf53b8f7cf26262f0f71ec291
|
| 3 |
+
size 2149176480
|
mtp-MiMo-V2.6-Pro-MOPD-Q8_0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1403612d2265d7d8384aa01cbb63f6827f936a849f99e49be34d3d40a431c16f
|
| 3 |
+
size 4053914784
|