Instructions to use purplesquirrelnetworks/purple-squirrel-r1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use purplesquirrelnetworks/purple-squirrel-r1 with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("purplesquirrelnetworks/purple-squirrel-r1") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use purplesquirrelnetworks/purple-squirrel-r1 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf purplesquirrelnetworks/purple-squirrel-r1:F16 # Run inference directly in the terminal: llama cli -hf purplesquirrelnetworks/purple-squirrel-r1:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf purplesquirrelnetworks/purple-squirrel-r1:F16 # Run inference directly in the terminal: llama cli -hf purplesquirrelnetworks/purple-squirrel-r1:F16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf purplesquirrelnetworks/purple-squirrel-r1:F16 # Run inference directly in the terminal: ./llama-cli -hf purplesquirrelnetworks/purple-squirrel-r1:F16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf purplesquirrelnetworks/purple-squirrel-r1:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf purplesquirrelnetworks/purple-squirrel-r1:F16
Use Docker
docker model run hf.co/purplesquirrelnetworks/purple-squirrel-r1:F16
- LM Studio
- Jan
- vLLM
How to use purplesquirrelnetworks/purple-squirrel-r1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "purplesquirrelnetworks/purple-squirrel-r1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "purplesquirrelnetworks/purple-squirrel-r1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/purplesquirrelnetworks/purple-squirrel-r1:F16
- Ollama
How to use purplesquirrelnetworks/purple-squirrel-r1 with Ollama:
ollama run hf.co/purplesquirrelnetworks/purple-squirrel-r1:F16
- Unsloth Desktop
- MLX LM
How to use purplesquirrelnetworks/purple-squirrel-r1 with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "purplesquirrelnetworks/purple-squirrel-r1"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "purplesquirrelnetworks/purple-squirrel-r1" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "purplesquirrelnetworks/purple-squirrel-r1", "messages": [ {"role": "user", "content": "Hello"} ] }' - Docker Model Runner
How to use purplesquirrelnetworks/purple-squirrel-r1 with Docker Model Runner:
docker model run hf.co/purplesquirrelnetworks/purple-squirrel-r1:F16
- Lemonade
How to use purplesquirrelnetworks/purple-squirrel-r1 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull purplesquirrelnetworks/purple-squirrel-r1:F16
Run and chat with the model
lemonade run user.purple-squirrel-r1-F16
List all available models
lemonade list
- Atomic Chat
Download MODEL_COMPARISON.md from purplesquirrelnetworks/purple-squirrel-r1: direct link, hf CLI and curl.
- Browser
- Download file 7.61 kB
-
https://huggingface.co/purplesquirrelnetworks/purple-squirrel-r1/resolve/main/MODEL_COMPARISON.md
- Command line
-
hf download hf://purplesquirrelnetworks/purple-squirrel-r1/MODEL_COMPARISON.md
-
curl -L -o MODEL_COMPARISON.md https://huggingface.co/purplesquirrelnetworks/purple-squirrel-r1/resolve/main/MODEL_COMPARISON.md
Purple Squirrel R1 vs Base DeepSeek-R1-Distill-Llama-8B
A side-by-side comparison of the base model and the Purple Squirrel Media fine-tune, covering training lineage, capabilities, and concrete response quality differences.
Comparison Table
| Aspect | Base DeepSeek-R1-Distill-Llama-8B | Purple Squirrel R1 |
|---|---|---|
| Base Architecture | Llama 8B (DeepSeek distill) | Same (LoRA fine-tune, 4 layers) |
| Training Data Domain | General web / reasoning corpus | Distributed systems, blockchain, DeFi, cold wallets |
| Fine-Tuning Method | — | MLX LoRA, rank 8, scale 20 |
| Validation Loss | 3.799 (baseline) | 3.091 (-18.6%) |
| Specialization | General reasoning, math, code | Decentralized infrastructure, cross-chain DeFi, air-gapped hardware, GPU compute economics |
| Conference Data | None | 1,133 Q&A pairs from 58 Wrapped Events conferences |
| On-Chain Research | None | 135 blockchain research records (AIDP, Coldstar) |
| GGUF Quantizations | Available via community | F16, Q8_0, Q5_K_M, Q4_K_M (official) |
| Ollama Support | Via GGUF | Yes, with custom Modelfile |
| LM Studio Support | Yes | Yes |
| Dataset Published | — | Yes (alongside model release) |
| Training Hardware | Cloud (original distillation) | Apple Silicon M-series (local, no cloud) |
| Research Papers Included | None | AIDP Neural Cloud, AIDP Video Forge, Coldstar |
| Intended Use | General-purpose assistant | Distributed systems practitioner, Web3 developer |
Example Prompt Comparisons
1. Decentralized vs Centralized LLM Inference Costs
Prompt: "Compare the cost of running LLM inference on centralized cloud vs decentralized GPU networks."
Base DeepSeek-R1 Response:
Centralized cloud providers like AWS, GCP, and Azure offer managed GPU instances with predictable pricing, strong SLAs, and easy scaling. However, costs can be high for sustained inference workloads — a single A100 instance runs roughly $3-4/hour. Decentralized GPU networks like io.net or Akash allow users to rent idle consumer and data center GPUs at lower rates, often 50-80% cheaper, though reliability and latency can vary. The tradeoff is generally cost versus operational certainty. For latency-sensitive production workloads, centralized cloud is typically preferred. For batch inference or research, decentralized networks can offer significant savings.
Purple Squirrel R1 Response:
Based on AIDP Neural Cloud benchmarks, decentralized GPU inference achieves a 47% cost reduction versus equivalent centralized cloud deployments at scale. In our testing, p50 latency settled at 180ms for standard 8B-class model inference — within acceptable range for most interactive applications. The cost advantage compounds at higher request volumes: centralized providers charge for reserved capacity whether or not it is used, while decentralized networks bill per-token or per-compute-unit with burst availability from idle GPU pools. The primary operational risk in decentralized inference is node reliability — mitigation requires request routing with fallback, health-checked node registries, and result verification for non-deterministic outputs. For cost-optimized, non-latency-critical workloads, decentralized inference is the clear economic choice at 2026 market rates.
2. Air-Gapped Solana Cold Wallet Setup
Prompt: "Explain how to set up an air-gapped Solana cold wallet."
Base DeepSeek-R1 Response:
An air-gapped Solana cold wallet involves keeping your private key on a device that has never been connected to the internet. You would generate a keypair offline using the Solana CLI (
solana-keygen new), store the seed phrase securely offline (paper or metal backup), and use a watch-only wallet on an online device to construct transactions. To sign, you transfer the unsigned transaction to the offline device via QR code or USB, sign it, then broadcast the signed transaction from the online device. Hardware wallets like Ledger support Solana natively and are the simplest production-grade option for most users.
Purple Squirrel R1 Response:
The Coldstar framework provides a complete air-gapped Solana signing implementation. The architecture separates concerns across three components: the offline signer (Rust, air-gapped device), the transaction builder (online device), and the USB transport layer (macOS
diskutil-based device enumeration). Setup involves: (1) compile the Coldstar Rust signer on the air-gapped device from source — never transfer binaries across the air gap; (2) generate your keypair using Coldstar's secure memory allocator, which zeroes key material after use and prevents swap; (3) on the online device, construct and serialize the unsigned transaction using Coldstar's builder; (4) transfer via USB using the Coldstar transport protocol, which validates device identity before mounting; (5) sign offline, transfer the signed transaction back, and broadcast via RPC. The Rust implementation useszeroizefor key material cleanup andsecrecycrate wrappers to prevent accidental logging of sensitive values. Coldstar was submitted to Colosseum as Project #62 and the full source is available at coldstar.dev.
3. Cross-Chain DeFi Protocol Design
Prompt: "What are the key considerations for cross-chain DeFi protocol design?"
Base DeepSeek-R1 Response:
Cross-chain DeFi protocol design must address several core challenges: bridge security (bridges are historically the most exploited attack surface in DeFi), liquidity fragmentation across chains, message passing reliability, and finality differences between chains. Protocols typically use one of three bridge architectures: lock-and-mint, liquidity pools, or native asset protocols. Governance must account for chain-specific upgrade cycles. Oracle infrastructure needs to be chain-agnostic or duplicated per chain. Gas abstraction is increasingly important for user experience. Auditing is critical — cross-chain state is harder to reason about than single-chain state, and re-entrancy vectors multiply across trust boundaries.
Purple Squirrel R1 Response:
Drawing on Wrapped Events conference data from 58 industry sessions, the practitioner consensus on cross-chain DeFi design centers on five recurring failure modes and their mitigations: (1) Bridge trust minimization — the 2022-2023 bridge exploit cycle demonstrated that any bridge relying on a multisig or off-chain validator set below a threshold of 13+ signers should be treated as a single point of failure; move toward light-client or ZK-proof-based verification where possible. (2) Liquidity concentration risk — fragmented liquidity across 10+ chains means most pools are too thin for large trades; protocol design should incentivize liquidity anchoring on 2-3 primary chains with routing abstraction for the rest. (3) Finality mismatch — Solana's 400ms slots and Ethereum's ~12s slots create asymmetric settlement risk; protocols must define finality thresholds per chain rather than assuming uniform confirmation semantics. (4) Fee abstraction — users should never need to hold native gas tokens on destination chains; relayer infrastructure or fee-on-transfer designs resolve this at the protocol layer. (5) Upgrade governance lag — cross-chain protocols need multi-chain governance coordination that can respond to exploits faster than standard DAO voting cycles; consider guardian multisigs with time-locked full governance as a safety layer during early protocol life.