Text Generation
Transformers
Safetensors
GGUF
English
qwen3_5
image-text-to-text
decision-model
typed-decisions
calibration
calibrated-probabilities
classification
tool-selection
agent-routing
decision-index
jevbench
jev-compatible
systemone
wald
wald-q4b
qwen3.5
4b
vllm
reasoning
llama.cpp
conversational
Eval Results (legacy)
Instructions to use org2ai/Wald-4B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use org2ai/Wald-4B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="org2ai/Wald-4B") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("org2ai/Wald-4B") model = AutoModelForMultimodalLM.from_pretrained("org2ai/Wald-4B", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use org2ai/Wald-4B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "org2ai/Wald-4B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "org2ai/Wald-4B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/org2ai/Wald-4B
- SGLang
How to use org2ai/Wald-4B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "org2ai/Wald-4B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "org2ai/Wald-4B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "org2ai/Wald-4B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "org2ai/Wald-4B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use org2ai/Wald-4B with Docker Model Runner:
docker model run hf.co/org2ai/Wald-4B
Card: describe teacher models as large frontier models
Browse filesText-only: teacher/label model attribution in NOTICE, PROVENANCE, README (en/zh) and model-info now reads "large frontier models"; MANIFEST hashes updated for the edited files. No weights or tags changed.
- MANIFEST.json +10 -10
- NOTICE +1 -1
- PROVENANCE.md +1 -1
- README.md +3 -3
- docs/readmes/README.zh.md +3 -3
- model-info.json +1 -1
MANIFEST.json
CHANGED
|
@@ -12,16 +12,16 @@
|
|
| 12 |
"sha256": "c95bae1d1ce0235ecccd3560b772ec1efb97f348a79f0fbe0a634f0c2ccefe2c"
|
| 13 |
},
|
| 14 |
"NOTICE": {
|
| 15 |
-
"bytes":
|
| 16 |
-
"sha256": "
|
| 17 |
},
|
| 18 |
"PROVENANCE.md": {
|
| 19 |
-
"bytes":
|
| 20 |
-
"sha256": "
|
| 21 |
},
|
| 22 |
"README.md": {
|
| 23 |
-
"bytes":
|
| 24 |
-
"sha256": "
|
| 25 |
},
|
| 26 |
"RUNBOOK.md": {
|
| 27 |
"bytes": 4980,
|
|
@@ -44,8 +44,8 @@
|
|
| 44 |
"sha256": "e385b92e333eaaa9395a09daf26c09420645bee242456552a55500db45919bc7"
|
| 45 |
},
|
| 46 |
"docs/readmes/README.zh.md": {
|
| 47 |
-
"bytes":
|
| 48 |
-
"sha256": "
|
| 49 |
},
|
| 50 |
"evaluation/benchmark-summary.json": {
|
| 51 |
"bytes": 36014,
|
|
@@ -220,8 +220,8 @@
|
|
| 220 |
"sha256": "ad20de47de5bbe7f72417f3d87e6f72aae7987fab913eb814b818e4a4bbc6e1e"
|
| 221 |
},
|
| 222 |
"model-info.json": {
|
| 223 |
-
"bytes":
|
| 224 |
-
"sha256": "
|
| 225 |
},
|
| 226 |
"llms.txt": {
|
| 227 |
"bytes": 3299,
|
|
|
|
| 12 |
"sha256": "c95bae1d1ce0235ecccd3560b772ec1efb97f348a79f0fbe0a634f0c2ccefe2c"
|
| 13 |
},
|
| 14 |
"NOTICE": {
|
| 15 |
+
"bytes": 1591,
|
| 16 |
+
"sha256": "7b37cfe73768e3c01481d0a5d0f097b307cc6b556968c7f4072f6d56b108e061"
|
| 17 |
},
|
| 18 |
"PROVENANCE.md": {
|
| 19 |
+
"bytes": 2139,
|
| 20 |
+
"sha256": "cde98850a90a3159ee17cac4e3e2bc0e267c16e84bb5813b4f97aa8cf4b1ba2e"
|
| 21 |
},
|
| 22 |
"README.md": {
|
| 23 |
+
"bytes": 27927,
|
| 24 |
+
"sha256": "d389337645dabd0124391761a37edd08d24ffa272998346f41a2123995ce3895"
|
| 25 |
},
|
| 26 |
"RUNBOOK.md": {
|
| 27 |
"bytes": 4980,
|
|
|
|
| 44 |
"sha256": "e385b92e333eaaa9395a09daf26c09420645bee242456552a55500db45919bc7"
|
| 45 |
},
|
| 46 |
"docs/readmes/README.zh.md": {
|
| 47 |
+
"bytes": 23706,
|
| 48 |
+
"sha256": "47e10ff98866a8a8c5747f6534ea0dbf2c02e4a96eb80582d342d9e40d7ccb43"
|
| 49 |
},
|
| 50 |
"evaluation/benchmark-summary.json": {
|
| 51 |
"bytes": 36014,
|
|
|
|
| 220 |
"sha256": "ad20de47de5bbe7f72417f3d87e6f72aae7987fab913eb814b818e4a4bbc6e1e"
|
| 221 |
},
|
| 222 |
"model-info.json": {
|
| 223 |
+
"bytes": 6179,
|
| 224 |
+
"sha256": "efcfdef89980654e6b7988fa583bf044aecf3a25fc6d3ea4123a10b79f3d16b4"
|
| 225 |
},
|
| 226 |
"llms.txt": {
|
| 227 |
"bytes": 3299,
|
NOTICE
CHANGED
|
@@ -20,4 +20,4 @@ No benchmark items or training data are included in this repository.
|
|
| 20 |
|
| 21 |
2026-09-29 release: Wald-Q4B 022D0-f7. See PROVENANCE.md for later training-source rights limitations; the code/base license does not grant rights to third-party training texts.
|
| 22 |
|
| 23 |
-
2026-10-01 release: Wald-Q4B v1.2 (02600-f19), a robustness LoRA stage merged into Wald-Q4B 022D0-f7. The inserted training texts of this stage were written by
|
|
|
|
| 20 |
|
| 21 |
2026-09-29 release: Wald-Q4B 022D0-f7. See PROVENANCE.md for later training-source rights limitations; the code/base license does not grant rights to third-party training texts.
|
| 22 |
|
| 23 |
+
2026-10-01 release: Wald-Q4B v1.2 (02600-f19), a robustness LoRA stage merged into Wald-Q4B 022D0-f7. The inserted training texts of this stage were written by large frontier models (vendors and model names are not listed); see PROVENANCE.md.
|
PROVENANCE.md
CHANGED
|
@@ -12,7 +12,7 @@ v1.2 adds one LoRA stage on v1.1. The v1.1 notes above apply unchanged.
|
|
| 12 |
|
| 13 |
- **Questions.** 5,300 questions drawn from v1.1's own training text. No new source dataset was added.
|
| 14 |
- **Perturbed rows.** 8,064 perturbed copies of those questions (13,674 training rows with repeats and 5,000 unperturbed replay rows). Each perturbed row has a short distracting or pressuring text inserted into the question, after an option or into the state, or is a paraphrase or a typo variant.
|
| 15 |
-
- **Text written by a model.** The inserted texts and the paraphrases were written by **
|
| 16 |
- **Targets.** v1.1's own answer distribution on the unperturbed question.
|
| 17 |
- **Benchmarks.** No JevAdvBench text was used. JevAdvBench is evaluation-only.
|
| 18 |
|
|
|
|
| 12 |
|
| 13 |
- **Questions.** 5,300 questions drawn from v1.1's own training text. No new source dataset was added.
|
| 14 |
- **Perturbed rows.** 8,064 perturbed copies of those questions (13,674 training rows with repeats and 5,000 unperturbed replay rows). Each perturbed row has a short distracting or pressuring text inserted into the question, after an option or into the state, or is a paraphrase or a typo variant.
|
| 15 |
+
- **Text written by a model.** The inserted texts and the paraphrases were written by **large frontier models** from our own templates (vendors and model names are not listed). A script inserted them, so the original question text is unchanged. Typos were produced by a script. A separate large-frontier-model call checked every row, and rows on which v1.1 changed its answer were checked again by a second large frontier model.
|
| 16 |
- **Targets.** v1.1's own answer distribution on the unperturbed question.
|
| 17 |
- **Benchmarks.** No JevAdvBench text was used. JevAdvBench is evaluation-only.
|
| 18 |
|
README.md
CHANGED
|
@@ -230,8 +230,8 @@ v1.1 combines full-parameter decision training, LoRA refinement, short-thought d
|
|
| 230 |
|
| 231 |
- **Questions:** 5,300 questions drawn from v1.1's own training text. No new source dataset.
|
| 232 |
- **Perturbations:** 8,064 perturbed copies. Each one has a short text inserted into the question, after an option or into the state: unrelated sentences and off-topic passages, a bystander's opinion, rumour or analogy that pushes another option, or a fake instruction that claims authority. A smaller share are paraphrases and typos.
|
| 233 |
-
- **Who wrote them:** **the inserted texts and the paraphrases were written by
|
| 234 |
-
- **Checks:** a separate
|
| 235 |
- **Targets:** v1.1's own answer distribution on the clean question. The model is taught to answer the perturbed question as v1.1 answers the clean one. 5,000 clean rows are replayed against v1.1 to limit drift.
|
| 236 |
- **Separation from the benchmark:** no JevAdvBench text was used. An 8-gram overlap check of every inserted text against every JevAdvBench string (clean questions and all 9,744 attacked variants) found 0 hits.
|
| 237 |
|
|
@@ -333,7 +333,7 @@ Leaderboard rows are scored by the maintainers; Wald's number is self-run with t
|
|
| 333 |
|
| 334 |
**Can I fine-tune it for my task?** It is a standard Transformers checkpoint, so common LoRA tooling applies. For v1.0 we trained per-task LoRAs for $0.12–$1.81 of GPU time each; that tooling is not public yet, and those adapters are not validated on v1.1 or v1.2 ([v1.0 notes](https://huggingface.co/org2ai/Wald-4B/blob/main/history/v1.0/README.md)).
|
| 335 |
|
| 336 |
-
**What is the license?** Apache-2.0 for the weights and code. The base model, Qwen3.5-4B-Base, is also Apache-2.0. Some public training sources have their own terms or no stated licence; they are listed in [PROVENANCE.md](https://huggingface.co/org2ai/Wald-4B/blob/main/PROVENANCE.md). The model and code licence does not grant rights in those texts. v1.2 adds no new source dataset; its added training text was written by
|
| 337 |
|
| 338 |
## Limits
|
| 339 |
|
|
|
|
| 230 |
|
| 231 |
- **Questions:** 5,300 questions drawn from v1.1's own training text. No new source dataset.
|
| 232 |
- **Perturbations:** 8,064 perturbed copies. Each one has a short text inserted into the question, after an option or into the state: unrelated sentences and off-topic passages, a bystander's opinion, rumour or analogy that pushes another option, or a fake instruction that claims authority. A smaller share are paraphrases and typos.
|
| 233 |
+
- **Who wrote them:** **the inserted texts and the paraphrases were written by large frontier models from our own templates (vendors and model names are not listed).** A script inserted them, so the original facts stay byte-identical. Typos were made by a script.
|
| 234 |
+
- **Checks:** a separate large-frontier-model call checked every row ("does the edit change the correct answer?") and rejected rows were dropped. Rows on which v1.1 changed its answer were checked a second time by another large frontier model.
|
| 235 |
- **Targets:** v1.1's own answer distribution on the clean question. The model is taught to answer the perturbed question as v1.1 answers the clean one. 5,000 clean rows are replayed against v1.1 to limit drift.
|
| 236 |
- **Separation from the benchmark:** no JevAdvBench text was used. An 8-gram overlap check of every inserted text against every JevAdvBench string (clean questions and all 9,744 attacked variants) found 0 hits.
|
| 237 |
|
|
|
|
| 333 |
|
| 334 |
**Can I fine-tune it for my task?** It is a standard Transformers checkpoint, so common LoRA tooling applies. For v1.0 we trained per-task LoRAs for $0.12–$1.81 of GPU time each; that tooling is not public yet, and those adapters are not validated on v1.1 or v1.2 ([v1.0 notes](https://huggingface.co/org2ai/Wald-4B/blob/main/history/v1.0/README.md)).
|
| 335 |
|
| 336 |
+
**What is the license?** Apache-2.0 for the weights and code. The base model, Qwen3.5-4B-Base, is also Apache-2.0. Some public training sources have their own terms or no stated licence; they are listed in [PROVENANCE.md](https://huggingface.co/org2ai/Wald-4B/blob/main/PROVENANCE.md). The model and code licence does not grant rights in those texts. v1.2 adds no new source dataset; its added training text was written by large frontier models, as described above.
|
| 337 |
|
| 338 |
## Limits
|
| 339 |
|
docs/readmes/README.zh.md
CHANGED
|
@@ -111,8 +111,8 @@ v1.1 结合全参数决策训练、LoRA 精修、短思考蒸馏和 RLCD。训
|
|
| 111 |
|
| 112 |
- **题目**:从 v1.1 自己的训练文本里取 5,300 道题。没有新增数据来源。
|
| 113 |
- **扰动**:8,064 条扰动副本。每条在题干、某个选项后或状态里插入一小段文字:无关句子和离题段落,旁观者把答案往另一个选项推的意见、传言或类比,或自称有权限的伪造指令。少部分是改写和错别字。
|
| 114 |
-
- **谁写的**:**插入的文字和改写由
|
| 115 |
-
- **核对**:每一条都由另一次
|
| 116 |
- **训练目标**:v1.1 自己在干净题上的答案分布。也就是教模型在被扰动的题上,答得和 v1.1 在干净题上一样。另外回放 5,000 条干净题并向 v1.1 对齐,限制漂移。
|
| 117 |
- **与基准隔离**:没有使用任何 JevAdvBench 文本。把每段插入文字与 JevAdvBench 的全部字符串(干净题和全部 9,744 个攻击变体)做 8-gram 重叠检查,命中 0 处。
|
| 118 |
|
|
@@ -214,7 +214,7 @@ v1.1 结合全参数决策训练、LoRA 精修、短思考蒸馏和 RLCD。训
|
|
| 214 |
|
| 215 |
**能针对我的任务微调吗?** 它是标准的 Transformers checkpoint,常见的 LoRA 工具都适用。v1.0 时我们为单个任务训练 LoRA,每个花费 $0.12–$1.81 的 GPU 时间;这套工具尚未公开,这些 adapter 也未在 v1.1 或 v1.2 上验证([v1.0 说明](https://huggingface.co/org2ai/Wald-4B/blob/main/history/v1.0/README.md))。
|
| 216 |
|
| 217 |
-
**许可证是什么?** 权重与代码为 Apache-2.0。基座 Qwen3.5-4B-Base 也是 Apache-2.0。部分公开训练数据有各自的条款或没有注明许可证,列在 [PROVENANCE.md](https://huggingface.co/org2ai/Wald-4B/blob/main/PROVENANCE.md)。模型与代码的许可证不授予这些文本的权利。v1.2 没有新增数据来源;它新增的训练文字由
|
| 218 |
|
| 219 |
## 使用限制
|
| 220 |
|
|
|
|
| 111 |
|
| 112 |
- **题目**:从 v1.1 自己的训练文本里取 5,300 道题。没有新增数据来源。
|
| 113 |
- **扰动**:8,064 条扰动副本。每条在题干、某个选项后或状态里插入一小段文字:无关句子和离题段落,旁观者把答案往另一个选项推的意见、传言或类比,或自称有权限的伪造指令。少部分是改写和错别字。
|
| 114 |
+
- **谁写的**:**插入的文字和改写由大型前沿模型(large frontier models)按我们自己的模板写成,不列出厂商和模型名称。** 插入由脚本完成,所以原题的事实逐字节不变。错别字由脚本生成。
|
| 115 |
+
- **核对**:每一条都由另一次大型前沿模型调用核对(“这处改动会不会改变正确答案?”),被判会改变的丢弃。v1.1 答案发生变化的那些行再由另一个大型前沿模型复核一遍。
|
| 116 |
- **训练目标**:v1.1 自己在干净题上的答案分布。也就是教模型在被扰动的题上,答得和 v1.1 在干净题上一样。另外回放 5,000 条干净题并向 v1.1 对齐,限制漂移。
|
| 117 |
- **与基准隔离**:没有使用任何 JevAdvBench 文本。把每段插入文字与 JevAdvBench 的全部字符串(干净题和全部 9,744 个攻击变体)做 8-gram 重叠检查,命中 0 处。
|
| 118 |
|
|
|
|
| 214 |
|
| 215 |
**能针对我的任务微调吗?** 它是标准的 Transformers checkpoint,常见的 LoRA 工具都适用。v1.0 时我们为单个任务训练 LoRA,每个花费 $0.12–$1.81 的 GPU 时间;这套工具尚未公开,这些 adapter 也未在 v1.1 或 v1.2 上验证([v1.0 说明](https://huggingface.co/org2ai/Wald-4B/blob/main/history/v1.0/README.md))。
|
| 216 |
|
| 217 |
+
**许可证是什么?** 权重与代码为 Apache-2.0。基座 Qwen3.5-4B-Base 也是 Apache-2.0。部分公开训练数据有各自的条款或没有注明许可证,列在 [PROVENANCE.md](https://huggingface.co/org2ai/Wald-4B/blob/main/PROVENANCE.md)。模型与代码的许可证不授予这些文本的权利。v1.2 没有新增数据来源;它新增的训练文字由大型前沿模型写成,见上文。
|
| 218 |
|
| 219 |
## 使用限制
|
| 220 |
|
model-info.json
CHANGED
|
@@ -172,5 +172,5 @@
|
|
| 172 |
"revision": "50f94ecd5d6e7e8459e9c198ef811bfaba12a3fe"
|
| 173 |
},
|
| 174 |
"thinking_note": "v1.2 is a one-pass model. On the JevBench public set it scored 198/231 with medium and with high (one run each) against 204/231 with none. Thinking efforts are evaluated on v1.1.",
|
| 175 |
-
"training_data_note": "perturbed copies of v1.1 training questions; inserted texts written by
|
| 176 |
}
|
|
|
|
| 172 |
"revision": "50f94ecd5d6e7e8459e9c198ef811bfaba12a3fe"
|
| 173 |
},
|
| 174 |
"thinking_note": "v1.2 is a one-pass model. On the JevBench public set it scored 198/231 with medium and with high (one run each) against 204/231 with none. Thinking efforts are evaluated on v1.1.",
|
| 175 |
+
"training_data_note": "perturbed copies of v1.1 training questions; inserted texts written by large frontier models from our templates (vendors and model names not listed); targets are v1.1 answers on the clean questions; no JevAdvBench text"
|
| 176 |
}
|