Qwen3-30B-A3B-DAPO-BF16-step-0730

This repository contains training checkpoint step 730, converted from a distributed training checkpoint into standard Hugging Face safetensors. It is part of the Qwen3-30B-A3B W4A4-QAT vs BF16 Checkpoints series.

Checkpoint metadata

  • Architecture: Qwen3MoeForCausalLM
  • Model type: qwen3_moe
  • Base model: Qwen/Qwen3-30B-A3B-Base
  • Training trajectory: BF16 baseline
  • Public trajectory label: BF16 baseline
  • Source checkpoint: global_step_730
  • Tensor storage: BF16
  • Matched counterpart: shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0730
  • Matched source step: 730
  • Absolute step difference: 0

Important quantization note

This is the BF16 baseline trajectory. QAT was disabled, and the repository contains standard BF16 Hugging Face weights.

Intended use

These checkpoints are research artifacts for comparing approximately step-matched W4A4-QAT and BF16 training trajectories. They have not been evaluated here as general-purpose production models.

Validation

The export was checked for:

  • required Hugging Face model and tokenizer metadata;
  • readable safetensors headers and complete shard index;
  • exact index-to-shard key consistency;
  • BF16 tensor dtype throughout;
  • exact key and tensor-shape match against the native Qwen3-MoE architecture;
  • full source-artifact content comparison against the validated export;
  • Hugging Face path, byte-size, LFS SHA256, and metadata-download integrity.

SHA256SUMS covers every published file in this repository except the checksum manifest itself. Internal execution provenance is intentionally omitted from this public release.

Downloads last month
161
Safetensors
Model size
31B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for shawnzzzzz/Qwen3-30B-A3B-DAPO-BF16-step-0730

Finetuned
(62)
this model

Collection including shawnzzzzz/Qwen3-30B-A3B-DAPO-BF16-step-0730