gpt54-mini-sequential-qwen3-1.7b-rose-s2-textcraft-20260920

Qwen/Qwen3-1.7B trained with ROSE using teacher gpt-5.4-mini. This is the final checkpoint of a completed textcraft stage: five epochs, 55 optimizer updates in that stage.

Sequential stage 2 of BabyAI โ†’ TextCraft โ†’ SearchQA. Completed training prefix: babyai โ†’ textcraft. Each environment receives five epochs. The student and method are carried through the chain.

Training-completion evidence: Observed complete stage manifest, verified full-step count, and complete controller task with verification marker.

No completed evaluation for this intermediate checkpoint is attached. Final three-environment scores belong only to the fully trained stage-3 model.

Provenance and interpretation notes:

  • This is one trained checkpoint, not evidence of a general method advantage or replication across training seeds.
  • The selection inventory records file names, sizes and modification times. It is not a tensor-byte hash binding to historical evaluation responses.
  • No stage-specific evaluation is attached. Scores of later sequential checkpoints or standalone models must not be attributed to this checkpoint.
  • This checkpoint is from a separate sequential chain, not the historical standalone run. Each stage carries the preceding stage of the same method and student.

The HF export is stored at the repository root; configuration, tokenizer, and all weight shards are included. Optimizer state, raw logs, and teacher trajectories are not included. Machine-readable source references and checksums are in experiment.json.

from transformers import AutoTokenizer, AutoModelForCausalLM
repo_id = "Diluner/gpt54-mini-sequential-qwen3-1.7b-rose-s2-textcraft-20260920"
tokenizer = AutoTokenizer.from_pretrained(repo_id)
model = AutoModelForCausalLM.from_pretrained(repo_id, torch_dtype="auto")

Repository access is public, as authorized by the experiment owner. No license is asserted here; consult the base model and applicable terms.

Downloads last month
47
Safetensors
Model size
2B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Diluner/gpt54-mini-sequential-qwen3-1.7b-rose-s2-textcraft-20260920

Finetuned
Qwen/Qwen3-1.7B
Finetuned
(1358)
this model