Robotics
LeRobot
nielsr HF Staff commited on
Commit
7cf3c3b
·
verified ·
1 Parent(s): 728991d

Add model card for MINT-libero

Browse files

This PR adds a comprehensive model card for MINT-libero.
It includes:
- Relevant metadata (license, library name, and pipeline tag).
- Links to the paper, project page, and GitHub repository.
- A brief description of the model's architecture (SDAT tokenization and intent-to-execution reasoning).
- Sample usage for evaluation using the `lerobot` CLI.
- The BibTeX citation.

Files changed (1) hide show
  1. README.md +48 -0
README.md ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: lerobot
4
+ pipeline_tag: robotics
5
+ ---
6
+
7
+ # Mimic Intent, Not Just Trajectories (MINT)
8
+
9
+ MINT (Mimic Intent, Not just Trajectories) is a framework for end-to-end imitation learning in dexterous manipulation. It explicitly disentangles behavior intent from execution details by learning a hierarchical, multi-scale token representation of actions.
10
+
11
+ - **Paper:** [Mimic Intent, Not Just Trajectories](https://huggingface.co/papers/2602.08602)
12
+ - **Project Page:** [https://renming-huang.github.io/MINT/](https://renming-huang.github.io/MINT/)
13
+ - **Repository:** [https://github.com/RenMing-Huang/MINT](https://github.com/RenMing-Huang/MINT)
14
+
15
+ ## Overview ✨
16
+
17
+ MINT addresses the limitations of standard Vision-Language-Action (VLA) models by disentangling behavior intent from execution details via multi-scale frequency-space tokenization. This yields an abstract **Intent token** for planning and **Execution tokens** for precise environmental adaptation. The policy generates trajectories through next-scale autoregression, performing progressive intent-to-execution reasoning.
18
+
19
+ ## Usage 🛠️
20
+
21
+ This model is integrated with the [LeRobot](https://github.com/huggingface/lerobot) library. You can evaluate the policy on LIBERO tasks using the following command:
22
+
23
+ ```bash
24
+ lerobot-eval \
25
+ --policy.path=huangrm/MINT-libero \
26
+ --policy.vqvae_name_or_path=<path/to/tokenizer> \
27
+ --env.type=libero \
28
+ --env.task=libero_10,libero_object,libero_spatial,libero_goal \
29
+ --eval.batch_size=1 \
30
+ --eval.n_episodes=2 \
31
+ --seed=42 \
32
+ --policy.n_action_steps=4
33
+ ```
34
+
35
+ *Note: Replace `<path/to/tokenizer>` with the local path to the [MINT-tokenizer-libero](https://huggingface.co/huangrm/MINT-tokenizer-libero) weights.*
36
+
37
+ ## Citation 📚
38
+
39
+ If you find this project useful, please cite:
40
+
41
+ ```bibtex
42
+ @article{huang2026mimic,
43
+ title={Mimic Intent, Not Just Trajectories},
44
+ author={Huang, Renming and Zeng, Chendong and Tang, Wenjing and Cai, Jintian and Lu, Cewu and Cai, Panpan},
45
+ journal={arXiv preprint arXiv:2602.08602},
46
+ year={2026}
47
+ }
48
+ ```