AI & ML interests

None defined yet.

Recent Activity

sergiopaniego 
posted an update 4 days ago
view post
Post
1,072
if you want to deep dive into how the new @MistralAI Large 4 was built, we sat down with the team to learn straight from them!

scaling, specialization, evals, cyber, sandboxing and why open weights matter

a really detailed look at what it takes to build and release an open frontier model, super recommended

https://www.youtube.com/watch?v=FczbSauVvjw
danielhanchen 
posted an update 4 days ago
sergiopaniego 
posted an update 5 days ago
danielhanchen 
posted an update 5 days ago
sergiopaniego 
posted an update 6 days ago
view post
Post
3,000
how do you post-train an agent?

we laid it out as a 5-step curriculum, from SFT to RL through a real harness, with livestreams, code and docs for each step

https://huggingface.co/blog/huggingface/train-agents
  • 2 replies
·
sergiopaniego 
posted an update 7 days ago
view post
Post
137
Last week we closed the Training Agents series IRL at the GitHub offices in SF

4 talks, a panel and audience Q&A. almost 2h on post-training agents with open models

> Learnings from enterprise RL (Govind Kamtamneni Microsoft)
> Environments and benchmarks in industry (Victor Barres Mercor)
> How to train your agents with Miles (Tao Lin RadixArk)
> Why we built OpenEnv Arena (Xiangyi Li BenchFlow)

Full recording + Slides

https://www.youtube.com/watch?v=CKFUx7COIwQ
danielhanchen 
posted an update 14 days ago
MaziyarPanahi 
posted an update 20 days ago
danielhanchen 
posted an update 26 days ago
sergiopaniego 
posted an update 27 days ago
danielhanchen 
posted an update 28 days ago
sergiopaniego 
posted an update 28 days ago
view post
Post
310
Repo2RLEnv just shipped TaskSmith + 50 high quality RL envs generated from HF repos 🔨

TaskSmith is a specialized harness that turns a merged PR into a verified RL env

the envs come from HF repos (Transformers, TRL, PEFT, Accelerate, Diffusers), shipped as Harbor tasks you can eval or train on

> code: github.com/huggingface/Repo2RLEnv
> dataset: huggingface.co/datasets/FineEnvs/HF_ML_Tasksmith
sergiopaniego 
posted an update 29 days ago
view post
Post
3,831
ThinkingBox from @microsoft is now available as an OpenEnv env (cc @tuhink 🤗 )!

> ThinkingBox is a sandbox for testing agents on business workflows. it simulates a customer, gives the agent MCP tools over a real database, and at the end checks what changed in that database instead of trusting the agent's last message

> ThinkingBox-Bench is the benchmark built on it: 507 tasks across retail, insurance, travel, banking and consulting

> the OpenEnv env runs each task as an episode in its own isolated backend and returns a pass/fail reward from those checks

https://huggingface.co/blog/microsoft/thinkingbox
sergiopaniego 
posted an update about 1 month ago
danielhanchen 
posted an update about 1 month ago
view post
Post
9,197
Unsloth has surpassed 500M model downloads on Hugging Face! 🦥🤗

Qwen3.8-27B GGUF is already Unsloth’s #1 most-downloaded model ever.

Thanks for all your support! Follow us:
unsloth
  • 1 reply
·
danielhanchen 
posted an update about 1 month ago
sergiopaniego 
posted an update about 1 month ago
view post
Post
467
ICYMI, Async GRPO in TRL now supports LoRA and we wrote a looong blog testing it

> the adapter is a few megabytes, so the weight sync is a file instead of an NCCL transfer
> 3 HF Jobs: 1 trainer and 2 vLLM replicas
> the adapter travels through an HF Storage Bucket mounted in all 3 at the same path
> a proxy in front of the replicas routes each rollout to the one already holding its KV prefix

https://huggingface.co/blog/asyncgrpo-lora-hfjobs
sergiopaniego 
posted an update about 2 months ago
view post
Post
3,399
while preparing the last class of the Training Agents live series during the summer, i spent some time reading the post-training sections of many frontier model reports, to learn how they use RL environments to improve their models, and wrote a blog about it

if you use any kind of coding harness, or you saw the Blender scenes that went viral recently, this might be interesting to you

Blog: https://huggingface.co/blog/sergiopaniego/rl-environments-2026
danielhanchen 
posted an update about 2 months ago