HuggingFaceFW/fineweb
Viewer
• Updated
• 52.5B • 163k • 2.68k
📚 LLM pretraining datasets
A collection of datasets for LLM pretraining
-
HuggingFaceFW/fineweb-2
Viewer • Updated • 4.48B • 73.4k • 759Note 🍷 Web datasets
-
HuggingFaceFW/fineweb-edu
Viewer • Updated • 3.5B • 224k • 963
mlfoundations/dclm-baseline-1.0
Preview • Updated • 104k • 254Note 📚 Highly curated web datasets filtered using classifiers
HuggingFaceTB/finemath
Viewer • Updated • 48.3M • 9.1k • 351Note 📐 Highly curated math pages from CommonCrawl
-
bigcode/the-stack
Viewer • Updated • 546M • 21k • 959
bigcode/the-stack-v2
Viewer • Updated • 5.45B • 7.56k • 477Note 💻 Github code dataset
HuggingFaceTB/cosmopedia
Viewer • Updated • 31.1M • 12.7k • 674Note Synthetic textbooks
HuggingFaceTB/smollm-corpus
Viewer • Updated • 237M • 25.6k • 438Note Contains Cosmopedia v2 (synthetic textbooks) and Python-Edu (educational Python code)