HuggingFaceFW/fineweb
Dataset · https://huggingface.co/datasets/HuggingFaceFW/fineweb
🍷 FineWeb 15 trillion tokens of the finest data the 🌐 web has to offer What is it? The 🍷 FineWeb dataset consists of more than 18.5T tokens (originally 15T tokens) of cleaned and deduplicated english web data from CommonCrawl. The data processing pipeline is optimized for LLM performance and ran on the 🏭 datatrove library, our large scale data processing library. 🍷 FineWeb was originally meant to be a fully open replication of 🦅 RefinedWeb, with a… See the full description on the dataset page: https://huggingface.co/datasets/HuggingFaceFW/fineweb.
First seen by Oriel on .
Metric trends
Last 30 days · Up to 120 recorded samples per source and metric · First and latest retained
Likes
Total likes reported by the source.
- Hugging Face Datasets: 3,684, latest observation ; +24 over observed period since
Downloads (30d)
Rolling 30-day downloads. A change in this value is not new downloads during the observed period.
- Hugging Face Datasets: 327,930, latest observation ; -10,380 over observed period since
Aliases
| Source | External ID | URL |
|---|---|---|
| Hugging Face Datasets | HuggingFaceFW/fineweb | https://huggingface.co/datasets/HuggingFaceFW/fineweb |