Topics
Results for “pretraining data”
5 results
- HuggingFaceFW/fineweb-2 — Hugging Face Datasets · Seen
- AQL-Lite: Enabling Efficient Knowledge Acquisition for Arabic LLMs via Data-Centric Continual Pretraining — arXiv AI Papers · Seen
- How to Use Parallel Data for Multilingual Pretraining — arXiv AI Papers · Seen
- Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline — Hugging Face Blog · Seen
- allenai/dolma — Hugging Face Datasets · Seen