Announcement_9
Released ReScraper, one 0.6B model that replaces the heuristic scraper and filter stack for LLM pretraining data: the paper, a project page, code, the model, and the curated corpus.
Released ReScraper, one 0.6B model that replaces the heuristic scraper and filter stack for LLM pretraining data: the paper, a project page, code, the model, and the curated corpus.