Files
LLM-from-scratch/utils/download_corpus.sh
T
2025-04-29 18:21:17 +08:00

3 lines
175 B
Bash

mkdir corpus
git clone https://huggingface.co/datasets/pleisto/wikipedia-cn-20230720-filtered corpus
wget -P data corpus https://www.gutenberg.org/cache/epub/16457/pg16457.txt