Files
LLM-from-scratch/utils/download_corpus.sh
T
2025-05-07 11:28:08 +08:00

3 lines
175 B
Bash
Executable File

mkdir corpus
git clone https://huggingface.co/datasets/pleisto/wikipedia-cn-20230720-filtered corpus
wget -P data corpus https://www.gutenberg.org/cache/epub/16457/pg16457.txt