admin/LLM-from-scratch
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

[2025.06.10]train en tokenizer

Browse Source
This commit is contained in:
root
2025-06-10 17:36:53 +08:00
parent c6e171e8ed
commit eb1c6c0c17
13 changed files with 243835 additions and 57395 deletions
Download Patch File Download Diff File Expand all files Collapse all files
.gitignore
+2 -7
View File
@@ -1,8 +1,3 @@
corpus/wikipedia-cn-20230720-filtered.json
corpus/wikipedia.txt
corpus/*/*.jsonl
dolly_env_local
corpus/*
llm_dolly.egg-info
src_llm/__pycache__
weights_MoE
weights_llm
weights/*