admin/LLM-from-scratch
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

[2025.05.22] add MoE support

Browse Source
This commit is contained in:
coffee
2025-05-22 16:47:52 +08:00
parent 1d698ba7c3
commit 28fe25780e
11 changed files with 1285 additions and 9 deletions
Download Patch File Download Diff File Expand all files Collapse all files
.gitignore
+5 -2
View File
@@ -1,6 +1,9 @@
corpus/wikipedia-cn-20230720-filtered.json
corpus/wikipedia.txt
corpus/*.jsonl
corpus/*/*.jsonl
dolly_env_local
llm_dolly.egg-info
src_llm/__pycache__
src_llm/__pycache__
weights_MoE
weights_llm
weights_tokenizer/*