admin/LLM-from-scratch
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

[2025.06.05] upload tokenizer weights and update the tokenizer train code

Browse Source
This commit is contained in:
coffee
2025-06-05 18:33:32 +08:00
parent dc4bbf43f6
commit edc60be53b
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+1 -1
View File
@@ -5,7 +5,7 @@ LLM-Dolly is a custom LLM built from scratch
🗓️ 更新日志
#### 2025-06-05
- 📝 上传tokenizer的训练权重，调整tokenizer的格式和训练方式，和qwen2的tokenizer风格保持一致.
- 📝 上传tokenizer的训练权重（1.56字符/token），调整tokenizer的格式和训练方式，和qwen2的tokenizer风格保持一致.
<details>
<summary>查看更多</summary>