[2025.06.05] upload tokenizer weights and update the tokenizer train code

This commit is contained in:
coffee
2025-06-05 18:16:34 +08:00
parent 80517880b5
commit 0e023c8bc1
+2 -3
View File
@@ -1,8 +1,8 @@
# LLM-Dolly # LLM-Dolly
LLM-Dolly is a custom LLM built from scratch LLM-Dolly is a custom LLM built from scratch
持续优化更新中... 持续优化更新中...
<details>
<summary>🗓️ 更新日志</summary> 🗓️ 更新日志
#### 2025-06-05 #### 2025-06-05
- 📝 上传tokenizer的训练权重,调整tokenizer的格式和训练方式,和qwen2的tokenizer风格保持一致. - 📝 上传tokenizer的训练权重,调整tokenizer的格式和训练方式,和qwen2的tokenizer风格保持一致.
@@ -46,7 +46,6 @@ LLM-Dolly is a custom LLM built from scratch
#### 2025-04-24 #### 2025-04-24
- ✅ 测试从transformers构建自定义的LLM模型结构。 - ✅ 测试从transformers构建自定义的LLM模型结构。
</details> </details>
</details>
## 致谢 ## 致谢