[2025.06.05] upload tokenizer weights and update the tokenizer train code

2025-06-05 18:15:28 +08:00
parent 947ad2b87c
commit 80517880b5
1 changed files with 5 additions and 1 deletions
@@ -7,6 +7,9 @@ LLM-Dolly is a custom LLM built from scratch
 #### 2025-06-05
 - 📝 上传tokenizer的训练权重，调整tokenizer的格式和训练方式，和qwen2的tokenizer风格保持一致.

+<details>
+<summary>查看更多</summary>
+
 #### 2025-05-26
 - 📝 增加LLM文档，涵盖LLM全周期技术点。

@@ -42,8 +45,9 @@ LLM-Dolly is a custom LLM built from scratch

 #### 2025-04-24
 - ✅ 测试从transformers构建自定义的LLM模型结构。
-
 </details>
+</details>
+
 ## 致谢

 特别感谢以下资源和文章的帮助：