admin/LLM-from-scratch
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

[2025.06.05] upload tokenizer weights and update the tokenizer train code

Browse Source
This commit is contained in:
coffee
2025-06-05 18:12:48 +08:00
parent 6a30309848
commit 947ad2b87c
1 changed files with 5 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+5 -4
View File
@@ -1,11 +1,11 @@
# LLM-Dolly # LLM-Dolly
LLM-Dolly is a custom LLM built from scratch LLM-Dolly is a custom LLM built from scratch
持续优化更新中... 持续优化更新中...
<details>
<summary>🗓️ 更新日志</summary>
## 🗓️ 更新日志 #### 2025-06-05
- 📝 上传tokenizer的训练权重，调整tokenizer的格式和训练方式，和qwen2的tokenizer风格保持一致.
#### 2025-06-04
- 📝 调整tokenizer的格式和训练方式，和qwen2的tokenizer风格保持一致
#### 2025-05-26 #### 2025-05-26
- 📝 增加LLM文档，涵盖LLM全周期技术点。 - 📝 增加LLM文档，涵盖LLM全周期技术点。
@@ -43,6 +43,7 @@ LLM-Dolly is a custom LLM built from scratch
#### 2025-04-24 #### 2025-04-24
- ✅ 测试从transformers构建自定义的LLM模型结构。 - ✅ 测试从transformers构建自定义的LLM模型结构。
</details>
## 致谢 ## 致谢
特别感谢以下资源和文章的帮助： 特别感谢以下资源和文章的帮助：