From 947ad2b87cd7871e4992ba92e0ad150b684a408b Mon Sep 17 00:00:00 2001 From: coffee Date: Thu, 5 Jun 2025 18:12:48 +0800 Subject: [PATCH] [2025.06.05] upload tokenizer weights and update the tokenizer train code --- README.md | 9 +++++---- 1 file changed, 5 insertions(+), 4 deletions(-) diff --git a/README.md b/README.md index 6100072..cdb00d4 100755 --- a/README.md +++ b/README.md @@ -1,11 +1,11 @@ # LLM-Dolly LLM-Dolly is a custom LLM built from scratch 持续优化更新中... +
+🗓️ 更新日志 -## 🗓️ 更新日志 - -#### 2025-06-04 -- 📝 调整tokenizer的格式和训练方式,和qwen2的tokenizer风格保持一致 +#### 2025-06-05 +- 📝 上传tokenizer的训练权重,调整tokenizer的格式和训练方式,和qwen2的tokenizer风格保持一致. #### 2025-05-26 - 📝 增加LLM文档,涵盖LLM全周期技术点。 @@ -43,6 +43,7 @@ LLM-Dolly is a custom LLM built from scratch #### 2025-04-24 - ✅ 测试从transformers构建自定义的LLM模型结构。 +
## 致谢 特别感谢以下资源和文章的帮助: