admin/LLM-from-scratch
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

[2025.06.19] pretoken corpus and add cold start

Browse Source
This commit is contained in:
hanluzhi0429@gmail.com
2025-06-19 18:25:21 +08:00
parent aa0267da53
commit e4d1bf72b3
1 changed files with 5 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+5 -2
View File
@@ -4,12 +4,15 @@ LLM-Dolly is a custom LLM built from scratch
🗓️ 更新日志 🗓️ 更新日志
#### 2025-06-05 #### 2025-06-19
- 📝 上传tokenizer的训练权重（1.56字符/token），调整tokenizer的格式和训练方式，和qwen2的tokenizer风格保持一致. - 📝 pretoken corpus and update cold start code.
<details> <details>
<summary>查看更多</summary> <summary>查看更多</summary>
#### 2025-06-05
- 📝 上传tokenizer的训练权重（1.56字符/token），调整tokenizer的格式和训练方式，和qwen2的tokenizer风格保持一致.
#### 2025-05-26 #### 2025-05-26
- 📝 增加LLM文档，涵盖LLM全周期技术点。 - 📝 增加LLM文档，涵盖LLM全周期技术点。