From edc60be53b568d30943553becad38bea3f5a76bf Mon Sep 17 00:00:00 2001 From: coffee Date: Thu, 5 Jun 2025 18:33:32 +0800 Subject: [PATCH] [2025.06.05] upload tokenizer weights and update the tokenizer train code --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 60021b6..68d609e 100755 --- a/README.md +++ b/README.md @@ -5,7 +5,7 @@ LLM-Dolly is a custom LLM built from scratch 🗓️ 更新日志 #### 2025-06-05 -- 📝 上传tokenizer的训练权重,调整tokenizer的格式和训练方式,和qwen2的tokenizer风格保持一致. +- 📝 上传tokenizer的训练权重(1.56字符/token),调整tokenizer的格式和训练方式,和qwen2的tokenizer风格保持一致.
查看更多