 root
|
eb1c6c0c17
|
[2025.06.10]train en tokenizer
|
2025-06-10 17:36:53 +08:00 |
|
|
coffee
|
6a30309848
|
[2025.06.05] update tokenizer train code, use the style of Qwen
|
2025-06-05 18:09:18 +08:00 |
|
|
coffee
|
28fe25780e
|
[2025.05.22] add MoE support
|
2025-05-22 16:47:52 +08:00 |
|
|
coffee
|
b9b1d4b51d
|
add jsonl support
|
2025-05-20 17:17:49 +08:00 |
|
|
coffee
|
9d9e858b65
|
update code
|
2025-05-14 13:35:24 +08:00 |
|
|
coffee
|
c3231fcc4e
|
update gitignore
|
2025-05-07 11:19:46 +08:00 |
|
|
coffee
|
e718363979
|
add corpus files and update ignore
|
2025-04-29 18:35:28 +08:00 |
|
|
coffee
|
d5ebd9df0e
|
add tokenizer code
|
2025-04-29 18:21:17 +08:00 |
|