Commit Graph

8 Commits

Author SHA1 Message Date
hanluzhi0429@gmail.com aa0267da53 [2025.06.19] pre_token corpus and add cold start 2025-06-19 18:23:19 +08:00
root bd75a6d3ac [2025.06.19] update train code, pretoken corpus 2025-06-19 17:00:27 +08:00
root f28b310bc3 [2025.06.17] update train code 2025-06-17 18:24:05 +08:00
root 5182ecc4a4 [2025.06.17] update train code 2025-06-17 17:21:01 +08:00
root 7ebb8a1b94 [2025.06.17] update train code 2025-06-17 17:19:52 +08:00
root ae76142fdc [2025.06.17] update train code 2025-06-17 17:17:49 +08:00
coffee 9c1739baf3 [2025.06.10] train EN tokenizer use parquet files 2025-06-10 17:56:00 +08:00
root eb1c6c0c17 [2025.06.10]train en tokenizer 2025-06-10 17:36:53 +08:00