Commit Graph

178 Commits

Author SHA1 Message Date
coffee f9908d8b7d update README log 2025-04-29 18:49:12 +08:00
coffee 38c9c3c729 update README log 2025-04-29 18:44:48 +08:00
coffee 3dfa132496 update README log 2025-04-29 18:44:48 +08:00
coffee da0b63690f update README 2025-04-29 18:39:41 +08:00
coffee 5cd662bbad update README 2025-04-29 18:39:41 +08:00
coffee cb34c84755 add corpus files and update ignore 2025-04-29 18:35:28 +08:00
coffee e718363979 add corpus files and update ignore 2025-04-29 18:35:28 +08:00
coffee 45ffd1a891 add tokenizer_code readme 2025-04-29 18:33:35 +08:00
coffee c945aad67c add tokenizer_code readme 2025-04-29 18:33:35 +08:00
coffee b5d90ba346 add tokenizer_code 2025-04-29 18:29:46 +08:00
coffee 2798c7bc68 add tokenizer_code 2025-04-29 18:29:46 +08:00
coffee 4550697faf add utils for data process 2025-04-29 18:28:45 +08:00
coffee f6206ce421 add utils for data process 2025-04-29 18:28:45 +08:00
coffee 552776c379 del some tokenizer model file 2025-04-29 18:24:43 +08:00
coffee 57a4401c54 del some tokenizer model file 2025-04-29 18:24:43 +08:00
coffee 1b809eb64c add tokenizer code 2025-04-29 18:21:17 +08:00
coffee d5ebd9df0e add tokenizer code 2025-04-29 18:21:17 +08:00
coffee df6dbd8702 update README 2025-04-28 18:44:49 +08:00
coffee c0bcb8947e update README 2025-04-28 18:44:49 +08:00
coffee 7bc286be12 add tokenizer test 2025-04-28 18:42:53 +08:00
coffee 0ed6897a05 add tokenizer test 2025-04-28 18:42:53 +08:00
hanluzhi0429@gmail.com ec4b0d7962 test huggingface train 2025-04-24 22:32:31 +08:00
hanluzhi0429@gmail.com 505b4fb094 test huggingface train 2025-04-24 22:32:31 +08:00
hanluzhi0429@gmail.com 7152d7115d Merge branch 'main' of https://github.com/IP127000/dolly 2025-04-24 22:26:18 +08:00
hanluzhi0429@gmail.com 373f6bc379 Merge branch 'main' of https://github.com/IP127000/dolly 2025-04-24 22:26:18 +08:00
hanluzhi0429@gmail.com 7a5789c503 test huggingface transformers 2025-04-24 22:19:55 +08:00
IP127000 2914bf7064 Initial commit 2025-04-23 22:42:17 +08:00
IP127000 ac68a7db39 Initial commit 2025-04-23 22:42:17 +08:00