Commit Graph

14 Commits

Author SHA1 Message Date
coffee 3dfa132496 update README log 2025-04-29 18:44:48 +08:00
coffee 5cd662bbad update README 2025-04-29 18:39:41 +08:00
coffee e718363979 add corpus files and update ignore 2025-04-29 18:35:28 +08:00
coffee c945aad67c add tokenizer_code readme 2025-04-29 18:33:35 +08:00
coffee 2798c7bc68 add tokenizer_code 2025-04-29 18:29:46 +08:00
coffee f6206ce421 add utils for data process 2025-04-29 18:28:45 +08:00
coffee 57a4401c54 del some tokenizer model file 2025-04-29 18:24:43 +08:00
coffee d5ebd9df0e add tokenizer code 2025-04-29 18:21:17 +08:00
coffee c0bcb8947e update README 2025-04-28 18:44:49 +08:00
coffee 0ed6897a05 add tokenizer test 2025-04-28 18:42:53 +08:00
hanluzhi0429@gmail.com 505b4fb094 test huggingface train 2025-04-24 22:32:31 +08:00
hanluzhi0429@gmail.com 373f6bc379 Merge branch 'main' of https://github.com/IP127000/dolly 2025-04-24 22:26:18 +08:00
hanluzhi0429@gmail.com 7a5789c503 test huggingface transformers 2025-04-24 22:19:55 +08:00
IP127000 ac68a7db39 Initial commit 2025-04-23 22:42:17 +08:00