coffee
3 lines
105 B
Markdown
Executable File
3 lines
105 B
Markdown
Executable File
# USAGE
|
|
使用sentencepiece和huggingface transformers分别进行tokenizer的训练
|
|
support BPE and BBPE |