coffee
3 lines
105 B
Markdown
3 lines
105 B
Markdown
# USAGE
|
|
使用sentencepiece和huggingface transformers分别进行tokenizer的训练
|
|
support BPE and BBPE |