add tokenizer test

2025-04-28 18:24:20 +08:00
parent 505b4fb094
commit 0ed6897a05
2 changed files with 22 additions and 0 deletions
@@ -1,2 +1,3 @@
 # dolly
 Dolly is a custom LLM built from scratch
+only for personal usage