add tokenizer test

2025-04-28 18:24:20 +08:00
parent ec4b0d7962
commit 7bc286be12
2 changed files with 22 additions and 0 deletions
@@ -1,2 +1,3 @@
 # dolly
 Dolly is a custom LLM built from scratch
+only for personal usage