CarGDev/avante.nvim
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Revert tokenizers (#423)

Browse Source 
* Revert "fix: add missing "with" in README"

This reverts commit bf1e7f1f17.

* Revert "feat: tokenizers (#407)"

This reverts commit d2095ba267.
This commit is contained in:
yetone
2024-08-31 22:45:31 +08:00
committed by GitHub
parent bf1e7f1f17
commit d5a4db8321
27 changed files with 27 additions and 3554 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
crates/avante-tokenizers/README.md
View File

@@ -1 +0,0 @@
A simple crate to unify hf/tokenizers and tiktoken-rs