Commit Graph

18 Commits

Author SHA1 Message Date
Aaron Pham
0557deeab7 feat: tokenizers (#429)
* feat: tokenizers

This reverts commit d5a4db8321.

* fix(inputs): #422

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

---------

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
2024-08-31 13:39:50 -04:00
yetone
d5a4db8321 Revert tokenizers (#423)
* Revert "fix: add missing "with" in README"

This reverts commit bf1e7f1f17.

* Revert "feat: tokenizers (#407)"

This reverts commit d2095ba267.
2024-08-31 22:45:31 +08:00
Aaron Pham
d2095ba267 feat: tokenizers (#407)
* feat: autobuild tiktoken lib and schenanigans

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

* chore: revert readme changes

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

* fix(build): windows

Signed-off-by: Hanchin Hsieh <me@yuchanns.xyz>

* chore(plugin): early load commands and base setup

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

* fix(build): make sync

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

* feat: rust go vroom vroom

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

* feat: scuffed afaf implementation binding go brrrr

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

* chore: remove dups

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

* fix(tokens): calculate whether we should do prompt_caching (fixes #416)

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

* chore: ignore lockfiles

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

* Update README.md

* Update crates/avante-tokenizers/README.md

* chore: remove unused

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

* chore: remove auto build

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

---------

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Hanchin Hsieh <me@yuchanns.xyz>
Co-authored-by: yuchanns <me@yuchanns.xyz>
2024-08-31 07:19:59 -04:00
Aaron Pham
5ff5dcf72b chore(openai): add back support functions for ease-of-use (#402)
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
2024-08-30 13:49:08 -04:00
Aaron Pham
b196627e86 chore(provider): use latest cohere models (#400)
Update prompts to correct grammar
concat with table.concat to avoid overhead

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
2024-08-30 13:39:36 -04:00
yetone
104484f17c fix: use the original prompts (#397) 2024-08-30 22:21:50 +08:00
yetone
fc1bcda822 fix: copilot message format (#395) 2024-08-30 19:25:04 +08:00
yetone
2997d4669a refactor: refactor planning prompts to resolve line number issues and indentation issues (#382) 2024-08-30 18:53:49 +08:00
Aaron Pham
8a683b053b fix(style): reformat (#344)
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
2024-08-28 19:56:11 -04:00
Daniel Rodriguez
bb5411cd9a fix(openai): first chunk emit errors (#337) 2024-08-28 18:36:50 -04:00
Aaron Pham
c635f73748 feat: pasting image within buffer (#331)
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
2024-08-28 14:43:14 -04:00
Aaron Pham
755c15c0bd chore(clipboard): separate logic to save as base64 and files (#329)
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
2024-08-28 11:52:12 -04:00
Aaron Pham
d7be4a59c2 fix(openai): enable image support on OpenAI platform only (fixes #282) (#284)
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
2024-08-27 11:35:25 -04:00
Aaron Pham
971e61b2c8 feat(openai): support pasting image from clipboard (#280)
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
2024-08-27 07:06:20 -04:00
Aaron Pham
a7d3defa3d feat(llm): add support for parsing secret vault (#200)
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
2024-08-24 17:52:38 -04:00
Coffee
1142c3c274 fix(openai): add support for Cloudflare's AI-Gateway (#192) 2024-08-24 12:32:16 -04:00
Aaron Pham
6475407d0d fix(llm): persistent key check for override class (#158)
* fix(llm): make sure to allow passing custom module

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

* fix: correct custom class

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

* fix: correct attribute

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

---------

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
2024-08-22 23:52:49 -04:00
Aaron Pham
8d52229f16 refactor(llm): cleanup providers for future ops (closes #134) (#147)
support allow_insecure and proxy ops

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
2024-08-22 01:48:40 -04:00