feat(llm): support local LLM (#86)

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
This commit is contained in:
Aaron Pham
2024-08-19 08:35:36 -04:00
committed by GitHub
parent 330d214c14
commit 02eb39ae48
3 changed files with 67 additions and 5 deletions

View File

@@ -330,6 +330,22 @@ vendors = {
},
```
## Local LLM
If you want to use local LLM that has a OpenAI-compatible server, set `["local"] = true`:
```lua
openai = {
endpoint = "http://127.0.0.1:3000",
model = "code-gemma",
temperature = 0,
max_tokens = 4096,
["local"] = true,
},
```
You will be responsible for setting up the server yourself before using Neovim.
</details>
## License