CarGDev/avante.nvim
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

docs: recommended groq as cursor applying provider (#1298)

Browse Source
This commit is contained in:
yetone
2025-02-18 22:54:02 +08:00
committed by GitHub
parent 603bd7f8ec
commit 18f3c50ea0
1 changed files with 13 additions and 9 deletions
Download Patch File Download Diff File Expand all files Collapse all files

22
cursor-planning-mode.md
View File

@@ -5,29 +5,33 @@ Because avante.nvim has always used Aider’s method for planning applying, but
Therefore, I have adopted Cursor’s method to implement planning applying. For details on the implementation, please refer to: [🚀 Introducing Fast Apply - Replicate Cursor's Instant Apply model](https://www.reddit.com/r/LocalLLaMA/comments/1ga25gj/introducing_fast_apply_replicate_cursors_instant/) Therefore, I have adopted Cursor’s method to implement planning applying. For details on the implementation, please refer to: [🚀 Introducing Fast Apply - Replicate Cursor's Instant Apply model](https://www.reddit.com/r/LocalLLaMA/comments/1ga25gj/introducing_fast_apply_replicate_cursors_instant/)
So you need to first run the `FastApply` model mentioned above: ~~So you need to first run the `FastApply` model mentioned above:~~
```bash ~~```bash~~
ollama pull hf.co/Kortix/FastApply-7B-v1.0_GGUF:Q4_K_M ollama pull hf.co/Kortix/FastApply-7B-v1.0_GGUF:Q4_K_M
``` ~~```~~
An interesting fact is that I found the `FastApply` model mentioned above doesn't work well. First, it's too slow, and second, it's not accurate for processing long code file. It often includes `// ... existing code ...` comments in the generated final code, resulting in incorrect code generation.
The best model I found for applying is `qwen-2.5-coder-32b` on [Groq](https://console.groq.com/playground), it's both fast and accurate, it's perfect!
Then enable it in avante.nvim: Then enable it in avante.nvim:
```lua ```lua
{ {
--- ... existing configurations --- ... existing configurations
cursor_applying_provider = 'fastapply', cursor_applying_provider = 'groq', -- use groq for applying
behaviour = { behaviour = {
--- ... existing behaviours --- ... existing behaviours
enable_cursor_planning_mode = true, enable_cursor_planning_mode = true, -- enable cursor planning mode!
}, },
vendors = { vendors = {
--- ... existing vendors --- ... existing vendors
fastapply = { groq = { -- define groq provider
__inherited_from = 'openai', __inherited_from = 'openai',
api_key_name = '', api_key_name = 'GROQ_API_KEY',
endpoint = 'http://localhost:11434/v1', endpoint = 'https://api.groq.com/openai/v1/',
model = 'hf.co/Kortix/FastApply-7B-v1.0_GGUF:Q4_K_M', model = 'qwen-2.5-coder-32b',
}, },
}, },
--- ... existing configurations --- ... existing configurations