josharsh / josharsh/xeli

Local Ollama backend for the AI bar

Open
#7 0 comments 0 reactions 0 assignees View on GitHub
area:ai help wanted
Dominant language
Rust
Stars
1
Forks
0
PR merge metrics
No merged PRs in 30d

Description

The AI bar (`Ctrl+K`) currently hits OpenAI or Anthropic. A local **Ollama** option would let users run NL→SQL fully offline.

**Where**: \`src/ai/client.rs\` (add \`Backend::Ollama\`), \`src/ai/config.rs\` (config schema), \`src/ai/prompt.rs\` (may need to trim — local models have smaller context windows)

**Acceptance**
- \`xeli config set-key ollama http://localhost:11434\` works
- \`Ctrl+K\` → query goes to \`POST /api/generate\` with the configured model (default \`qwen2.5-coder:7b\` or similar)
- Falls back to clear error if the daemon isn't running

Bonus: streaming response into the bar.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.