apollographql / apollographql/graphchat

Support for open LLM models

Open
#8 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
32
Forks
12
PR merge metrics
No merged PRs in 30d

Description

The current implementation works great with using the openAI `gpt-4o` model. Alternatively, are there any open LLM models that can be used in replace of this? I tried with `Llama` and `Qwen` and both do not seem to do the job affectively especially with tool calls. We are looking to see how we can utilize graphchat with locally hosted models.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files or tests. Start by tracing the current OpenAI gpt-4o integration and its tool-call handling, then review how model configuration is passed through the application. Done would mean identifying and implementing a defined path for locally hosted open models such as Llama or Qwen with reliable tool calls.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
ai
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.