typesense / typesense/typesense

cf/mistral/mistral-7b-instruct-v0.1 is only accepted Cloudflare Workers AI model

Open
#1,725 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

feature:vectorsearch
Dominant language
C++
Stars
26.6k
Forks
973
Avg merge
18h 45m
Merged PRs (30d)
4

Description

Description

Trying to use Cloudflare Workers AI models other then cf/mistral/mistral-7b-instruct-v0.1

Steps to reproduce

For example, use cf/meta/llama-3-8b-instruct as model_name

Expected Behavior

Model gets created

Actual Behavior

Message is returned: Model name is not a valid Cloudflare model

Metadata

Typesense Version: v26.0

OS: Any

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the error with cf/meta/llama-3-8b-instruct supplied as model_name, then trace the Cloudflare Workers AI model-name validation entry point. Done means supported Cloudflare Workers AI models are accepted and the existing invalid-model error remains appropriate for unsupported names.

Written by the indexing model from the issue text.

Assessment

Domain
api, backend
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.