ROCm / ROCm/FastFlowLM

Claude code support - Anthropic API compatibility

Open
#321 3 comments 2 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
C++
Stars
1.9k
Forks
152
Avg merge
4h 14m
Merged PRs (30d)
11

Description

I saw Ollama included Anthropic API compatibility therefore making it possible to use Claude Code with Ollama models.

Would it be possible to add it to fastflowlm?

If I ran lets say llama3.1:8b model on my laptop with these specs:

  • 32 GB RAM
  • AMD Ryzen AI 7 350 with Radeon 860M, 2000 MHz, 8 main processors, 16 logical processors

It would run faster in FastflowLm than Ollama I assume

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names no files, tests, or entry points. Start by comparing Ollama's Anthropic API compatibility with the interfaces FastFlowLM currently exposes, then establish which Claude Code requests must work. Done means Claude Code can use FastFlowLM-backed models through the requested compatibility.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, ollama
Domain
ai, api
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.