open-compass / open-compass/VLMEvalKit

add AI/ML API as provider

Open
#1,073 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Pending
Dominant language
Python
Stars
4.4k
Forks
768
Avg merge
1d 10h
Merged PRs (30d)
17

Description

Hi!

I'm Sergey from the Integrations team over at AI/ML API, a startup with 150K+ users, providing over 300 AI models in one place

Your project looks dope, so we'd like a native integration. We already got integrations with Langflow, AutoGPT, and LiteLLM - so our integrations team is pretty seasoned :)

Say you're interested, and we'll test the compatibility, update the code/docs to include us, create a PR and add a tutorial on using VLMEvalKit with AI/ML API to our docs

If you guys give us a green light, we could get on it 👷

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue does not name any files, tests, or entry points. First determine whether the maintainers want an AI/ML API integration and what compatibility or documentation requirements apply; done would require an agreed scope and a validated integration, but no acceptance criteria are provided.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, api
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.