anomalyco / anomalyco/models.dev

Tool Modality

Open
#3,977 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
TypeScript
Stars
6.9k
Forks
1.7k
Avg merge
3h 21m
Merged PRs (30d)
873

Description

Just like input and output modalities, please also include the tool result modality, because, for example, Gemini models support file,image, video, and audio as tool results, while the Anthropic models support text and image, and the Openai models support text only.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the model metadata definitions for input and output modalities, then trace how those fields are represented for Gemini, Anthropic, and OpenAI models. Add a tool-result modality field that captures the formats described in the issue, and verify the affected model records and any existing modality checks.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
ai, database
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
65/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.