vllm-project / vllm-project/aibrix

Add option to download image/video from remote storage for image/video to text

Open
#1,710 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Go
Stars
5.1k
Forks
697
Avg merge
1d 19h
Merged PRs (30d)
104

Description

🚀 Feature Description and Motivation

for multi-modality usecase, add option to download image or video from remote storage such as S3.

We can leverage storage API: https://github.com/vllm-project/aibrix/tree/main/python/aibrix/aibrix/storage to download the files.

Use Case

For vllm, image/video to text.

Proposed Solution

No response

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the storage API under python/aibrix/aibrix/storage, then trace the image/video-to-text path that consumes remote inputs. The issue is complete when an option allows image or video files stored remotely, such as in S3, to be downloaded and used by that path.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python
Domain
ai, cloud
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.