vllm-project / vllm-project/aibrix

[CICD] Optimize kv cache image size

Open
#1,047 4 comments 0 reactions 0 assignees View on GitHub
area/cicd area/installation area/kv-cache help wanted priority/important-longterm
Dominant language
Go
Stars
5.1k
Forks
694
Avg merge
1d 19h
Merged PRs (30d)
98

Description

### 🚀 Feature Description and Motivation

![Image](https://github.com/user-attachments/assets/d4b2c067-ce70-4e62-97e1-775484ea8ac1)

The image size is super large now, we need to reduce the size a little bit.

```
FROM ubuntu:22.04

RUN apt-get update && \
DEBIAN_FRONTEND=noninteractive apt-get install -y \
python3 python3-pip \
iproute2 net-tools \
ibverbs-utils libibverbs-dev \
libnl-3-dev libnl-route-3-dev \
rdmacm-utils libibverbs1 rdma-core \
wget \
&& rm -rf /var/lib/apt/lists/*

#RUN pip3 install --no-cache-dir InfiniStore
#
RUN wget https://test-files.pythonhosted.org/packages/f5/57/7013d0deee8b5a0e8cfd5a51bcc8be2084fc0ab8589586fb5e19687efe99/infinistore-0.2.41-cp310-cp310-manylinux_2_28_x86_64.whl
RUN pip3 install infinistore-0.2.41-cp310-cp310-manylinux_2_28_x86_64.whl

CMD ["infinistore"]
```

### Use Case

Reduce the container image size

### Proposed Solution

_No response_

Contributor guide

Open the contributing guide

Research direction

Locate the Dockerfile containing the Ubuntu 22.04 base image and InfiniStore wheel installation shown in the issue. First compare its installed packages and image layers, then verify that the resulting image is smaller and still starts the infinistore command.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, python
Domain
build-system, devops
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.