vllm-project / vllm-project/aibrix
[CICD] Optimize kv cache image size
- Dominant language
- Go
- Stars
- 5.1k
- Forks
- 694
- Avg merge
- 1d 19h
- Merged PRs (30d)
- 98
Description
### 🚀 Feature Description and Motivation

The image size is super large now, we need to reduce the size a little bit.
```
FROM ubuntu:22.04
RUN apt-get update && \
DEBIAN_FRONTEND=noninteractive apt-get install -y \
python3 python3-pip \
iproute2 net-tools \
ibverbs-utils libibverbs-dev \
libnl-3-dev libnl-route-3-dev \
rdmacm-utils libibverbs1 rdma-core \
wget \
&& rm -rf /var/lib/apt/lists/*
#RUN pip3 install --no-cache-dir InfiniStore
#
RUN wget https://test-files.pythonhosted.org/packages/f5/57/7013d0deee8b5a0e8cfd5a51bcc8be2084fc0ab8589586fb5e19687efe99/infinistore-0.2.41-cp310-cp310-manylinux_2_28_x86_64.whl
RUN pip3 install infinistore-0.2.41-cp310-cp310-manylinux_2_28_x86_64.whl
CMD ["infinistore"]
```
### Use Case
Reduce the container image size
### Proposed Solution
_No response_
Contributor guide
Research direction
Locate the Dockerfile containing the Ubuntu 22.04 base image and InfiniStore wheel installation shown in the issue. First compare its installed packages and image layers, then verify that the resulting image is smaller and still starts the infinistore command.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- docker, python
- Domain
- build-system, devops
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 45/100