Skip to content

Commit

Permalink
Rpd build arg (#269)
Browse files Browse the repository at this point in the history
* Added build arg for RPD build to disable it until its build is fixed for ROCm6.3

* Passing the arg to the final stage
  • Loading branch information
gshtras authored Nov 8, 2024
1 parent 72ffb94 commit 15d17c5
Showing 1 changed file with 5 additions and 3 deletions.
8 changes: 5 additions & 3 deletions Dockerfile.rocm
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,7 @@ ARG BUILD_PYTORCH="1"
# If "0", it is copied in from the local working directory.
ARG REMOTE_VLLM="0"
ARG USE_CYTHON="0"
ARG BUILD_RPD="1"

# -----------------------
# vLLM base image
Expand Down Expand Up @@ -252,12 +253,13 @@ RUN --mount=type=bind,from=export_pytorch,src=/,target=/install \
fi

RUN python3 -m pip install --upgrade huggingface-hub[cli]

RUN git clone -b nvtx_enabled https://github.com/ROCm/rocmProfileData.git \
ARG BUILD_RPD
RUN if [ ${BUILD_RPD} -eq "1" ]; then \
git clone -b nvtx_enabled https://github.com/ROCm/rocmProfileData.git \
&& cd rocmProfileData/rpd_tracer \
&& pip install -r requirements.txt && cd ../ \
&& make && make install \
&& cd hipMarker && python setup.py install
&& cd hipMarker && python setup.py install ; fi

# Install vLLM (and gradlib)
# Make sure punica kernels are built (for LoRA)
Expand Down

0 comments on commit 15d17c5

Please sign in to comment.