environments acft hf nlp gpu

acft-hf-nlp-gpu

Overview

Environment used by Hugging Face NLP Finetune components

Version: 52

Tags

Preview

View in Studio: https://ml.azure.com/registries/azureml/environments/acft-hf-nlp-gpu/version/52

Docker image: mcr.microsoft.com/azureml/curated/acft-hf-nlp-gpu:52

Docker build context

Dockerfile

#PTCA image
FROM mcr.microsoft.com/aifx/acpt/stable-ubuntu2004-cu118-py38-torch222:biweekly.202405.1

USER root

RUN apt-get update && apt-get -y upgrade
RUN pip install --upgrade pip

COPY requirements.txt .
# The below file is required for baking the code into the environment
COPY finetune_run.py /azureml/finetune/run.py

RUN pip install -r requirements.txt --no-cache-dir
RUN python -m nltk.downloader punkt
RUN MAX_JOBS=4 pip install flash-attn==2.5.5 --no-build-isolation

# dummy number to change when needing to force rebuild without changing the definition: 2