Skip to content

environments acft hf nlp data import

github-actions[bot] edited this page Sep 20, 2024 · 15 revisions

acft-hf-nlp-data-import

Overview

Environment used by Hugging Face NLP Finetune components

Version: 5

Tags

Preview MaaS DataImport

View in Studio: https://ml.azure.com/registries/azureml/environments/acft-hf-nlp-data-import/version/5

Docker image: mcr.microsoft.com/azureml/curated/acft-hf-nlp-data-import:5

Docker build context

Dockerfile

# openmpi image
FROM mcr.microsoft.com/azureml/openmpi4.1.0-ubuntu20.04:20240918.v1

USER root

# sudo is expected by Singularity inside the image
RUN apt-get update && ACCEPT_EULA=Y apt-get -y upgrade && apt-get install sudo
RUN pip install --upgrade pip

COPY requirements.txt .

RUN pip install -r requirements.txt --no-cache-dir

# temp fix for vulnerabilties, remove after pypi release
RUN pip install scikit-learn==1.5.1

# The below file is required for baking the code into the environment
COPY data_import_run.py /azureml/data_import/run.py
Clone this wiki locally