Skip to content
Test HELM Integration

Better separate HF from Unitxt in loading HF datasets, to gain a more comparable loading time for non-eager and eager execution #2983

Sign in to view logs

Better separate HF from Unitxt in loading HF datasets, to gain a more comparable loading time for non-eager and eager execution

Better separate HF from Unitxt in loading HF datasets, to gain a more comparable loading time for non-eager and eager execution #2983

Workflow file for this run

.github/workflows/test_helm.yml at acb2b64
name: Test HELM Integration
on:
push:
branches: [ main ]
pull_request:
branches: [ main ]
concurrency:
group: ${{ github.workflow }}-${{ github.event_name == 'pull_request' && github.event.pull_request.number || github.ref_name }}
cancel-in-progress: true
jobs:
helm:
runs-on: ubuntu-latest
env:
OS: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: actions/setup-python@v5
with:
python-version: '3.9'
cache: 'pip' # caching pip dependencies
- run: pip install --upgrade 'crfm-helm[unitxt]>=0.5.3'
- name: Test Helm
run: utils/run_helm.sh