Skip to content

Commit

Permalink
feat: make it easier to download the datasets
Browse files Browse the repository at this point in the history
  • Loading branch information
dimakis committed Nov 14, 2023
1 parent 7124cd7 commit c148f35
Showing 1 changed file with 9 additions and 2 deletions.
11 changes: 9 additions & 2 deletions demo-notebooks/guided-demos/2_basic_jobs.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -116,7 +116,13 @@
"id": "83d77b74",
"metadata": {},
"source": [
"First, let's begin by submitting to Ray, training a basic NN on the MNIST dataset:"
"First, let's begin by submitting to Ray, training a basic NN on the MNIST dataset:\n",
"\n",
"NOTE: To test this demo in an air-gapped/ disconnected environment alter the training script to use a local dataset.\n",
"First we must download the MNIST dataset. We've included a helper script to do this for you. \n",
"\n",
"You can run the python script directly and then place the dataset in the same directory as this notebook. \n",
"The path to the dataset would be: `..guided-demos/MNIST/raw/` "
]
},
{
Expand All @@ -129,6 +135,7 @@
"jobdef = DDPJobDefinition(\n",
" name=\"mnisttest\",\n",
" script=\"mnist.py\",\n",
" # script=\"mnist_disconnected.py\", # training script for disconnected environment\n",
" scheduler_args={\"requirements\": \"requirements.txt\"}\n",
")\n",
"job = jobdef.submit(cluster)"
Expand Down Expand Up @@ -302,7 +309,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.8.13"
"version": "3.9.18"
},
"vscode": {
"interpreter": {
Expand Down

0 comments on commit c148f35

Please sign in to comment.