studio

EMR Studio Demo Code

This is the associated code for the Intro to Amazon EMR Studio video.

• WeatherDay.ipynb - Notebook that uses @zflamig's original birthday-weather example that uses ERA5 Zaar data to draw a map of US weather for a given day.

CloudFormation Templates

There are two templates in this repository for use with EMR Studio. Please note that you can find more examples in the EMR Studio Samples repository.

1. full_studio_dependencies - Creates everything you need in order to use EMR Studio including a new VPC with security groups and subnets tagged appropriately for use with EMR Managed Policies.
2. matplotlib_studio - Incorporates the above template and also creates a new Studio associated with the AWS SSO username you provide. Also includes a Service Catalog cluster template that installs basemap for usage with matplotlib and the WeatherDay notebook above.

Scheduling Notebooks

In order to schedule, you need three pieces of information:

• Editor ID
• Cluster ID
• Service role name

export EDITOR_ID=e-AAABBB
export CLUSTER_ID=j-CCCDDD

aws emr start-notebook-execution \
  --editor-id ${EDITOR_ID} \
  --notebook-params '{"weather_date": "2019-09-01"}' \
  --relative-path demo-code/emr/studio/WeatherDay.ipynb \
  --notebook-execution-name Summer \
  --execution-engine '{"Id" : "'${CLUSTER_ID}'"}' \
  --service-role EMR_Notebooks_DefaultRole

aws emr describe-notebook-execution --notebook-execution-id ex-FFFFGGGG

aws s3 cp s3://<EMR_STUDIO_BUCKET>/e-AAABBB/executions/ex-FFFFGGGG/WeatherDay.ipynb .