In this project we implement a simple classification task: predict bicycle / motorcycleusing the CIFAR dataset. The main focus of the project is to deploy and monitor the machine learning workflow in AWS.
The full work can be seen in the notebook ML_Workflow.ipynb
. The main steps are:
- Load the CIFAR dataset, transform, and upload to S3.
- Train a simple model using the SageMaker framework image-classification.
- Deploy the model with monitoring and create an endpoint, while verifying we can make predictions.
- Next, we leave the notebook and create 3 Lambda functions to make predictions (get image, classify, and warn on low confidence). See the
lambdas
folder. - We glue them together in a Step Function (see
step_function
folder). - Finally, we make some predictions and plot custom graphs to monitor the workflow.