Copy_of_MNIST_Train_Task1.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/github/zeidsolh/ece188final/blob/main/Copy_of_MNIST_Train_Task1.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "# Project 2- ECE 188, Spring 2022 - Deadline: June 10th, 2022. Please upload a link to your Github on Gradescope.\n",
        "# Train a Deep Learning model on the MNIST dataset and evaluate it on a test set.\n",
        "\n",
        "The first part in this notebook will take you though the training of the [MNIST Dataset](http://yann.lecun.com/exdb/mnist/) which is a collection of handwritten digits. \n",
        "\n",
        "We will build a Deep Learning based system that can recognise handwritten digits using [Keras](https://keras.io/) and [Tensorflow](https://www.tensorflow.org/). \n",
        "\n",
        "Note that the entire project will be done on a Google Colab. A tutorial to some basic colab instructions can be found [here](https://colab.research.google.com/?utm_source=scs-index#scrollTo=GJBs_flRovLc). \n",
        "\n",
        "Note that all the code needed is provided until Task 1, **you will only have to write code after the task 1 header**"
      ],
      "metadata": {
        "id": "a-utSW-VUF2y"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Import Necessary Packages\n",
        "\n",
        "We import Keras and Tensorflow to train our network and numpy to work with our data. \n",
        "\n",
        "We also import matplotlib to view our images. "
      ],
      "metadata": {
        "id": "fgnHUBjoUTcy"
      }
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "metadata": {
        "id": "aDvD8R1TbbOi"
      },
      "outputs": [],
      "source": [
        "import numpy as np\n",
        "import tensorflow as tf\n",
        "from tensorflow import keras\n",
        "from keras import layers\n"
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "import matplotlib as mpl\n",
        "import matplotlib.pyplot as plt\n",
        "\n",
        "mpl.rcParams['figure.figsize'] = (8, 8)\n",
        "mpl.rcParams['axes.grid'] = False\n"
      ],
      "metadata": {
        "id": "OdYVH66MUciD"
      },
      "execution_count": 2,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "# Load the Data\n",
        "\n",
        "We perform some data preprocessing. Feel free to skip over this and use the train and test data as x_train and x_test"
      ],
      "metadata": {
        "id": "yuFHL78kUez_"
      }
    },
    {
      "cell_type": "code",
      "execution_count": 3,
      "metadata": {
        "id": "2iKGDDuDbhRM",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "60721469-156c-4409-c426-6bb9e19aa4b1"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Downloading data from https://storage.googleapis.com/tensorflow/tf-keras-datasets/mnist.npz\n",
            "11493376/11490434 [==============================] - 0s 0us/step\n",
            "11501568/11490434 [==============================] - 0s 0us/step\n",
            "x_train shape: (60000, 28, 28, 1)\n",
            "60000 train samples\n",
            "10000 test samples\n"
          ]
        }
      ],
      "source": [
        "# Model / data parameters\n",
        "num_classes = 10\n",
        "input_shape = (28, 28, 1)\n",
        "\n",
        "# the data, split between train and test sets\n",
        "(x_train, y_train), (x_test, y_test) = keras.datasets.mnist.load_data()\n",
        "\n",
        "# Scale images to the [0, 1] range\n",
        "x_train = x_train.astype(\"float32\") / 255\n",
        "x_test = x_test.astype(\"float32\") / 255\n",
        "# Make sure images have shape (28, 28, 1)\n",
        "x_train = np.expand_dims(x_train, -1)\n",
        "x_test = np.expand_dims(x_test, -1)\n",
        "print(\"x_train shape:\", x_train.shape)\n",
        "print(x_train.shape[0], \"train samples\")\n",
        "print(x_test.shape[0], \"test samples\")\n",
        "\n",
        "\n",
        "# convert class vectors to binary class matrices\n",
        "y_train = keras.utils.to_categorical(y_train, num_classes)\n",
        "y_test = keras.utils.to_categorical(y_test, num_classes)\n"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Define a model in keras.\n",
        "\n",
        "\n",
        " We define a simple simple network with 2 hidden layers. One fully connected dense layer with 8 neurons and onr flatten layer that flattens the model into 1D structure which is then fed into a softmax output.\n",
        "\n",
        "This is a barebones keras structure. In task 1 you will be tasked with improving this model. "
      ],
      "metadata": {
        "id": "tEDsgxIcuv0B"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "model = keras.Sequential(\n",
        "    [\n",
        "        keras.Input(shape=input_shape),\n",
        "        layers.Dense(8,activation=\"relu\"),\n",
        "        layers.Flatten(),\n",
        "        layers.Dense(num_classes, activation=\"softmax\"),\n",
        "    ]\n",
        ")\n",
        "\n",
        "model.summary()\n"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "Kb3ONTl8Odrq",
        "outputId": "c33602d2-4e6f-4ec5-8808-90f7704dece2"
      },
      "execution_count": 4,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Model: \"sequential\"\n",
            "_________________________________________________________________\n",
            " Layer (type)                Output Shape              Param #   \n",
            "=================================================================\n",
            " dense (Dense)               (None, 28, 28, 8)         16        \n",
            "                                                                 \n",
            " flatten (Flatten)           (None, 6272)              0         \n",
            "                                                                 \n",
            " dense_1 (Dense)             (None, 10)                62730     \n",
            "                                                                 \n",
            "=================================================================\n",
            "Total params: 62,746\n",
            "Trainable params: 62,746\n",
            "Non-trainable params: 0\n",
            "_________________________________________________________________\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Compile and train the model \n",
        "\n",
        "We know train our model. Before we do that we need to set some parameters to train the model. Hence we define the loss and optimizer to be used as well as batch size. The number of epochs refers to the number of training iterations. "
      ],
      "metadata": {
        "id": "7qepS8u7VJXF"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "batch_size = 128\n",
        "epochs = 15\n",
        "\n",
        "model.compile(loss=\"categorical_crossentropy\", optimizer=\"adam\", metrics=[\"accuracy\"])\n",
        "\n",
        "model.fit(x_train, y_train, batch_size=batch_size, epochs=epochs, validation_split=0.1)\n"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "3cwCRnA2OgPY",
        "outputId": "b1c5363e-46eb-4edb-cc9d-597f136d0b97"
      },
      "execution_count": 5,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 1/15\n",
            "422/422 [==============================] - 6s 4ms/step - loss: 0.7301 - accuracy: 0.8328 - val_loss: 0.2968 - val_accuracy: 0.9182\n",
            "Epoch 2/15\n",
            "422/422 [==============================] - 2s 4ms/step - loss: 0.3357 - accuracy: 0.9040 - val_loss: 0.2602 - val_accuracy: 0.9230\n",
            "Epoch 3/15\n",
            "422/422 [==============================] - 2s 4ms/step - loss: 0.3023 - accuracy: 0.9144 - val_loss: 0.2409 - val_accuracy: 0.9308\n",
            "Epoch 4/15\n",
            "422/422 [==============================] - 2s 4ms/step - loss: 0.2873 - accuracy: 0.9183 - val_loss: 0.2354 - val_accuracy: 0.9340\n",
            "Epoch 5/15\n",
            "422/422 [==============================] - 2s 4ms/step - loss: 0.2787 - accuracy: 0.9203 - val_loss: 0.2319 - val_accuracy: 0.9352\n",
            "Epoch 6/15\n",
            "422/422 [==============================] - 2s 4ms/step - loss: 0.2725 - accuracy: 0.9238 - val_loss: 0.2294 - val_accuracy: 0.9368\n",
            "Epoch 7/15\n",
            "422/422 [==============================] - 2s 4ms/step - loss: 0.2689 - accuracy: 0.9252 - val_loss: 0.2243 - val_accuracy: 0.9365\n",
            "Epoch 8/15\n",
            "422/422 [==============================] - 2s 4ms/step - loss: 0.2643 - accuracy: 0.9264 - val_loss: 0.2270 - val_accuracy: 0.9368\n",
            "Epoch 9/15\n",
            "422/422 [==============================] - 2s 4ms/step - loss: 0.2622 - accuracy: 0.9263 - val_loss: 0.2283 - val_accuracy: 0.9378\n",
            "Epoch 10/15\n",
            "422/422 [==============================] - 2s 4ms/step - loss: 0.2589 - accuracy: 0.9273 - val_loss: 0.2263 - val_accuracy: 0.9380\n",
            "Epoch 11/15\n",
            "422/422 [==============================] - 2s 4ms/step - loss: 0.2569 - accuracy: 0.9287 - val_loss: 0.2223 - val_accuracy: 0.9385\n",
            "Epoch 12/15\n",
            "422/422 [==============================] - 2s 4ms/step - loss: 0.2552 - accuracy: 0.9286 - val_loss: 0.2218 - val_accuracy: 0.9403\n",
            "Epoch 13/15\n",
            "422/422 [==============================] - 2s 4ms/step - loss: 0.2541 - accuracy: 0.9293 - val_loss: 0.2226 - val_accuracy: 0.9397\n",
            "Epoch 14/15\n",
            "422/422 [==============================] - 2s 4ms/step - loss: 0.2528 - accuracy: 0.9291 - val_loss: 0.2244 - val_accuracy: 0.9380\n",
            "Epoch 15/15\n",
            "422/422 [==============================] - 2s 4ms/step - loss: 0.2510 - accuracy: 0.9302 - val_loss: 0.2234 - val_accuracy: 0.9390\n"
          ]
        },
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "<keras.callbacks.History at 0x7f8fe2080910>"
            ]
          },
          "metadata": {},
          "execution_count": 5
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Evaluate the model "
      ],
      "metadata": {
        "id": "2IscBu-nVLw3"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "score = model.evaluate(x_test, y_test, verbose=0)\n",
        "print(\"Test loss:\", score[0])\n",
        "print(\"Test accuracy:\", score[1])\n"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "SCRqjgb_OiN7",
        "outputId": "fa3b45c2-6858-4a85-edba-4a360b272158"
      },
      "execution_count": 6,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Test loss: 0.2657722532749176\n",
            "Test accuracy: 0.9253000020980835\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "We achieve an accuracy on the test set of 92% but can we do better?"
      ],
      "metadata": {
        "id": "nSdY-BY5vKZb"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Looking at a prediction.\n",
        "\n",
        "Lets look at the prediction for a particular image in our model. We will look at one corect and one incorrect prediction and see if we can improve on the incorrect prediction. "
      ],
      "metadata": {
        "id": "y9a6QtAJ4Xby"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "def get_mnist_label(image_probs):\n",
        "\n",
        "  return np.argmax(image_probs), np.max(image_probs)"
      ],
      "metadata": {
        "id": "g3uyTJ6253Jv"
      },
      "execution_count": 7,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "preds = model.predict(x_test)\n",
        "\n",
        "image = x_test[0].reshape(input_shape[0], input_shape[1])\n",
        "label = np.argmax(y_test[0])\n",
        "image_probs = preds[0]"
      ],
      "metadata": {
        "id": "sZP5HsZO5OyY"
      },
      "execution_count": 8,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "plt.figure()\n",
        "plt.imshow(image*0.5 + 0.5)  # To change [-1, 1] to [0,1]\n",
        "image_class, class_confidence = get_mnist_label(image_probs)\n",
        "plt.title('{} : {:.2f}% Confidence'.format(image_class, class_confidence*100))\n",
        "plt.show()\n"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 499
        },
        "id": "AdIoM5GX5ygg",
        "outputId": "e2fc8ef1-f6c6-4e6b-e6a5-241f7b1c9e37"
      },
      "execution_count": 9,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "<Figure size 576x576 with 1 Axes>"
            ],
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAdUAAAHiCAYAAAC+xlbiAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+WH4yJAAAaBElEQVR4nO3df7TtdV3n8ddbuFziggr+QLyiJP6YyBTrRpbORJk/sjF0lSZNRJMT1uQKK3+NMyZrKjPHH/0yWzhSZKaZ6GhFJZKTuTQUXIggJqQo4AVSTCCVn+/5Y39vc7yd+2vvz+WcfXk81jrrnPPd+/P9fs6XzX2e73fvs7/V3QEAFne3tZ4AAOwrRBUABhFVABhEVAFgEFEFgEFEFQAGEVVgj1TVw6vqwqq6sap+rqp+r6peupP7d1U95M6cI6wVUWXpVdVN233cXlW/Pee6NlbVa6vq81X1par63arasOL2b6qqv6mqL1fV5VX19N1c77lTXPZfsey7qurDU5wuqqrHrbjtUVV1SVV9oap+YcXyDVV1XlUduYvtHVBVp1XVZVX1L1V1RVWdUVVH7cn+2IEXJnlfdx/S3b/V3T/d3b88YL2w9ESVpdfdB2/7SHK/JF9N8qdzru7FSbYkeUSShyX51iT/I0mmIL4ryZ8nOSzJKUn+qKoetrMVVtV/SrJhu2WHJfmzJP8ryT2TvDLJn1XVodNdfi3J85M8Ksl/r6r7Tct/IclZ3X3lLn6Otyf5wSQ/muQe03ouSPL4XYzbHQ9KcsmA9cC+p7t9+NhnPpKcnOTTSWrO8ecnecaK7380yZXT149IctPKdSd5T5Jf3sn67pHkU0kek6ST7D8t/49JLtnuvp9K8uzp60uTbJy+/vskx2UWsw8n2bCLn+H7MvvF4sid3Of+Sd6d5Poklyf5qRW3nZbkbUn+MMmNmQV0y3Tb3yS5PcnXpn3xsCR/kORXVox/QZKtST6f5Cenn/sh020bk7wqyeeSXJvk95J8w3Tb8UmuSvKLSa6b1vGfV6z3G5K8Oslnk3w5yQdWjH1Mkg8m+eckH0ty/Fo/Fn3cNT8cqbKvOTnJH3b3qu+/WVUPrKp/rqoH7mQdtd3XD6iqe+zkvo/YybpenuT1Sa7ZxXa2X9fFSZ5YVQ9IclSSf0zym0le0N237mR7ySyqH+6dH82+NbOA3T/JDyd5eVV974rbf3C6zz0zi+/vJEl3f2+Sv0vy3J6dHfjU1/0AVU/O7Aj7CUkeOs1lpVdkFuJjkzwkyeYkv7Ti9vtl9ovI5iTPTvK6FUfvr0rybUm+K7MzBS9MckdVbU7yF0l+ZVr+/CRnVdV9dvLzw14hquwzqupBSb47yZk7uk93f66779ndn9vBXf4qyalVdZ/plOvPTcsPSvIPmR1BvWB6bvOJ0/YO2sF8tiR5bJLVnt/9UJL7V9WJ07pOTnL0inU9P8nPZBa0n5/Wc2OSz1TVu6rqb6vqGTv4Ge6V2VHeqqbnYx+b5EXd/bXuvjDJ/07y4yvu9oHuPru7b0/ypsxOH++OZyb5/e6+uLv/JbOj3m3brcxOmf98d1/f3Tdm9kvHs1aMvzXJ/+zuW7v77MyOhh9eVXfL7Kj31O6+urtv7+4PdvfNSX4sydnTfO/o7nMyO+PwlN2cMwyz/67vAkvjpMxi8JkF1vGrmR2dXZjk5iRvSPLoJNd29x1V9bTMIvmizP7hftt0v68zReB3M4vAbbOe/H/d/cWqOiGzo6/XJfnrJO/N7Ogx3f3ZTFGoqoMyi/ATp23/SWZHZhdX1bndff12m/9iZkeDO3L/JNuits1nM3sueZuVR9ZfSXJgVe3f3bftZL3b1n3Bduvd5j6Z/dJwwYr9UUn2Wzn37bbxlSQHJ7l3kgMzO2Lf3oOSPKOqnrpi2YYk79vFXGE4R6rsS348OzlK3R3d/dXufm53b+7uB2cWqAu6+47p9ou6+7u7+17d/aQkD87sec7t3T2zSP1JVV2T5CPT8quq6t9P6/rb7v727j4ss18I/t0O1vVLSd7Q3dcm+ZYk53f3lzML8Gp/qvLeJMdNp45X8/kkh1XVISuWPTDJ1Tu4/57YmmTlK5NXnmb/QmbP9X7zdLbgnt19j569wGxXvpDZ87hHr3LblUnetGKd9+zuTd39inl/CJiXqLJPqKrvyux5uHlf9bttPZur6v4185gkL03yshW3P7KqDqyqg6rq+UmOyOyFOtv7cmZHbcdOH9tORX5bkvOmdT16OvV798yOWK/s7r/ebj7HZPYCntdPiz6T5Hur6vDMnrP8N6exu/u9Sc5J8s6q+raq2r+qDqmqn66qn5yea/1gkl+bfpZHZvb85R/t4e5azduS/ERVHTMdYf/rvpt+MXlDktdW1X2nn29zVT1pVyudxp6R5DXTf5/9quo7q2rjNO+nVtWTpuUHVtXxO/mlAvYaUWVfcXKSd2x3SvPfmF6odNNOXqh0dGbB+ZfMjnpf3N3vWXH7SZkdjV2X2Z+nPGF6Xu/r1t0z12z7SPJP0/hru/uW6esXZnYEdmVmcV7tb15fl9kp5Nun7/9bZs/zXpLk5dO6V/PDSc7O7FTxlzN74dOWzI5ik+TEzF4A9fkk70zysinGC+nuv0zyG5m9Svjy6fNKL5qW/31V3TDN5+G7ufrnJ/l4Zkf91yf59SR3m35JOCHJSzLbz1dm9gpk/75xp6sdvEgSANhDfpMDgEFEFQAGEVUAGERUAWAQUQWAQe7Ud1Q6oDb2gdl0Z24SAIa6MV/6Qnev+t7Sd2pUD8ymfEeNuPIUAKyN9/bbP7uj25z+BYBBRBUABlkoqlX15Kr6h6q6vKpePGpSALCM5o5qVe2X2fuSfn+SY5KcOL35NwDcJS1ypHpcksu7+9PTG4S/NbM3tQaAu6RForo5s6tBbHPVtAwA7pL2+p/UVNUpSU5JkgNz0N7eHACsmUWOVK9OcuSK7x8wLfs63X16d2/p7i0bsnGBzQHA+rZIVD+S5KFV9Y1VdUCSZyV595hpAcDymfv0b3ffVlXPTfLXSfZLckZ3XzJsZgCwZBZ6TrW7z05y9qC5AMBS845KADCIqALAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAwiqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAwiqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAwiqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAwiqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAwiqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAwiqgAwyP6LDK6qK5LcmOT2JLd195YRkwKAZbRQVCff091fGLAeAFhqTv8CwCCLRrWTvKeqLqiqU1a7Q1WdUlXnV9X5t+bmBTcHAOvXoqd/H9fdV1fVfZOcU1Wf7O73r7xDd5+e5PQkuXsd1gtuDwDWrYWOVLv76unzdUnemeS4EZMCgGU0d1SralNVHbLt6yRPTHLxqIkBwLJZ5PTv4UneWVXb1vPH3f1XQ2YFAEto7qh296eTPGrgXABgqfmTGgAYRFQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgkP3XegLsXV/8qe9caPwDT7p87rGfvO7whbZ9y80b5h67+S3zj02Sg666ae6xd1z4iYW2DSwvR6oAMIioAsAgogoAg4gqAAwiqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIOIKgAMIqoAMIioAsAgLv22j3vhC/54ofE/tOlL8w8+eqFNL+b4xYZfcdtX5h77m//0PYttnKXz4eseNPfYTa++x0Lb3v/cCxYaz1iOVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFEFQAGcT3VfdxvveRZC43/pUfO/3vXoZf2Qtv+0jfV3GMPeOQ/L7TtVz7iHXOPfe0R5y207b/4ysFzj/2Bg25aaNtr6at9y0Ljz7t509xjjz/w1oW2nQX+mz/kR56z0KYfdu5CwxnMkSoADCKqADCIqALAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAwiqgAwiKgCwCCiCgCDiCoADCKqADCIS7/t4za9fbHLkG16+6CJzOHua7fp/Pb9jp977K889qiFtn33v7187rGvPP4hC217Le3/1TsWGr/poq1zj73X+89aaNvfcsCGuccedMX8Y1l/HKkCwCCiCgCDiCoADLLLqFbVGVV1XVVdvGLZYVV1TlVdNn0+dO9OEwDWv905Uv2DJE/ebtmLk5zb3Q9Ncu70PQDcpe0yqt39/iTXb7f4hCRnTl+fmeRpg+cFAEtn3udUD+/uba9fvybJ4YPmAwBLa+EXKnV3J+kd3V5Vp1TV+VV1/q25edHNAcC6NW9Ur62qI5Jk+nzdju7Y3ad395bu3rIhG+fcHACsf/NG9d1JTp6+PjnJu8ZMBwCW1+78Sc1bknwoycOr6qqqenaSVyR5QlVdluT7pu8B4C5tl+/9290n7uCmxw+eCwAsNe+oBACDiCoADCKqADCI66nCKm675tq5x246a/6xSXL7AmM3vf2LC217mV37X75z7rHffMBi/xS+6vqHzz32qN//9ELbvm2h0YzmSBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABjEpd+AdWH/Bx250PjfecnvzD12Q+230Lb/9De/b+6x99r6oYW2zfriSBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgENdTBdaFT/785oXGf/vGmnvsJbd8daFtH/aJryw0nn2HI1UAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQl34Dhrn5B7597rEf/eHXLrj1jXOP/JlTT11oy9/wwQ8vNJ59hyNVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFcTxUY5nPfP//v6QfX/NdDTZITP/OEucce9FcfW2jbvdBo9iWOVAFgEFEFgEFEFQAG2WVUq+qMqrquqi5esey0qrq6qi6cPp6yd6cJAOvf7hyp/kGSJ6+y/LXdfez0cfbYaQHA8tllVLv7/UmuvxPmAgBLbZHnVJ9bVRdNp4cPHTYjAFhS80b19UmOTnJskq1JXr2jO1bVKVV1flWdf2tunnNzALD+zRXV7r62u2/v7juSvCHJcTu57+ndvaW7t2zIYn/cDQDr2VxRraojVnz79CQX7+i+AHBXscu3KayqtyQ5Psm9q+qqJC9LcnxVHZvZu3NdkeQ5e3GOALAUdhnV7j5xlcVv3AtzAYCl5h2VAGAQUQWAQUQVAAZxPVXgX93tkEMWGn/Sv//A3GNvuONrC237upc/eO6xG2/+yELbhm0cqQLAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAwiqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIO49Bvwry477ZsXGv/n9/7duceecNkPLbTtjWe7fBtrz5EqAAwiqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAwiqgAwiKgCwCCupwr7kC//2GMWGn/Rj/zWQuP/8bZb5x57068/YKFtb8zWhcbDCI5UAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQVz6DdaZ/Tfff+6xz3vpnyy07Y212D8Jz/rYSXOPvc9ffmShbcN64EgVAAYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBDXU4XBav/F/rd61J9fNffYZxz8xYW2/eYb77vQ+MNfOv/v6XcstGVYHxypAsAgogoAg4gqAAyyy6hW1ZFV9b6q+kRVXVJVp07LD6uqc6rqsunzoXt/ugCwfu3OkeptSX6xu49J8pgkP1tVxyR5cZJzu/uhSc6dvgeAu6xdRrW7t3b3R6evb0xyaZLNSU5IcuZ0tzOTPG1vTRIAlsEevfa/qo5K8ugk5yU5vLu3Tjddk+TwHYw5JckpSXJgDpp3ngCw7u32C5Wq6uAkZyV5XnffsPK27u4kvdq47j69u7d095YN2bjQZAFgPdutqFbVhsyC+ubufse0+NqqOmK6/Ygk1+2dKQLActidV/9WkjcmubS7X7PipncnOXn6+uQk7xo/PQBYHrvznOpjk5yU5ONVdeG07CVJXpHkbVX17CSfTfLMvTNFAFgOu4xqd38gSe3g5sePnQ4ALC/vqAQAg4gqAAzi0m8w2qMevtDwX77vmwZNZM+97uXPWGj8PT/2oUEzgeXkSBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgENdThVXsd8zD5h57ylvfNXAme+aYM352ofFHvenvB80E7pocqQLAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAwiqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIO49Bus4pP/9dC5xz71oBsGzmTPPOD/3rLYCrrHTATuohypAsAgogoAg4gqAAwiqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAzieqrsk7721OMWGn/uU1+9wOiDFto2sLwcqQLAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAwiqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIO49Bv7pM8/dr+Fxj9w/7W7fNubb7zv3GM33HDLQtvuhUYDjlQBYBBRBYBBRBUABtllVKvqyKp6X1V9oqouqapTp+WnVdXVVXXh9PGUvT9dAFi/dueFSrcl+cXu/mhVHZLkgqo6Z7rttd39qr03PQBYHruMandvTbJ1+vrGqro0yea9PTEAWDZ79JxqVR2V5NFJzpsWPbeqLqqqM6rq0MFzA4ClsttRraqDk5yV5HndfUOS1yc5OsmxmR3JvnoH406pqvOr6vxbc/OAKQPA+rRbUa2qDZkF9c3d/Y4k6e5ru/v27r4jyRuSHLfa2O4+vbu3dPeWDdk4at4AsO7szqt/K8kbk1za3a9ZsfyIFXd7epKLx08PAJbH7rz697FJTkry8aq6cFr2kiQnVtWxmb2z2RVJnrNXZggAS2J3Xv37gSS1yk1nj58OACwv76gEAIOIKgAMIqoAMIjrqcJgv/bFYxYa/6EnHTX32N768YW2DSzGkSoADCKqADCIqALAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAwiqgAwiKgCwCCiCgCDiCoADCKqADBIdfedtrG712H9HfX4O217ADDae/vtF3T3ltVuc6QKAIOIKgAMIqoAMIioAsAgogoAg4gqAAwiqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIOIKgAMIqoAMMidej3VqvqnJJ/dyV3uneQLd9J09hX22Xzst/nYb3vOPpvPet5vD+ru+6x2w50a1V2pqvN3dOFXVmefzcd+m4/9tufss/ks635z+hcABhFVABhkvUX19LWewBKyz+Zjv83Hfttz9tl8lnK/ravnVAFgma23I1UAWFrrIqpV9eSq+oequryqXrzW81kWVXVFVX28qi6sqvPXej7rVVWdUVXXVdXFK5YdVlXnVNVl0+dD13KO680O9tlpVXX19Hi7sKqespZzXI+q6siqel9VfaKqLqmqU6flHm87sJN9tpSPtzU//VtV+yX5VJInJLkqyUeSnNjdn1jTiS2BqroiyZbuXq9/y7UuVNV/SHJTkj/s7kdMy16Z5PrufsX0i9yh3f2itZznerKDfXZakpu6+1VrObf1rKqOSHJEd3+0qg5JckGSpyX5iXi8rWon++yZWcLH23o4Uj0uyeXd/enuviXJW5OcsMZzYh/S3e9Pcv12i09Icub09ZmZ/U/MZAf7jF3o7q3d/dHp6xuTXJpkczzedmgn+2wprYeobk5y5Yrvr8oS79A7WSd5T1VdUFWnrPVklszh3b11+vqaJIev5WSWyHOr6qLp9LBTmDtRVUcleXSS8+Lxtlu222fJEj7e1kNUmd/juvtbk3x/kp+dTtmxh3r2HIiXwe/a65McneTYJFuTvHptp7N+VdXBSc5K8rzuvmHlbR5vq1tlny3l4209RPXqJEeu+P4B0zJ2obuvnj5fl+SdmZ1KZ/dcOz2Xs+05nevWeD7rXndf2923d/cdSd4Qj7dVVdWGzOLw5u5+x7TY420nVttny/p4Ww9R/UiSh1bVN1bVAUmeleTdazynda+qNk1P6qeqNiV5YpKLdz6KFd6d5OTp65OTvGsN57IUtkVh8vR4vP0bVVVJ3pjk0u5+zYqbPN52YEf7bFkfb2v+6t8kmV4q/RtJ9ktyRnf/6hpPad2rqgdndnSaJPsn+WP7bXVV9ZYkx2d21Ytrk7wsyf9J8rYkD8zsyknP7G4vzJnsYJ8dn9mpuE5yRZLnrHiekCRV9bgkf5fk40numBa/JLPnCD3eVrGTfXZilvDxti6iCgD7gvVw+hcA9gmiCgCDiCoADCKqADCIqALAIKIKAIOIKgAMIqoAMMj/AxQBZ585cbPqAAAAAElFTkSuQmCC\n"
          },
          "metadata": {
            "needs_background": "light"
          }
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "# Store the incorrect prediction index here\n",
        "incorrect_index = 0\n",
        "\n",
        "for i in range(preds.shape[0]):\n",
        "\n",
        "  if np.argmax(preds[i]) != np.argmax(y_test[i]):\n",
        "\n",
        "    incorrect_index = i\n",
        "\n",
        "image_incorrect = x_test[incorrect_index].reshape(input_shape[0], input_shape[1])"
      ],
      "metadata": {
        "id": "qmmsBM_E6DUc"
      },
      "execution_count": 10,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "plt.figure()\n",
        "plt.imshow(image_incorrect*0.5 + 0.5)  # To change [-1, 1] to [0,1]\n",
        "image_class, class_confidence = get_mnist_label(preds[i])\n",
        "plt.title('{} : {:.2f}% Confidence'.format(image_class, class_confidence*100))\n",
        "plt.show()\n"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 499
        },
        "id": "HKsiOalv7Bsj",
        "outputId": "ec93d6c9-d083-4b70-a68b-f4f4f3c46d5e"
      },
      "execution_count": 11,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "<Figure size 576x576 with 1 Axes>"
            ],
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAdUAAAHiCAYAAAC+xlbiAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+WH4yJAAAaj0lEQVR4nO3df7TtdV3n8dcbuPwGBVEERFTE0kxRb2ijpeWPUXOlTGUyKwbLFk7jr0xboTajk8t+uNRs/DVhkGRiizRT0xyUmpimNAFB+ZGhiAIhqPgDfyS/3vPH3nfWEe+597K/n3vP2fc+HmuddfbZ3/35fj/ny+Y+z/e79znf6u4AANPtttYTAICdhagCwCCiCgCDiCoADCKqADCIqALAIKIK3CFVdWhVnVtVN1bVa6vqpVX1R1t4/JVV9bgdOUdYK6LKTqGqnlFVl1XVt6rqs1X1YwuuZ6+q+v2q+teq+mpVvbmqNqxYfv+q+puq+npVfaaqjt8e66qqI6vqo1V1Q1W99nbr/euq2riV76Oq6vlVdfF8n1xdVX9eVT+8yH65nZOTfDnJgd39ou7+7e7+5QHrhaUnqiy9qnp8kt9L8otJDkjy40muWHB1pyTZmOSBSe6X5KFJfnO+nT2SvDfJXyU5OLO4/GlV3W87rOslSc5Icu8kT9sU0ar6+SSf6+7ztvJ9/EGSFyR5/nz990vyl0l+ahv3w5YcleTS9pdj4Pt1tw8fS/2R5B+SPGvQus5L8nMrvv6PSa6a335gkm8mqRXLz07yytHrSvLXSX5gfvvPkjw9yYFJPpHkzlv5Ho5JcmuS47bwmDsl+ZMkX0ry+cxiv9t82TOT/H2S1yT5apLPJXnSfNnbktyc5Kb5/B+X5BVJ/nTFuk+cr/MrSV6W5Mokj5sv2y2zHzY+O19+VpKD58vulaSTnJTkC5kdDb9sxXp3T/LS+dgbk5yf5Mj5sh9M8uEkNyT5dJKnr/Xz0seu+eFIlaVWVbtndjR41/kp1Kur6o1Vtc8qj79nVX2tqu65pdXe7vY9qupOW3jsA7fDui5O8viqunOShyW5JMkrk7y+u7+2he0lyWOTXN3d/7SFx7whs7DeJ8mjk/ynzI70N3l4ZnE6JMmrk5xWVdXdz0zyjiSv7u79u/sj3/MNVD0gyVsyC+vhSe6S5B4rHvK8JE+bb/PwzKL9ptvN7VFJfmD+ffy3qrr//P5fS3JCkidn9gPGLyX5dlXtl1lQz0xytyTPSPLm+VxghxJVlt2hSTYk+dkkP5bk2CQPyfw06+119xe6+87d/YVV1vehJC+oqrtW1d0zO32aJPtmFpnrk/x6VW2oqidkFod9t8O6fmf+/fxdkjcn2TPJg5K8v6rOnL9R6LmrbPcuSa5dZdmmH0SekeQl3X1jd1+Z5LWZhXCTz3f3W7v71sxOQx+W2b7emp9N8lfdfW53fzfJf01y24rl/zmzo8+r58tfkeRn56fDN/nv3f2d7r4oyUVJHjy//5eT/GZ3f7pnLururyR5SpIru/uPu/uW7v5Ekncn+bltmC8MtcfWHwLr2nfmn9/Q3dcmSVW9LrOovmyB9b0qyZ2TXJjku0nemlmkr+vu26rqaZkd5f1GZqd3z5o/bui6uvuGJD8//352S3JuZkE6JbOj2GcmuaCqzunuy2633a9kFsHVHJLZDyKfX3Hf55McseLrL2660d3frqok2X8L69zk8CRXrRj7rar6yorlRyV5T1WtDO2t+d5gf3HF7W+v2O6RmZ36vb2jkjy8qlYewe+R5O3bMF8YypEqS627v5rk6sxei/v/d09Y33e6+7ndfUR33yezQJ3f3bfNl3+yux/d3Xfp7n+f2enTzZ5mHbiuk5N8tLsvTvLDSc7r7puSfGr+9e2dk9lp5tXeIfzlzF4XPWrFffdMcs0Wds22ujaz+CVJqmrfzI6cN7kqs9dn77ziY+/u3pZtX5Xk6FXu/7vbrXP/7v6VKd8ILEJU2Rn8cZLnVdXdquqgJC/M7F21d1hVHVFVh89/JeURmZ2+fPmK5Q+qqr2rat+qenFmR4Rv217rqqq7JXlOZqdJk9mbhn6iqvbP7LXk73uXc3dfntkp43dW1WOqas/5dp5RVafMT+meleRVVXVAVR2V2euVf3qHd9j3e1eSp1TVo6pqzyS/le/9d+Z/zrd71Pz7u2tVPXUb1/1HSV5ZVcfM9+mDquoumf23vl9VnTg/lb6hqn5kxWuxsMOIKjuDVyb5eJJ/SXJZZu+QfdXmHjh/o9I3t/BGpaMzezfxtzJ7LfGU7j57xfITMzsauz6zN9I8fv7a4ObWvfC6VnhNkt/q7m/Ov/6dJD+Z2dHZ+3v1X615fpI3ZvYmoK9ldtr0+CTvny9/3nxeV2T2Tt8zk5y+yrq2WXdfktkPAWfOv7dNZxI2+YMk70tydlXdmOSjmb0palu8LrMfBs5O8o0kpyXZp7tvTPKEzF4n/tfMTh//XpK9pn4/cEdVt181A4ARHKkCwCCiCgCDiCoADCKqADCIqALAIDv0LyrtWXv13tlvR24SAIa6MV/9cnffdXPLdmhU985+eXg9dkduEgCG+ki/6/OrLXP6FwAGEVUAGGRSVKvqiVX16fl1LE8ZNSkAWEYLR3V+TcY3JXlSkgckOcFFgQHYlU05Uj0uyWe6+4r5Zaj+LMm2Xm0CAHY6U6J6RFZcjDizK1EcscpjAWCnt91/paaqTs7sIsvZO/tu780BwJqZcqR6TZIjV3x9j/l936O7T+3ujd29cYPLGwKwE5sS1Y8nOaaq7l1Ve2Z2geD3jZkWACyfhU//dvctVfXcJP8rye5JTu/uS4bNDACWzKTXVLv7g0k+OGguALDU/EUlABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGGSPtZ4ArEe1116LD37AfSdt+9qX37bw2IuOe+ekbU/1+q/ea+Gxb/+DJ03a9iFv/ejig7snbRs2caQKAIOIKgAMIqoAMMik11Sr6sokNya5Nckt3b1xxKQAYBmNeKPST3T3lwesBwCWmtO/ADDI1Kh2krOr6vyqOnlzD6iqk6vqvKo67+Z8d+LmAGD9mnr691HdfU1V3S3Jh6vqn7v73JUP6O5Tk5yaJAfWwX4ZDICd1qQj1e6+Zv75+iTvSXLciEkBwDJaOKpVtV9VHbDpdpInJLl41MQAYNlMOf17aJL3VNWm9ZzZ3R8aMisAWEILR7W7r0jy4IFzAYCl5ldqAGAQUQWAQap34CWPDqyD++H12B22PXZdux1wwKTxG/5qv4XHvvu+H5i0bRbz0z914sJjb7vw0oEzYWf3kX7X+av9WV5HqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAwiqgAwiKgCwCCiCgCD7LHWE4DV7PagH1x47AlnfWTStk844LpJ49nxPvsbGxYee+8TBk6EXZojVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBCXfmOLasOeC4+96sUbJ237109618Jjd9VLt73wX//dpPEfuvz+k8Zf9ujTJo2fYp99blp4bO0x7Z/CvuWWSePZeThSBYBBRBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABjE9VR3clOuh5okV7zyYQuPveTEN0za9rI65Ys/Mmn82e98xMJj7/nnV03a9r4/s++k8Xn0tOFTPPTuVy889rp9p33ft37jG5PGs/NwpAoAg4gqAAwiqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAzi0m87ud2PPHzS+EtOfOOgmSyX+73/VxYe+4BXXz9p24df8Q8Lj71l0paT40+6YuIa1s7//dx9Fh57729cNHAm7MocqQLAIKIKAIOIKgAMstWoVtXpVXV9VV284r6Dq+rDVXX5/PNB23eaALD+bcuR6tuSPPF2952S5JzuPibJOfOvAWCXttWodve5SW643d1PTXLG/PYZSZ42eF4AsHQWfU310O6+dn77i0kOHTQfAFhak9+o1N2dpFdbXlUnV9V5VXXezfnu1M0BwLq1aFSvq6rDkmT+edXfdu/uU7t7Y3dv3JC9FtwcAKx/i0b1fUlOmt8+Kcl7x0wHAJbXtvxKzTuT/GOSH6iqq6vqWUl+N8njq+ryJI+bfw0Au7St/u3f7j5hlUWPHTwXAFhq/qISAAwiqgAwiKgCwCCup7qTu+1LX5k0/qH/dOLCY9/xkNMnbfuKmw9ZeOyL3/sLk7b9gDd/ceGxt1xx5aRtT3HjMx4xafzP3On1E2ewYeJ4WG6OVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFc+m0nd9uNN04af/jxly489oU/+ZxJ297rqq8uPPboyz86adu3TBo9ze6H3GXhsU992TmTtn3/DWt36bZP3nTrpPGHnrX3oJnA4hypAsAgogoAg4gqAAwiqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAzieqpsN3v8zfmTxk+7uuba6UceO2n8/f/HJxce+2sH//Okba+ln/vA8yaNP+Y9Hxs0E1icI1UAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQl36DwT73nGnjP3D3j4+ZyJI5/H+v9QxgOkeqADCIqALAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAwiqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIO4niqwLvz2q/9w0vjfO++nFx57y5VfmLRt2MSRKgAMIqoAMIioAsAgW41qVZ1eVddX1cUr7ntFVV1TVRfOP568facJAOvfthypvi3JEzdz/+9397Hzjw+OnRYALJ+tRrW7z01yww6YCwAstSmvqT63qj45Pz180LAZAcCSWjSqb0lydJJjk1yb5LWrPbCqTq6q86rqvJvz3QU3BwDr30JR7e7ruvvW7r4tyVuTHLeFx57a3Ru7e+OG7LXoPAFg3VsoqlV12Iovj09y8WqPBYBdxVb/TGFVvTPJY5IcUlVXJ3l5ksdU1bFJOsmVSZ69HecIAEthq1Ht7hM2c/dp22EuALDU/EUlABhEVAFgEFEFgEFcTxUGu/cbe9L4T/7orQuPfdCeu0/a9lr60b0W/76T5J9fcPjCY+/7QtdTZQxHqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAwiqgAwiKgCwCAu/QaD1T9cNGn8y/7DLy489kvHHThp23/yktdNGn+/DXtOGj/F7nf/zpptGzZxpAoAg4gqAAwiqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAwiqgAwiOupwjrTn7hk4bGHfGLatn/+zi+aNP4Tz3/DtAlM8K4f/cOFx77kHj8zadu3XH3NpPHsPBypAsAgogoAg4gqAAwiqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIOIKgAMIqoAMIioAsAgogoAg7j0G9vNvz3luEnjv3b04k/PI87+0qRt33rZ5ZPGL6t9vtRrPYWF3X/DhsUHb/BPIWM4UgWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYxEUE2aLd73f0wmPf9qbXTdr2PfbYZ+Gx579g0qZzwod+ZeGxd/vH3Sdt+85v/8dJ46e44UHLez3VU79+r4XH9je/PW4i7NIcqQLAIKIKAIOIKgAMstWoVtWRVfW3VXVpVV1SVS+Y339wVX24qi6ffz5o+08XANavbTlSvSXJi7r7AUkekeQ5VfWAJKckOae7j0lyzvxrANhlbTWq3X1td18wv31jksuSHJHkqUnOmD/sjCRP216TBIBlcId+paaq7pXkIUk+luTQ7r52vuiLSQ5dZczJSU5Okr2z76LzBIB1b5vfqFRV+yd5d5Jf7e5vrFzW3Z1ks7/g1t2ndvfG7t64IXtNmiwArGfbFNWq2pBZUN/R3X8xv/u6qjpsvvywJNdvnykCwHLYlnf/VpLTklzW3Sv/RM77kpw0v31SkveOnx4ALI9teU31kUlOTPKpqrpwft9Lk/xukrOq6llJPp/k6dtnigCwHLYa1e7++yS1yuLHjp0OACwvf1EJAAYRVQAYpGa/DbNjHFgH98PLGeMd6eu/8IhJ41//W29aeOzDdtHfoPr6bf82afzFNx0waCZ33EP2+tak8fvWnoNmcsf90Lm/tPDYe59w0cCZsLP7SL/r/O7euLlljlQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABtljrSfA9nXLPjVp/It//b8sPPaAz944adtPPfPvFh77rDt9YdK2p7jTbntPGv/IvW8eNJNFrN31UKfa64L91noK4EgVAEYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYpLp7h23swDq4H16P3WHbY7nttt/il/K65tkPnrTtF5981sJjTzjguknb3lU9+M3PmzT+yN/52OKDb7t10rbZtXyk33V+d2/c3DJHqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAwiqgAwiKgCwCCiCgCDuJ4qbEZt2HPxsT9030nbvvrli4+94Li3T9r2qV+/16TxH/jpzV5icpvc+tkrJ207O/DfMnZtrqcKADuAqALAIKIKAIOIKgAMIqoAMIioAsAgogoAg4gqAAwiqgAwiKgCwCCiCgCDiCoADCKqADCIqALAIHus9QRgPeqbb1p87IWXTtr24ccvPvYpedikbU/3uTXePqwtR6oAMIioAsAgogoAg2w1qlV1ZFX9bVVdWlWXVNUL5ve/oqquqaoL5x9P3v7TBYD1a1veqHRLkhd19wVVdUCS86vqw/Nlv9/dr9l+0wOA5bHVqHb3tUmund++saouS3LE9p4YACybO/SaalXdK8lDknxsftdzq+qTVXV6VR00eG4AsFS2OapVtX+Sdyf51e7+RpK3JDk6ybGZHcm+dpVxJ1fVeVV13s357oApA8D6tE1RraoNmQX1Hd39F0nS3dd1963dfVuStyY5bnNju/vU7t7Y3Rs3ZK9R8waAdWdb3v1bSU5Lcll3v27F/YeteNjxSS4ePz0AWB7b8u7fRyY5McmnqurC+X0vTXJCVR2bpJNcmeTZ22WGALAktuXdv3+fpDaz6IPjpwMAy8tfVAKAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFEFQAGEVUAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBBRBUABhFVABhEVAFgEFEFgEFEFQAGqe7ecRur+lKSz2/hIYck+fIOms7Owj5bjP22GPvtjrPPFrOe99tR3X3XzS3YoVHdmqo6r7s3rvU8lol9thj7bTH22x1nny1mWfeb078AMIioAsAg6y2qp671BJaQfbYY+20x9tsdZ58tZin327p6TRUAltl6O1IFgKW1LqJaVU+sqk9X1Weq6pS1ns+yqKorq+pTVXVhVZ231vNZr6rq9Kq6vqouXnHfwVX14aq6fP75oLWc43qzyj57RVVdM3++XVhVT17LOa5HVXVkVf1tVV1aVZdU1Qvm93u+rWIL+2wpn29rfvq3qnZP8i9JHp/k6iQfT3JCd1+6phNbAlV1ZZKN3b1ef5drXaiqH0/yzSR/0t0PnN/36iQ3dPfvzn+QO6i7f2Mt57merLLPXpHkm939mrWc23pWVYclOay7L6iqA5Kcn+RpSZ4Zz7fN2sI+e3qW8Pm2Ho5Uj0vyme6+ortvSvJnSZ66xnNiJ9Ld5ya54XZ3PzXJGfPbZ2T2PzFzq+wztqK7r+3uC+a3b0xyWZIj4vm2qi3ss6W0HqJ6RJKrVnx9dZZ4h+5gneTsqjq/qk5e68ksmUO7+9r57S8mOXQtJ7NEnltVn5yfHnYKcwuq6l5JHpLkY/F82ya322fJEj7f1kNUWdyjuvuhSZ6U5DnzU3bcQT17DcTb4LfuLUmOTnJskmuTvHZtp7N+VdX+Sd6d5Fe7+xsrl3m+bd5m9tlSPt/WQ1SvSXLkiq/vMb+Prejua+afr0/ynsxOpbNtrpu/lrPpNZ3r13g+6153X9fdt3b3bUneGs+3zaqqDZnF4R3d/Rfzuz3ftmBz+2xZn2/rIaofT3JMVd27qvZM8owk71vjOa17VbXf/EX9VNV+SZ6Q5OItj2KF9yU5aX77pCTvXcO5LIVNUZg7Pp5v36eqKslpSS7r7tetWOT5torV9tmyPt/W/N2/STJ/q/Trk+ye5PTuftUaT2ndq6r7ZHZ0miR7JDnTftu8qnpnksdkdtWL65K8PMlfJjkryT0zu3LS07vbG3PmVtlnj8nsVFwnuTLJs1e8TkiSqnpUkv+T5FNJbpvf/dLMXiP0fNuMLeyzE7KEz7d1EVUA2Bmsh9O/ALBTEFUAGERUAWAQUQWAQUQVAAYRVQAYRFQBYBBRBYBB/h/mvLZLaOtmzAAAAABJRU5ErkJggg==\n"
          },
          "metadata": {
            "needs_background": "light"
          }
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "We see that a 3 has been predicted with high confidence as a 6 does this change with our improved model below?"
      ],
      "metadata": {
        "id": "VfSIJAF57dhy"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        " # TASK 1: Improve the accuracy of the model \n",
        "\n",
        "Your goal in task one is to improve the accuracy of the model on the test set. "
      ],
      "metadata": {
        "id": "LifPv5WJvSMu"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "For image recogniton tasks convolutional neural networks work better than most other type of architectures. Your goal is to push the test accuracy above 99% percent. \n",
        "\n",
        "The following steps will get you there. \n",
        "\n",
        "1. Convert the 1st hidden Dense layer to a conv layer with 32 filters, a filter size of 3x3 and with relu activation. (I've done this step)\n",
        "2. Add a Maxpooling layer of size 2x2. \n",
        "3. Add another Conv layer with 64 filters, with a filter size of 3x3 with relu activation. \n",
        "4. Add a Maxpooling layer of size 2x2. \n",
        "5. Add Dropout to the layer after the Flatten layer. "
      ],
      "metadata": {
        "id": "nq8pen8-wdsh"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "improved_model = keras.Sequential(\n",
        "    [\n",
        "        keras.Input(shape=input_shape),\n",
        "        layers.Conv2D(32, kernel_size=(3, 3), activation=\"relu\"),\n",
        "        # Add Maxpooling layer here\n",
        "        layers.MaxPooling2D(pool_size=(2, 2), strides=None, padding=\"valid\", data_format=None),\n",
        "        # Add Conv2d layer here\n",
        "        layers.Conv2D(64, kernel_size=(3, 3), activation=\"relu\"),\n",
        "        layers.MaxPooling2D(pool_size=(2, 2), strides=None, padding=\"valid\", data_format=None),\n",
        "        layers.Flatten(),\n",
        "        # Add dropout of 0.5 here\n",
        "        layers.Dropout(0.5, noise_shape=None, seed=None),\n",
        "        layers.Dense(num_classes, activation=\"softmax\"),\n",
        "    ]\n",
        ")\n",
        "\n",
        "improved_model.summary()\n"
      ],
      "metadata": {
        "id": "LeDUJgK2wb4l",
        "outputId": "44208515-477e-457a-ca21-6b4fe5317b1c",
        "colab": {
          "base_uri": "https://localhost:8080/"
        }
      },
      "execution_count": 12,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Model: \"sequential_1\"\n",
            "_________________________________________________________________\n",
            " Layer (type)                Output Shape              Param #   \n",
            "=================================================================\n",
            " conv2d (Conv2D)             (None, 26, 26, 32)        320       \n",
            "                                                                 \n",
            " max_pooling2d (MaxPooling2D  (None, 13, 13, 32)       0         \n",
            " )                                                               \n",
            "                                                                 \n",
            " conv2d_1 (Conv2D)           (None, 11, 11, 64)        18496     \n",
            "                                                                 \n",
            " max_pooling2d_1 (MaxPooling  (None, 5, 5, 64)         0         \n",
            " 2D)                                                             \n",
            "                                                                 \n",
            " flatten_1 (Flatten)         (None, 1600)              0         \n",
            "                                                                 \n",
            " dropout (Dropout)           (None, 1600)              0         \n",
            "                                                                 \n",
            " dense_2 (Dense)             (None, 10)                16010     \n",
            "                                                                 \n",
            "=================================================================\n",
            "Total params: 34,826\n",
            "Trainable params: 34,826\n",
            "Non-trainable params: 0\n",
            "_________________________________________________________________\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Complile and train the improved model. "
      ],
      "metadata": {
        "id": "ffzFzyOZ0UG8"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "batch_size = 128\n",
        "epochs = 15\n",
        "\n",
        "improved_model.compile(loss=\"categorical_crossentropy\", optimizer=\"adam\", metrics=[\"accuracy\"])\n",
        "\n",
        "improved_model.fit(x_train, y_train, batch_size=batch_size, epochs=epochs, validation_split=0.1)\n"
      ],
      "metadata": {
        "id": "aPBhYQml1OuH",
        "outputId": "b2591c7f-d6fa-4097-8e50-3e840a5caca5",
        "colab": {
          "base_uri": "https://localhost:8080/"
        }
      },
      "execution_count": 13,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 1/15\n",
            "422/422 [==============================] - 11s 6ms/step - loss: 0.3777 - accuracy: 0.8866 - val_loss: 0.0838 - val_accuracy: 0.9793\n",
            "Epoch 2/15\n",
            "422/422 [==============================] - 3s 6ms/step - loss: 0.1125 - accuracy: 0.9661 - val_loss: 0.0549 - val_accuracy: 0.9857\n",
            "Epoch 3/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0857 - accuracy: 0.9736 - val_loss: 0.0454 - val_accuracy: 0.9883\n",
            "Epoch 4/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0691 - accuracy: 0.9781 - val_loss: 0.0410 - val_accuracy: 0.9880\n",
            "Epoch 5/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0613 - accuracy: 0.9813 - val_loss: 0.0393 - val_accuracy: 0.9893\n",
            "Epoch 6/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0547 - accuracy: 0.9828 - val_loss: 0.0412 - val_accuracy: 0.9883\n",
            "Epoch 7/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0512 - accuracy: 0.9841 - val_loss: 0.0327 - val_accuracy: 0.9908\n",
            "Epoch 8/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0475 - accuracy: 0.9850 - val_loss: 0.0342 - val_accuracy: 0.9905\n",
            "Epoch 9/15\n",
            "422/422 [==============================] - 3s 6ms/step - loss: 0.0434 - accuracy: 0.9864 - val_loss: 0.0352 - val_accuracy: 0.9902\n",
            "Epoch 10/15\n",
            "422/422 [==============================] - 2s 6ms/step - loss: 0.0416 - accuracy: 0.9864 - val_loss: 0.0311 - val_accuracy: 0.9913\n",
            "Epoch 11/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0382 - accuracy: 0.9879 - val_loss: 0.0336 - val_accuracy: 0.9913\n",
            "Epoch 12/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0399 - accuracy: 0.9873 - val_loss: 0.0294 - val_accuracy: 0.9915\n",
            "Epoch 13/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0350 - accuracy: 0.9893 - val_loss: 0.0285 - val_accuracy: 0.9917\n",
            "Epoch 14/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0347 - accuracy: 0.9886 - val_loss: 0.0324 - val_accuracy: 0.9917\n",
            "Epoch 15/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0318 - accuracy: 0.9896 - val_loss: 0.0272 - val_accuracy: 0.9930\n"
          ]
        },
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "<keras.callbacks.History at 0x7f8fcd5f3ed0>"
            ]
          },
          "metadata": {},
          "execution_count": 13
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Evaluate the Improved model. \n",
        "\n",
        "You should achieve a test accuracy of greater than 99%!\n",
        "\n",
        "If not the code will throw an assertion error. "
      ],
      "metadata": {
        "id": "7a7EZNcv1r9J"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "score = improved_model.evaluate(x_test, y_test, verbose=0)\n",
        "print(\"Improved Test loss:\", score[0])\n",
        "print(\"Improved Test accuracy:\", score[1])\n",
        "\n",
        "assert score[1] > 0.99"
      ],
      "metadata": {
        "id": "lYKx0TKH2P6G",
        "outputId": "1172aa6b-f917-46a2-e773-1858aec4dafc",
        "colab": {
          "base_uri": "https://localhost:8080/"
        }
      },
      "execution_count": 14,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Improved Test loss: 0.024950170889496803\n",
            "Improved Test accuracy: 0.9918000102043152\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Looking at a prediction.\n",
        "\n",
        "Lets look at the prediction for a particular image in our model. We will look at one corect and one incorrect prediction and see if we can improve on the incorrect prediction. \n",
        "\n",
        "Check the predictions on the improved model, do you see improvements on the incorrect sample. "
      ],
      "metadata": {
        "id": "aD885MO57xoV"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "improved_preds = improved_model.predict(x_test)\n",
        "\n",
        "image = x_test[0].reshape(input_shape[0], input_shape[1])\n",
        "label = np.argmax(y_test[0])\n"
      ],
      "metadata": {
        "id": "0ozaLxNg7xoW"
      },
      "execution_count": 15,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "plt.figure()\n",
        "plt.imshow(image*0.5 + 0.5)  # To change [-1, 1] to [0,1]\n",
        "image_class, class_confidence = get_mnist_label(improved_preds[0])\n",
        "plt.title('{} : {:.2f}% Confidence'.format(image_class, class_confidence*100))\n",
        "plt.show()\n"
      ],
      "metadata": {
        "id": "y0qsS5jY7xoW",
        "outputId": "039fc79b-9612-4e9b-9a75-288ceb970bf0",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 499
        }
      },
      "execution_count": 16,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "<Figure size 576x576 with 1 Axes>"
            ],
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAdUAAAHiCAYAAAC+xlbiAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+WH4yJAAAZ7klEQVR4nO3de7ztdV3n8fcnLgc5oIEoAnLJ62OglBqkHGyGHqaijYNWmuQQTRp08ZFOzZTDdHGcMvURaRezwZGJHMRS8VKpaYxlTmaCg8jFhBQUOnIElUsa1+/8sX7Hx+60z4W1Poe91+H5fDz2Y6/9+63v+n337yx47d9av71/NcYIALC4b1jrCQDA7kJUAaCJqAJAE1EFgCaiCgBNRBUAmogqsJCqekBV/VFV3VxVb62q51fV+7dz/z+vqhfel3OE+4qospSq6ratPu6uqt+a87G+uar+tKpurKp/9ovbVXVgVb2jqv6hqq6tqh/cav0PTsv/oareWVUHbmdbx1bVxVX11enzsSvWVVW9qqpumj5eVVU1rXvQNMevVNV5VbXHinFnV9X37sT3+YNVddG0vzZV1Xur6kk7u5+24/uTHJzkwWOM54wxzhtjPLXhcWHpiCpLaYyx35aPJA9L8rUkb53z4e5M8odJXrCN9a9Lckdm4Xh+ktdX1TFJMn3+H0lOndZ/NcnvrPYgVbV3kncl+d9JDkhybpJ3TcuT5PQkz0ry+CSPS/LMJGdM685I8v+mbRyV5NnTYz4xyaFjjAu29w1W1U8neW2SV0yPccQ0z5O3N24nHZnk02OMuxoeC5bbGMOHj6X+SHJaks8kqQUf51Gz/yT+ybKNmQX1MSuWvSnJK6fbr0jy5hXrHjndf/9VHv+pSa5fOc8kn0ty0nT7r5KcvmLdC5L89XT79UmeNt1+ZZKfTbJHkr9O8ogdfF8PSnJbkuds5z4bMovu308fr02yYVp3YpLrkvxMks1JNiX5D9O6/zZ9v3dO23hBkh9O8uEVj/2UJJ9KcnOS307yF0leuGL9jyS5MsmXk/xpkiNXrBtJfizJVUm+ktkPOCv3349OY29NckWSb5uWH5rk7Um+mOSzSX5qrZ+nPu4fH45U2R2cluT3xxir/s3Nqjpietn0iDke+zFJ7hpjfHrFsk8kOWa6fcz0dZJkjPF3mSK8ymMdk+TSreZ56bYea6vtXJbku6vqAUm+M8nlSX4qyXvHGJ/ZwffwxCT7JHnHdu7zX5N8R5JjMztSPj7Jz69Y/7DM4nxYZuF8XVUdMMb4pcx+sPiDMXvl4I0rH7SqDkpywfRYByX5uyQnrFh/cpIzk3xvkock+csk5281t3+b5AmZHb0/N8nTprHPSfKyJD+U5IFJ/l2Sm6rqG5L8UWb777AkT07ykqp62na+f2ghqiy1qjoyyb/J7KXUVY0xPjfG+MYxxufm2MR+SW7ZatnNSfZfsf7m7azf+rG2d9+t19+cZL/pfdU3Zha1j2YWnk9k9pLza6vqd6vqQ1X1y9v4Hh6c5Max/Zdnn5/k5WOMzWOML2Z2BHrqivV3TuvvHGO8J7Oj0sdu5/G2eEaSy8cYbxtj3JnZEfAXVqz/sSS/Osa4cprfK5IcO/27bvHKMcZXpn+/D2YW/iR5YZJXjzE+NmauHmNcm1mAHzLGePkY447ph443JHneTswXFrLnWk8AFnRqZi81fnYXPf5tmR0FrfTAzF5u3Jn1izzWA5PcNh3Z/mNm77kmSarqrZkd4T0/sx+O/02S91fVSWOM9221jZuSHFRVe24nrIcmuXbF19dOy77+GFuN/WpmPwTsyKFJPr/lizHGqKrPr1h/ZJLfqKqzViyrzI4wt8xnZYRXbvfwzI58t3ZkkkOr6isrlu2R2Q8jsEs5UmXZ/VC2c5Ta4NNJ9qyqR69Y9vjMXn7N9PnxW1ZU1SMye39y5cvFWXHfx205o3fyuG091lbb+bqqOimz9xXfl+Rbklw0hfei6fG29pEkt2d2EtS2/H1mMdriiGnZojZlFr8kszOcV36dWXDPmF5J2PLxgDHGX+3EY38+s/ewV1v+2a0ec/8xxjMW+UZgZ4gqS6uq/lVmRzTznvW75XGqqvZJsvf09T5VtSFJxhj/kNl7gi+vqo1VdUJmZ8y+aRp+XpJnVtV3VtXGJC9PcsEYY7Uj1T9PcneSn6qqDVX1omn5/5k+/36Sn66qw6rq0MxODPq9rea6T2YnKr1kWvTZJCdOZxCfkNkJW//EGOPmJL+Y2fugz6qqfatqr6p6elW9errb+Ul+vqoeMr0P+ouZnaW8qD9JckxVfW9V7ZnZ+8APW7H+d5P8lxVnUz9oeq90Z/zPJP+pqv7l9G/4qOll479JcmtV/VzNfod2j+nXpp7Q8P3Adokqy+y0bDtgXzedqHTbdk5UOjKzX8nZclT4tSR/u2L9TyR5QGZnvp6f5MfHGJcnyfT5xzKL6+bM3h/9iRXbfm9VnTnd947MjhZ/KLMzWX8kybOm5cnsV3P+KMknMzsx6U+mZSudmeS8McZ1K8YclNlZrtdlGycjjTHOSvLTmZ0w9MXMjuZelOSd011+ObMj3Uun7X98WraQMcaNSZ6T2Q8CNyV5dJL/u2L9O5K8KslbquqWzL7vp+/kY781ya8keXNmL6G/M8mBY4y7Mzu56djMfui4MbMAP2jR7wd2pLZxwiQAcC85UgWAJqIKAE1EFQCaiCoANBFVAGhyn/5Fpb1rw9gnG+/LTQJAq1vz5RvHGA9Zbd19GtV9sjHfXk++LzcJAK3+bLzt2m2t8/IvADQRVQBoslBUq+qkqvrbqrq6ql7aNSkAWEZzR7Wq9kjyusz+TufRSU6pqqO7JgYAy2aRI9Xjk1w9xvjM9AfB35LZ1TsA4H5pkagelhUXH87sChmHLTYdAFheu/xXaqrq9CSnJ8k+2XdXbw4A1swiR6rXJzl8xdcPn5b9E2OMs8cYx40xjtsrGxbYHACsb4tE9WNJHl1V31RVeyd5XpJ390wLAJbP3C//jjHuqqoXJfnTJHskOWeMcXnbzABgySz0nuoY4z1J3tM0FwBYav6iEgA0EVUAaCKqANBEVAGgiagCQBNRBYAmogoATUQVAJqIKgA0EVUAaCKqANBEVAGgiagCQBNRBYAmogoATUQVAJqIKgA0EVUAaCKqANBEVAGgiagCQBNRBYAmogoATUQVAJqIKgA0EVUAaCKqANBEVAGgiagCQBNRBYAmogoATUQVAJqIKgA0EVUAaCKqANBEVAGgiagCQBNRBYAmogoATUQVAJqIKgA0EVUAaCKqANBEVAGgiagCQBNRBYAmogoATUQVAJqIKgA0EVUAaCKqANBEVAGgiagCQBNRBYAmogoATUQVAJqIKgA0EVUAaCKqANBEVAGgiagCQBNRBYAmogoATUQVAJqIKgA0EVUAaCKqANBEVAGgiagCQJM9FxlcVdckuTXJ3UnuGmMc1zEpAFhGC0V18l1jjBsbHgcAlpqXfwGgyaJRHUneX1UXV9Xpq92hqk6vqouq6qI7c/uCmwOA9WvRl3+fNMa4vqoemuQDVfWpMcaHVt5hjHF2krOT5IF14FhwewCwbi10pDrGuH76vDnJO5Ic3zEpAFhGc0e1qjZW1f5bbid5apLLuiYGAMtmkZd/D07yjqra8jhvHmO8r2VWALCE5o7qGOMzSR7fOBcAWGp+pQYAmogqADQRVQBoIqoA0ERUAaCJqAJAE1EFgCaiCgBNRBUAmogqADQRVQBoIqoA0ERUAaCJqAJAE1EFgCaiCgBNRBUAmogqADTZc60nwK51048+caHxR5x69dxjP7X54IW2fcfte8099rDz5x+bJPted9vcY++55IqFtg0sL0eqANBEVAGgiagCQBNRBYAmogoATUQVAJqIKgA0EVUAaCKqANBEVAGgiagCQBNRBYAmogoATUQVAJq49Ntu7mf/85sXGv99G788/+BHLrTpxZy42PBr7vrq3GN/44vftdjGWTp/s/nIucduPOtBC217zwsvXmg8vRypAkATUQWAJqIKAE1EFQCaiCoANBFVAGgiqgDQRFQBoImoAkATUQWAJqIKAE1EFQCaiCoANBFVAGgiqgDQxPVUd3O/eebzFhr/i4+b/+euA64cC237y/+i5h679+O+stC2X/3NF8w99jWHfHShbf/JV/ebe+z37HvbQtteS18bdyw0/qO3b5x77In73LnQtrPAv/mjfuCMhTb9mAsXGk4zR6oA0ERUAaCJqAJAE1EFgCaiCgBNRBUAmogqADQRVQBoIqoA0ERUAaCJqAJAE1EFgCaiCgBNRBUAmrj0225u49sWuwzZxrc1TWQOD1y7Tee3Hnbi3GN/+YSjFtr2A//i6rnHvvrERy207bW059fuWWj8xks3zT32wR96+0Lb/pa995p77L7XzD+W9ceRKgA0EVUAaCKqANBkh1GtqnOqanNVXbZi2YFV9YGqumr6fMCunSYArH87c6T6e0lO2mrZS5NcOMZ4dJILp68B4H5th1EdY3woyZe2WnxyknOn2+cmeVbzvABg6cz7nurBY4wt569/IcnBTfMBgKW18IlKY4yRZGxrfVWdXlUXVdVFd+b2RTcHAOvWvFG9oaoOSZLp8+Zt3XGMcfYY47gxxnF7ZcOcmwOA9W/eqL47yWnT7dOSvKtnOgCwvHbmV2rOT/KRJI+tquuq6gVJXpnkKVV1VZLvnr4GgPu1Hf7t3zHGKdtY9eTmuQDAUvMXlQCgiagCQBNRBYAmrqcKq7jrCzfMPXbj2+cfmyR3LzB249tuWmjby+yGFz5x7rHH7L3Y/wp/7UuPnXvsUf/rMwtt+66FRtPNkSoANBFVAGgiqgDQRFQBoImoAkATUQWAJqIKAE1EFQCaiCoANBFVAGgiqgDQRFQBoImoAkATUQWAJi79BqwLex55+ELjf/vM35577F61x0LbfutvfPfcYx+86SMLbZv1xZEqADQRVQBoIqoA0ERUAaCJqAJAE1EFgCaiCgBNRBUAmogqADQRVQBoIqoA0ERUAaCJqAJAE1EFgCaiCgBNXE8VWBc+9R8PW2j8EzbU3GMvv+NrC237wCu+utB4dh+OVAGgiagCQBNRBYAmogoATUQVAJqIKgA0EVUAaCKqANBEVAGgiagCQBNRBYAmogoATUQVAJqIKgA0cek3oM3t3/OEucd+/Ptfs+DWN8w98sdf/OKFtvyAv/qbhcaz+3CkCgBNRBUAmogqADQRVQBoIqoA0ERUAaCJqAJAE1EFgCaiCgBNRBUAmogqADQRVQBoIqoA0ERUAaCJqAJAE9dTBdp87unz/5y+X81/PdQkOeWzT5l77L7v+8RC2x4LjWZ34kgVAJqIKgA0EVUAaLLDqFbVOVW1uaouW7HsZVV1fVVdMn08Y9dOEwDWv505Uv29JCetsvw1Y4xjp4/39E4LAJbPDqM6xvhQki/dB3MBgKW2yHuqL6qqS6eXhw9omxEALKl5o/r6JI9McmySTUnO2tYdq+r0qrqoqi66M7fPuTkAWP/miuoY44Yxxt1jjHuSvCHJ8du579ljjOPGGMftlcV+uRsA1rO5olpVh6z48tlJLtvWfQHg/mKHf6awqs5PcmKSg6rquiS/lOTEqjo2s7/OdU2SM3bhHAFgKewwqmOMU1ZZ/MZdMBcAWGr+ohIANBFVAGgiqgDQxPVUga/7hv33X2j8qd/54bnH3nLPPy607c2veMTcYzfc/rGFtg1bOFIFgCaiCgBNRBUAmogqADQRVQBoIqoA0ERUAaCJqAJAE1EFgCaiCgBNRBUAmogqADQRVQBoIqoA0MSl34Cvu+plxyw0/o8P+p25x5581fcttO0N73H5NtaeI1UAaCKqANBEVAGgiagCQBNRBYAmogoATUQVAJqIKgA0EVUAaCKqANBEVAGgiagCQBNRBYAmogoATUQVAJq4nirsRm7+99+x0PhLf+A3Fxr/d3fdOffY21718IW2vSGbFhoPHRypAkATUQWAJqIKAE1EFQCaiCoANBFVAGgiqgDQRFQBoImoAkATUQWAJqIKAE1EFQCaiCoANBFVAGji0m+wzux52KFzj33JL/zBQtveUIv9L+F5nzh17rEPee/HFto2rAeOVAGgiagCQBNRBYAmogoATUQVAJqIKgA0EVUAaCKqANBEVAGgiagCQBNRBYAmogoATUQVAJqIKgA0EVUAaOJ6qtCs9lzsP6vH//F1c499zn43LbTt82596ELjD/6F+X9Ov2ehLcP64EgVAJqIKgA0EVUAaLLDqFbV4VX1waq6oqour6oXT8sPrKoPVNVV0+cDdv10AWD92pkj1buS/MwY4+gk35HkJ6vq6CQvTXLhGOPRSS6cvgaA+60dRnWMsWmM8fHp9q1JrkxyWJKTk5w73e3cJM/aVZMEgGVwr879r6qjknxrko8mOXiMsWla9YUkB29jzOlJTk+SfbLvvPMEgHVvp09Uqqr9krw9yUvGGLesXDfGGEnGauPGGGePMY4bYxy3VzYsNFkAWM92KqpVtVdmQT1vjHHBtPiGqjpkWn9Iks27ZooAsBx25uzfSvLGJFeOMX59xap3Jzltun1aknf1Tw8AlsfOvKd6QpJTk3yyqi6Zlp2Z5JVJ/rCqXpDk2iTP3TVTBIDlsMOojjE+nKS2sfrJvdMBgOXlLyoBQBNRBYAmLv0G3R7/2IWG//eHvqlpIvfe617xnIXGf+MnPtI0E1hOjlQBoImoAkATUQWAJqIKAE1EFQCaiCoANBFVAGgiqgDQRFQBoImoAkATUQWAJqIKAE1EFQCaiCoANBFVAGjieqqwij2OfszcY09/y7saZ3LvHH3OTy40/qg3/XXTTOD+yZEqADQRVQBoIqoA0ERUAaCJqAJAE1EFgCaiCgBNRBUAmogqADQRVQBoIqoA0ERUAaCJqAJAE1EFgCYu/Qar+NRPHDD32Gfue0vjTO6dh//5HYs9wBg9E4H7KUeqANBEVAGgiagCQBNRBYAmogoATUQVAJqIKgA0EVUAaCKqANBEVAGgiagCQBNRBYAmogoATUQVAJqIKgA0cT1Vdkv/+MzjFxp/4TPPWmD0vgttG1hejlQBoImoAkATUQWAJqIKAE1EFQCaiCoANBFVAGgiqgDQRFQBoImoAkATUQWAJqIKAE1EFQCaiCoANHHpN3ZLf3/CHguNP2LPtbt823m3PnTusXvdcsdC2x4LjQYcqQJAE1EFgCaiCgBNdhjVqjq8qj5YVVdU1eVV9eJp+cuq6vqqumT6eMauny4ArF87c6LSXUl+Zozx8araP8nFVfWBad1rxhi/tuumBwDLY4dRHWNsSrJpun1rVV2Z5LBdPTEAWDb36j3Vqjoqybcm+ei06EVVdWlVnVNVBzTPDQCWyk5Htar2S/L2JC8ZY9yS5PVJHpnk2MyOZM/axrjTq+qiqrroztzeMGUAWJ92KqpVtVdmQT1vjHFBkowxbhhj3D3GuCfJG5Icv9rYMcbZY4zjxhjH7ZUNXfMGgHVnZ87+rSRvTHLlGOPXVyw/ZMXdnp3ksv7pAcDy2Jmzf09IcmqST1bVJdOyM5OcUlXHZvaXza5JcsYumSEALImdOfv3w0lqlVXv6Z8OACwvf1EJAJqIKgA0EVUAaOJ6qtDsV286eqHxH3naUXOPHZs+udC2gcU4UgWAJqIKAE1EFQCaiCoANBFVAGgiqgDQRFQBoImoAkATUQWAJqIKAE1EFQCaiCoANBFVAGgiqgDQpMYY99nGHlgHjm+vJ99n2wOAbn823nbxGOO41dY5UgWAJqIKAE1EFQCaiCoANBFVAGgiqgDQRFQBoImoAkATUQWAJqIKAE1EFQCaiCoANBFVAGgiqgDQRFQBoMl9ej3Vqvpikmu3c5eDktx4H01nd2Gfzcd+m4/9du/ZZ/NZz/vtyDHGQ1ZbcZ9GdUeq6qJtXfiV1dln87Hf5mO/3Xv22XyWdb95+RcAmogqADRZb1E9e60nsITss/nYb/Ox3+49+2w+S7nf1tV7qgCwzNbbkSoALK11EdWqOqmq/raqrq6ql671fJZFVV1TVZ+sqkuq6qK1ns96VVXnVNXmqrpsxbIDq+oDVXXV9PmAtZzjerONffayqrp+er5dUlXPWMs5rkdVdXhVfbCqrqiqy6vqxdNyz7dt2M4+W8rn25q//FtVeyT5dJKnJLkuyceSnDLGuGJNJ7YEquqaJMeNMdbr73KtC1X1r5PcluT3xxjfPC17dZIvjTFeOf0gd8AY4+fWcp7ryTb22cuS3DbG+LW1nNt6VlWHJDlkjPHxqto/ycVJnpXkh+P5tqrt7LPnZgmfb+vhSPX4JFePMT4zxrgjyVuSnLzGc2I3Msb4UJIvbbX45CTnTrfPzew/Yibb2GfswBhj0xjj49PtW5NcmeSweL5t03b22VJaD1E9LMnnV3x9XZZ4h97HRpL3V9XFVXX6Wk9myRw8xtg03f5CkoPXcjJL5EVVden08rCXMLejqo5K8q1JPhrPt52y1T5LlvD5th6iyvyeNMb4tiRPT/KT00t23Etj9h6I0+B37PVJHpnk2CSbkpy1ttNZv6pqvyRvT/KSMcYtK9d5vq1ulX22lM+39RDV65McvuLrh0/L2IExxvXT581J3pHZS+nsnBum93K2vKezeY3ns+6NMW4YY9w9xrgnyRvi+baqqtorszicN8a4YFrs+bYdq+2zZX2+rYeofizJo6vqm6pq7yTPS/LuNZ7TuldVG6c39VNVG5M8Ncll2x/FCu9Octp0+7Qk71rDuSyFLVGYPDueb/9MVVWSNya5cozx6ytWeb5tw7b22bI+39b87N8kmU6Vfm2SPZKcM8b4lTWe0rpXVY/I7Og0SfZM8mb7bXVVdX6SEzO76sUNSX4pyTuT/GGSIzK7ctJzxxhOzJlsY5+dmNlLcSPJNUnOWPE+IUmq6klJ/jLJJ5PcMy0+M7P3CD3fVrGdfXZKlvD5ti6iCgC7g/Xw8i8A7BZEFQCaiCoANBFVAGgiqgDQRFQBoImoAkATUQWAJv8ff1Q/uhk7K7AAAAAASUVORK5CYII=\n"
          },
          "metadata": {
            "needs_background": "light"
          }
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "plt.figure()\n",
        "plt.imshow(image_incorrect*0.5 + 0.5)  # To change [-1, 1] to [0,1]\n",
        "image_class, class_confidence = get_mnist_label(improved_preds[i])\n",
        "plt.title('{} : {:.2f}% Confidence'.format(image_class, class_confidence*100))\n",
        "plt.show()\n"
      ],
      "metadata": {
        "id": "Dyj5CbQD7xoW",
        "outputId": "e70c4e4b-b7a4-4a56-9069-25957016c98d",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 499
        }
      },
      "execution_count": 17,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "<Figure size 576x576 with 1 Axes>"
            ],
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAdUAAAHiCAYAAAC+xlbiAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+WH4yJAAAbUUlEQVR4nO3de7ztdV3n8fdHOBwuAkEYAiIoYiM0iHpCHXRyxjR1SsRGRzKiojlUmvcmox7pWJn6SKNJs3BgJAdpDMVLmnnJsvKSB0TkYqIIAh25eOGiJRz4zh/rd3osTnvvs1m/7zl7r3Oez8djP/bev9/6rt93/1ic1/791lr7V621AADj3WelJwAAOwpRBYBORBUAOhFVAOhEVAGgE1EFgE5EFRilqvaoqvdV1S1V9WdV9dyq+tASt//rqvq57TlH2F5ElblVVc+pqiuq6ttV9eWqevyM9/MDVfWXVXVzVf2bN25X1f5VdcGwnWuq6ie2WP8Tw/JvV9W7q2r/JbZ1bFVdWFXfGT4fO7Wuquq1VfX14eO1VVXDun2HOX6rqs6tql2mxp1ZVc9cxs/5E1W1oapur6qNVfUXVfW45e6nJfzXJAcm+d7W2rNaa+e21p7c4X5h7ogqc6mqnpTktUl+JsneSf5jkqtmvLs7k7wjyamLrH9TkjsyCcdzk7y5qo4e5nF0kj9OcvKw/jtJ/nCROe+W5D1J/m+S/ZKck+Q9w/IkWZ/kGUkenuSYJD+W5LRh3WlJPjts4/AkJw73+dgkB7fW3rXUD1hVL0lyRpJXD/fxwGGeJyw1bpkOS/LF1tqmDvcF86215sPH3H0k+USSUzvf50Mm/0vcY9lemQT1oVPL3pbkNcPXr07y9ql1Rwy333uB+39ykuuT1NSyryZ5ytTPtH5q3alJPjV8/eYkPzJ8/Zok/yPJLkk+leTBW/m59k1ye5JnLXGbtZlE95+GjzOSrB3WPSHJdUlemuTGJBuT/Myw7n8OP++dwzZOTfLTSf5u6r6flOQLSW5J8sYkf5Pk56bW/2ySK5J8M8lfJjlsal1L8vNJrkzyrUx+wZnef/99GHtbksuTPHJYfnCSdya5KclXkrxgpR+zPnaOD0eqzJ3h1Oe6JPerqi9V1XVV9caq2mOR2z9wOG36wBk299Akm1prX5xa9rkkRw9fHz18nyRprX05Q4QXuK+jk1zSWps+xXzJYve1xXYuTfLDw8/4+CSXJXlBkr9orW3tCP2xSXZPcsESt/m1JI9JcmwmR8rHJfn1qfX3zyTOh2QSzjdV1X6ttVdk8ovF/2ut3be1dtb0nVbVAUneNdzXAUm+nOT4qfUnJDk9yTOT3C/J3yY5b4u5/WiSH8zk6P3ZSX5kGPusJK9M8lNJ9kny9CRfr6r7JHlfJvvvkCRPTPKiqvqRJX5+6EJUmUcHJlmTyXN5j88kBI/IPSPwr1prX22tfU9r7aszbOu+SW7dYtktmZxy3rz+liXWb3lfS912y/W3JLnv8LzqWZlE7dOZhOdzmZxyPqOq/qiqPl5Vv7XIz/C9SW5uS5+efW6SV7XWbmyt3ZTJEejJU+vvHNbf2Vr7QCZHpd+/xP1t9rQkl7XWzm+t3ZnJEfDXptb/fJLfaa1dMczv1UmOrarDpm7zmtbat4b/fh/L5L93kvxckte11j7TJr7UWrsmkwDfr7X2qtbaHcMvHW9J8pxlzBdGEVXm0T8Pn/+gtbaxtXZzkjdk8g94b7dnchQ0bZ9MTjcuZ/2Y+9onye1DMP6ltba+tXZMa+3lSX4vkyO852by//EPJXl0VT1lge1+PckBVbXrIj9jMjldes3U99cMy/71PraI8ncy+SVgaw5Ocu3mb4aj9Gun1h+W5PeHMwnfSvKNJJXJEeZm0xGe3u6hmRz5bumwJAdvvs/hfk/P5Jcx2KZElbnTWvtmJs/xTZ9G3VaXW/pikl2r6sipZQ/P5PRrhs8P37yiqh6cyfOT06eLM3XbYza/ondwzGL3tcV2/tUQzmqtfTDJv0+yYYjVhuH+tvTJJN/N5EVQi/mnTGK02QOHZWNtzCR+SSavcJ7+PpPAnjacSdj8sUdr7RPLuO9rM3kOe6HlX9niPvdurW2LX7rgHkSVefV/kvxSVX1fVe2X5MVJ/nyWOxreyrJ7kt2G73evqrVJ0lr7dibPCb6qqvaqquMzecXs24bh5yb5sap6fFXtleRVSd7VWlvoSPWvk9yV5AVVtbaqnj8s/6vh858keUlVHVJVB2fywqC3bjHX3TN5odKLhkVfSfKE4RXEx2eBV0C31m5J8huZPA/6jKras6rWVNVTq+p1w83OS/LrVXW/4XnQ38jkVcpjvT/J0VX1zOFI+QWZPD+72R8l+dWpV1PvOzxXuhz/O8nLqupRw3/Dhwynjf8hyW1V9Ss1eQ/tLsPbpn6ww88DSxJV5tVvJvlMJkeEV2TydpPfXuiGwwuVbl/ihUqHZXJKefNR4T8n+cep9b+YZI9MXvl6XpJfaK1dliTD55/PJK43ZvL86C9Obfsvqur04bZ3ZHK0+FOZvJL1Z5M8Y1ieTN6a874kn8/khUnvH5ZNOz3Jua2166bGHJDJq1yvyyIvRmqtvT7JSzJ53vmmTI7mnp/k3cNNfiuTI91Lhu1fNCwbZTg1/6xMfhH4epIjk/z91PoLMnlr1J9W1a2Z/NxPXeZ9/1km/83fnskp9Hcn2b+1dlcmL246NpNfOm7OJMD7jv15YGvqni9EBABm5UgVADoRVQDoRFQBoBNRBYBORBUAOlnqL6x0t1utbbtnr+25SQDo6rZ88+bW2v0WWrddo7p79sqj64nbc5MA0NVH2vnXLLbO6V8A6ERUAaCTUVGtqqdU1T8O17R8ea9JAcA8mjmqw4Wi35TJ3+k8KslJVXVUr4kBwLwZc6R6XJIvtdauGv4g+J9mcvUOANgpjYnqIbnnxYavyz0vLAwAO5Vt/paaqlqfZH2S7J49t/XmAGDFjDlSvT7JoVPfP2BYdg+ttTNba+taa+vWZO2IzQHA6jYmqp9JcmRVPaiqdkvynCTv7TMtAJg/M5/+ba1tqqrnJ/nLJLskObu1dlm3mQHAnBn1nGpr7QNJPtBpLgAw1/xFJQDoRFQBoBNRBYBORBUAOhFVAOhEVAGgE1EFgE5EFQA6EVUA6ERUAaATUQWATkQVADoRVQDoRFQBoBNRBYBORBUAOhFVAOhEVAGgE1EFgE5EFQA6EVUA6ERUAaATUQWATkQVADoRVQDoRFQBoBNRBYBORBUAOhFVAOhEVAGgE1EFgE5EFQA6EVUA6ERUAaATUQWATkQVADoRVQDoRFQBoBNRBYBORBUAOhFVAOhEVAGgE1EFgE5EFQA6EVUA6ERUAaATUQWATkQVADoRVQDoRFQBoBNRBYBORBUAOhFVAOhEVAGgE1EFgE5EFQA6EVUA6ERUAaATUQWATkQVADoRVQDoRFQBoBNRBYBORBUAOhFVAOhk15WeAKxGtXbt7IOPesiobW98xd0zj/3cceeN2vZYZ3zz8JnHvu33nzpq2we85VOzD25t1LZhM0eqANCJqAJAJ6IKAJ2Mek61qq5OcluSu5Jsaq2t6zEpAJhHPV6o9J9aazd3uB8AmGtO/wJAJ2Oj2pJ8qKourKr1C92gqtZX1Yaq2nBnvjtycwCweo09/fu41tr1VfV9ST5cVV9orX18+gattTOTnJkk+9T+3gwGwA5r1JFqa+364fONSS5IclyPSQHAPJo5qlW1V1XtvfnrJE9OcmmviQHAvBlz+vfAJBdU1eb7eXtr7YNdZgUAc2jmqLbWrkry8I5zAYC55i01ANCJqAJAJ9W24yWP9qn926Pridtte+y87rP33qPGr/nzvWYe+86HvH/UtpnN0//LyTOPvfviyzvOhB3dR9r5Fy72Z3kdqQJAJ6IKAJ2IKgB0IqoA0ImoAkAnogoAnYgqAHQiqgDQiagCQCeiCgCdiCoAdCKqANCJqAJAJ6IKAJ2IKgB0sutKTwAWc59j/t3MY096x0dGbfukvW8YNZ7t78u/smbmsQ86qeNE2Kk5UgWATkQVADoRVQDoRFQBoBNRBYBORBUAOhFVAOhEVAGgE1EFgE5EFQA6EVUA6ERUAaATUQWATkQVADpx6TeWVGt2m3nstS9bN2rbv3zK+TOP3Vkv3fbif/oPo8Z/8MqHjRp/xQ+dNWr8GHvsccfMY2vXcf8Utk2bRo1nx+FIFQA6EVUA6ERUAaATUQWATkQVADoRVQDoRFQBoBNRBYBORBUAOhFVAOhEVAGgE1EFgE5EFQA6EVUA6ERUAaAT11PdwY25HmqSXPWbj5p57GUn/8Gobc+rl3/tB0eN/9B5j5l57AP/7NpR297zx/ccNT4/NG74GI+8/3Uzj71hz3E/91233jpqPDsOR6oA0ImoAkAnogoAnYgqAHQiqgDQiagCQCeiCgCdiCoAdCKqANCJqAJAJ6IKAJ2IKgB0IqoA0ImoAkAnLv22g9vl0INHjb/s5Dd2msl8eej7fmHmsUe97sZR2z74qk/MPHbTqC0nJ55y1ch7WDl//5UHzzz2Qbd+ruNM2Jk5UgWATkQVADoRVQDoZKtRraqzq+rGqrp0atn+VfXhqrpy+Lzftp0mAKx+yzlSfWuSp2yx7OVJPtpaOzLJR4fvAWCnttWottY+nuQbWyw+Ick5w9fnJHlG53kBwNyZ9TnVA1trG4evv5bkwE7zAYC5NfqFSq21lqQttr6q1lfVhqracGe+O3ZzALBqzRrVG6rqoCQZPi/6bvfW2pmttXWttXVrsnbGzQHA6jdrVN+b5JTh61OSvKfPdABgfi3nLTXnJflkku+vquuq6tQkr0nypKq6MskPD98DwE5tq3/7t7V20iKrnth5LgAw1/xFJQDoRFQBoBNRBYBOXE91B3f3TV8fNf6R/3DyzGPPfcTZo7Z91Z0HzDz2Ze/5yVHbPuoPvzbz2E1XXT1q22Pc9pzHjBr/4/ueMXIGa0aOh/nmSBUAOhFVAOhEVAGgE1EFgE5EFQA6EVUA6ERUAaATUQWATkQVADoRVQDoRFQBoBNRBYBORBUAOhFVAOjEpd92cHffdtuo8QefePnMY1/8n583attrr/3mzGOPuPJTo7a9adTocXY54HtnHnvCr3101LYftmblLt12yR13jRp/4Dt27zQTmJ0jVQDoRFQBoBNRBYBORBUAOhFVAOhEVAGgE1EFgE5EFQA6EVUA6ERUAaATUQWATkQVADoRVQDoRFQBoBNRBYBOXE+VbWbXv7pw1PhxV9dcOe34Y0eNf9j/umTmsS/Z/wujtr2SnvX+Xxo1/sgLPt1pJjA7R6oA0ImoAkAnogoAnYgqAHQiqgDQiagCQCeiCgCdiCoAdCKqANCJqAJAJ6IKAJ2IKgB0IqoA0ImoAkAnLv0GnX3leePGv//+n+kzkTlz8F+v9AxgPEeqANCJqAJAJ6IKAJ2IKgB0IqoA0ImoAkAnogoAnYgqAHQiqgDQiagCQCeiCgCdiCoAdCKqANCJqAJAJ6IKAJ24niqwKrz6dX88avxrNzx95rGbrv7qqG3DZo5UAaATUQWATkQVADrZalSr6uyqurGqLp1a9sqqur6qLh4+nrZtpwkAq99yjlTfmuQpCyz/vdbascPHB/pOCwDmz1aj2lr7eJJvbIe5AMBcG/Oc6vOr6pLh9PB+3WYEAHNq1qi+OckRSY5NsjHJ6xe7YVWtr6oNVbXhznx3xs0BwOo3U1Rbaze01u5qrd2d5C1Jjlvitme21ta11tatydpZ5wkAq95MUa2qg6a+PTHJpYvdFgB2Flv9M4VVdV6SJyQ5oKquS/KKJE+oqmOTtCRXJzltG84RAObCVqPaWjtpgcVnbYO5AMBc8xeVAKATUQWATkQVADpxPVXo7EFvbKPGX/LYu2Yee8xuu4za9kp67NrZf+4k+cILD5557ENe7Hqq9OFIFQA6EVUA6ERUAaATUQWATkQVADoRVQDoRFQBoBNRBYBORBUAOhFVAOhEVAGgE1EFgE5EFQA6EVUA6MSl36Cz+sTnRo3/tWf+zMxjbzpun1Hb/pNffcOo8Q9ds9uo8WPscv9/XrFtw2aOVAGgE1EFgE5EFQA6EVUA6ERUAaATUQWATkQVADoRVQDoRFQBoBNRBYBORBUAOhFVAOhEVAGgE1EFgE5EFQA6cT1VWGXaZy+beewBnx237f/2PS8dNf6zL/iDcRMY4fzH/vHMY3/1AT8+atubrrt+1Hh2HI5UAaATUQWATkQVADoRVQDoRFQBoBNRBYBORBUAOhFVAOhEVAGgE1EFgE5EFQA6EVUA6ERUAaATUQWATlz6jW3mX370uFHjv3XE7A/PQz5006ht33XFlaPGz6s9bmorPYWZPWzNmtkHr/FPIX04UgWATkQVADoRVQDoRFQBoBNRBYBORBUAOhFVAOhEVAGgE1EFgE5EFQA6EVUA6ERUAaATUQWATkQVADoRVQDoxEUEWdIuDz1i5rFvfdMbRm37AbvuMfPYC184atM56YO/MPPY7/vkLqO2/T1v++So8WN845j5vZ7qmbccPvPYdvt3+k2EnZojVQDoRFQBoBNRBYBOthrVqjq0qj5WVZdX1WVV9cJh+f5V9eGqunL4vN+2ny4ArF7LOVLdlOSlrbWjkjwmyfOq6qgkL0/y0dbakUk+OnwPADutrUa1tbaxtXbR8PVtSa5IckiSE5KcM9zsnCTP2FaTBIB5cK/eUlNVhyd5RJJPJzmwtbZxWPW1JAcuMmZ9kvVJsnv2nHWeALDqLfuFSlV13yTvTPKi1tqt0+taay3Jgm9wa62d2Vpb11pbtyZrR00WAFazZUW1qtZkEtRzW2vvGhbfUFUHDesPSnLjtpkiAMyH5bz6t5KcleSK1tr0n8h5b5JThq9PSfKe/tMDgPmxnOdUj09ycpLPV9XFw7LTk7wmyTuq6tQk1yR59raZIgDMh61GtbX2d0lqkdVP7DsdAJhf/qISAHQiqgDQSU3eDbN97FP7t0eXM8bb0y0/+ZhR48941ZtmHvuonfQdVLfc/S+jxl96x96dZnLvPWLtt0eN37N26zSTe+/oj//szGMfdNLnOs6EHd1H2vkXttbWLbTOkSoAdCKqANCJqAJAJ6IKAJ2IKgB0IqoA0ImoAkAnogoAnYgqAHQiqgDQiagCQCeiCgCdiCoAdCKqANCJqAJAJ7uu9ATYtjbtUaPGv+yXf3HmsXt/+bZR2z7h7X8z89hT9/3qqG2Pse99dh81/vjd7+w0k1ms3PVQx1p70V4rPQVwpAoAvYgqAHQiqgDQiagCQCeiCgCdiCoAdCKqANCJqAJAJ6IKAJ2IKgB0IqoA0ImoAkAnogoAnYgqAHRSrbXttrF9av/26Hridtse8+0+e81+Ka/rT3v4qG2/bP07Zh570t43jNr2zurhf/hLo8Yf+jufnn3w3XeN2jY7l4+08y9sra1baJ0jVQDoRFQBoBNRBYBORBUAOhFVAOhEVAGgE1EFgE5EFQA6EVUA6ERUAaATUQWATkQVADoRVQDoRFQBoBNRBYBOXE8VFlBrdpt97NEPGbXt614x+9iLjnvbqG2fecvho8a//+kLXmJyWe768tWjtp3t+G8ZOzfXUwWA7UBUAaATUQWATkQVADoRVQDoRFQBoBNRBYBORBUAOhFVAOhEVAGgE1EFgE5EFQA6EVUA6ERUAaCTXVd6ArAatTvvmH3sxZeP2vbBJ84+9kfzqFHbHu8rK7x9WFmOVAGgE1EFgE5EFQA62WpUq+rQqvpYVV1eVZdV1QuH5a+squur6uLh42nbfroAsHot54VKm5K8tLV2UVXtneTCqvrwsO73Wmu/u+2mBwDzY6tRba1tTLJx+Pq2qroiySHbemIAMG/u1XOqVXV4kkck+fSw6PlVdUlVnV1V+3WeGwDMlWVHtarum+SdSV7UWrs1yZuTHJHk2EyOZF+/yLj1VbWhqjbcme92mDIArE7LimpVrckkqOe21t6VJK21G1prd7XW7k7yliTHLTS2tXZma21da23dmqztNW8AWHWW8+rfSnJWkitaa2+YWn7Q1M1OTHJp/+kBwPxYzqt/j09ycpLPV9XFw7LTk5xUVccmaUmuTnLaNpkhAMyJ5bz69++S1AKrPtB/OgAwv/xFJQDoRFQBoBNRBYBORBUAOhFVAOhEVAGgE1EFgE5EFQA6EVUA6ERUAaATUQWATkQVADoRVQDoRFQBoBNRBYBORBUAOhFVAOhEVAGgE1EFgE5EFQA6EVUA6ERUAaATUQWATkQVADoRVQDoRFQBoBNRBYBORBUAOhFVAOhEVAGgE1EFgE5EFQA6EVUA6ERUAaCTaq1tv41V3ZTkmiVuckCSm7fTdHYU9tls7LfZ2G/3nn02m9W83w5rrd1voRXbNapbU1UbWmvrVnoe88Q+m439Nhv77d6zz2Yzr/vN6V8A6ERUAaCT1RbVM1d6AnPIPpuN/TYb++3es89mM5f7bVU9pwoA82y1HakCwNxaFVGtqqdU1T9W1Zeq6uUrPZ95UVVXV9Xnq+riqtqw0vNZrarq7Kq6saounVq2f1V9uKquHD7vt5JzXG0W2WevrKrrh8fbxVX1tJWc42pUVYdW1ceq6vKquqyqXjgs93hbxBL7bC4fbyt++reqdknyxSRPSnJdks8kOam1dvmKTmwOVNXVSda11lbre7lWhar6j0luT/InrbUfGJa9Lsk3WmuvGX6R26+19isrOc/VZJF99sokt7fWfncl57aaVdVBSQ5qrV1UVXsnuTDJM5L8dDzeFrTEPnt25vDxthqOVI9L8qXW2lWttTuS/GmSE1Z4TuxAWmsfT/KNLRafkOSc4etzMvmfmMEi+4ytaK1tbK1dNHx9W5IrkhwSj7dFLbHP5tJqiOohSa6d+v66zPEO3c5akg9V1YVVtX6lJzNnDmytbRy+/lqSA1dyMnPk+VV1yXB62CnMJVTV4UkekeTT8Xhbli32WTKHj7fVEFVm97jW2iOTPDXJ84ZTdtxLbfIciJfBb92bkxyR5NgkG5O8fmWns3pV1X2TvDPJi1prt06v83hb2AL7bC4fb6shqtcnOXTq+wcMy9iK1tr1w+cbk1yQyal0lueG4bmczc/p3LjC81n1Wms3tNbuaq3dneQt8XhbUFWtySQO57bW3jUs9nhbwkL7bF4fb6shqp9JcmRVPaiqdkvynCTvXeE5rXpVtdfwpH6qaq8kT05y6dKjmPLeJKcMX5+S5D0rOJe5sDkKgxPj8fZvVFUlOSvJFa21N0yt8nhbxGL7bF4fbyv+6t8kGV4qfUaSXZKc3Vr77RWe0qpXVQ/O5Og0SXZN8nb7bWFVdV6SJ2Ry1YsbkrwiybuTvCPJAzO5ctKzW2temDNYZJ89IZNTcS3J1UlOm3qekCRV9bgkf5vk80nuHhafnslzhB5vC1hin52UOXy8rYqoAsCOYDWc/gWAHYKoAkAnogoAnYgqAHQiqgDQiagCQCeiCgCdiCoAdPL/AfhMoG78PEwqAAAAAElFTkSuQmCC\n"
          },
          "metadata": {
            "needs_background": "light"
          }
        }
      ]
    }
  ],
  "metadata": {
    "colab": {
      "name": "Copy of MNIST_Train_Task1.ipynb",
      "provenance": [],
      "collapsed_sections": [],
      "toc_visible": true,
      "include_colab_link": true
    },
    "kernelspec": {
      "display_name": "Python 3",
      "name": "python3"
    },
    "language_info": {
      "name": "python"
    },
    "accelerator": "GPU"
  },
  "nbformat": 4,
  "nbformat_minor": 0
}