Twelve_Labs_API_Sports_Demo.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "oT_AjsAurpIR"
      },
      "source": [
        "Twelve Labs Video Understanding Platform, currently in beta, offers an API suite for integrating a state-of-the-art (“SOTA”) foundation model that understands contextual information from your videos, making it accessible to your applications. The API is organized around REST and is compatible with most programming languages. You can also use Postman or other REST clients to send requests and view responses.\n",
        "\n",
        "The following diagram illustrates the architecture of the Twelve Labs Video Understanding Platform and how different parts interact:\n",
        "\n",
        "![](https://files.readme.io/5fb7a80-image.png)\n",
        "\n",
        "## 1 - Setup and Requirements\n",
        "The Twelve Labs Video Understanding API is currently in open beta. Before you begin, [sign up](https://api.twelvelabs.io) for a free account, or if you already have one, [sign in](https://api.twelvelabs.io).\n",
        "\n",
        "You will receive a signup code that you can use to create an account. Once you have created an account, you can access the API Dashboard.\n",
        "\n",
        "This demo will use an existing account. To make calls to the API, you need your secret key and specify the URL of the API. You can use environment variables to pass configuration to your application."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "ydgqdioXpkq1",
        "outputId": "9771ad8a-74d8-48ea-c9d6-dc371a30e87f"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "env: API_KEY=tlk_2K9E0BB2W5TJY227437G62VR1617\n",
            "env: API_URL=https://api.twelvelabs.io/p/v1.2\n"
          ]
        }
      ],
      "source": [
        "# Specify the API key and the URL of the API\n",
        "%env API_KEY=tlk_0BKG1ZQ08FCHV92X59YZG3NR7T1Q\n",
        "%env API_URL=https://api.twelvelabs.io/p/v1.2"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "31isfodVuYPx"
      },
      "source": [
        "The next step is to install the required package."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "RpJCQ42RuxFF",
        "outputId": "91f627e0-b68f-4eb4-e16f-3e482cf522a6"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (2.31.0)\n",
            "Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests) (3.3.0)\n",
            "Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests) (3.4)\n",
            "Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests) (2.0.6)\n",
            "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests) (2023.7.22)\n"
          ]
        }
      ],
      "source": [
        "!pip install requests"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "XgLXWW74u59S"
      },
      "source": [
        "You want to import the required Python packages and retrieve the API key as well as the API URL."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 2,
      "metadata": {
        "id": "GW9vRq7NuycH"
      },
      "outputs": [],
      "source": [
        "# Import the required packages\n",
        "import requests\n",
        "import glob\n",
        "from pprint import pprint\n",
        "import os"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "jpAEIBMavBZv"
      },
      "outputs": [],
      "source": [
        "# Retrieve the URL of the API and my API key\n",
        "API_URL = os.getenv(\"API_URL\")\n",
        "assert API_URL\n",
        "\n",
        "API_KEY = os.getenv(\"API_KEY\")\n",
        "assert API_KEY"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "zUkH6-QZuZ6Y"
      },
      "source": [
        "## 2 - Index API\n",
        "The next step is to [create a video index](https://docs.twelvelabs.io/v1.2/docs/create-indexes). An index groups one or more video vectors and is the most granular level at which you can perform a search."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "dHHc7mOEvaUS"
      },
      "source": [
        "### 2.1 - Create An Index\n",
        "An index is a basic unit to organize and store your video data (video embeddings and metadata) to facilitate information retrieval and processing.\n",
        "\n",
        "You can use indexes to group related videos. For example, if you want to upload multiple videos from a car race, Twelve Labs recommends you create a single index and upload all the videos to it. Then, to find a specific moment in that race, you call the /search endpoint once, passing it the unique identifier of the index.\n",
        "\n",
        "When creating a new index, you must specify the following information:\n",
        "\n",
        "*   **Name**: Use a brief and descriptive name to facilitate future reference and management.\n",
        "*   **Engine configuration**: Provide a list containing the [video understanding engines](https://docs.twelvelabs.io/v1.2/docs/video-understanding-engines) and the associated [engine options](https://docs.twelvelabs.io/v1.2/docs/indexing-options) you want to enable.\n",
        "\n",
        "#### Video Understanding Engines\n",
        "Twelve Labs' video understanding engines consist of a family of deep neural networks built on our multimodal foundation model for video understanding that you can use for the following downstream tasks:\n",
        "\n",
        "*   Search using natural language queries\n",
        "*   Zero-shot classification\n",
        "*   Generate concise textual representations\n",
        "\n",
        "Twelve Labs provides two distinct engine types - embedding and generative, each serving unique purposes in multimodal video understanding.\n",
        "*   **Embedding engines**: These engines are proficient at performing tasks such as search and classification, enabling enhanced video understanding. We recommend choosing Marengo2.5.\n",
        "*   **Generative engines**: These engines specialize in generating concise textual representations for video. We recommend choosing Pegasus1.0.\n",
        "\n",
        "#### Engine Options\n",
        "\n",
        "Engine options indicate the types of information a video understanding engine will process. When creating a new index, you must specify the engines and the associated engines options that you want to enable.\n",
        "\n",
        "The following engine options are available:\n",
        "\n",
        "*   **visual**: This option allows you to analyze video content as you would see and hear from it, including actions, objects, sounds, and events, and excluding human speech.\n",
        "*   **conversation**: This option allows you to analyze human speech within your videos.\n",
        "*   **text_in_video**: This option allows you to detect and extract text (OCR) shown within your videos.\n",
        "*   **logo**: This option allows you to identify the presence of brand logos within your videos."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "ZSmhDwX-wtUR",
        "outputId": "e524812d-37ed-4194-b823-a8a643f29632"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Status code: 201\n",
            "{'_id': '6526d94f23c1347ffbe3a1fa'}\n"
          ]
        }
      ],
      "source": [
        "# Construct the URL of the `/indexes` endpoint\n",
        "INDEXES_URL = f\"{API_URL}/indexes\"\n",
        "\n",
        "# Specify the name of the index\n",
        "INDEX_NAME = \"Sports Videos\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named data\n",
        "data = {\n",
        "  \"engines\": [\n",
        "    {\n",
        "      \"engine_name\": \"marengo2.5\",  # Configure the video understanding engine\n",
        "      \"engine_options\": [\"visual\", \"conversation\", \"text_in_video\", \"logo\"]  # Specify the engine options\n",
        "    },\n",
        "    {\n",
        "      \"engine_name\": \"pegasus1\",  # Configure the video understanding engine\n",
        "      \"engine_options\": [\"visual\", \"conversation\"]  # Specify the engine options\n",
        "    }\n",
        "  ],\n",
        "  \"index_name\": INDEX_NAME,\n",
        "  \"addons\": [\"thumbnail\"]  # Enable the thumbnail generation feature\n",
        "}\n",
        "\n",
        "# Create an index\n",
        "response = requests.post(INDEXES_URL, headers=headers, json=data)\n",
        "\n",
        "# Store the unique identifier of your index\n",
        "INDEX_ID = response.json().get('_id')\n",
        "\n",
        "# Print the status code and response\n",
        "print(f'Status code: {response.status_code}')\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "cgGpRwEMyeQ6"
      },
      "source": [
        "### 2.2 - Upload A Video\n",
        "Once you've created an index, you can upload a video. When the video has finished uploading, the API service will automatically create a rich set of vectors containing all the information it needs to perform fast, semantic, accurate, and scalable searches.\n",
        "\n",
        "For this demo, we will work with sports videos. The video resolution must be greater or equal than 360p and less or equal than 4K.\n",
        "\n",
        "Below, we show how to upload a video file from YouTube: [US Open 2009: Roger Federer's Incredible Between the Legs Shot against Novak Djokovic HD](https://www.youtube.com/watch?v=DXB4MApF4Lo)\n",
        "\n",
        "The API service will retrieve the file directly from the specified URL, so your application doesn't have to store the video locally and upload the bytes. Our platform currently supports only YouTube as an external provider, but we will add support for additional providers in the future."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "D3ob1vEEbdGV",
        "outputId": "b7216335-99e7-4a5a-fe9c-177d4b8a9efc"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Status code: 201\n",
            "{'_id': '6526db2823c1347ffbe3a1fc'}\n"
          ]
        }
      ],
      "source": [
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare the /tasks/external-provider endpoint\n",
        "TASKS_URL = f\"{API_URL}/tasks/external-provider\"\n",
        "\n",
        "# Construct the body of the request\n",
        "data = {\n",
        "    \"index_id\": INDEX_ID,  # Specify the unique ID of the index\n",
        "    \"url\": \"https://www.youtube.com/watch?v=DXB4MApF4Lo\",  # Specify the YouTube URL of the video\n",
        "}\n",
        "\n",
        "# Upload the video\n",
        "response = requests.post(TASKS_URL, headers=headers, json=data)\n",
        "\n",
        "# Store the ID of the task in a variable named TASK_ID\n",
        "TASK_ID = response.json().get(\"_id\")\n",
        "\n",
        "# Print the status code and response\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "n7kjB-kq3d5C"
      },
      "source": [
        "The API service must have finished indexing the video before it becomes searchable. You can use the `GET` method of the `/tasks/{_id}` endpoint to monitor the indexing process. Construct the URL for monitoring the indexing process based on the `TASK_ID` variable you’ve declared in the previous step, and wait until the status shows as `ready`:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "background_save": true,
          "base_uri": "https://localhost:8080/"
        },
        "id": "cYuL6V3L3b-T",
        "outputId": "54fdddd9-62c8-4d08-e567-0b4c3d0ce125"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Start uploading video\n",
            "Status code: ready\n",
            "Finish uploading video\n",
            "Time elapsed (in seconds):  12471.153064250946\n"
          ]
        }
      ],
      "source": [
        "import time\n",
        "\n",
        "# Define starting time\n",
        "start = time.time()\n",
        "print(\"Start uploading video\")\n",
        "\n",
        "# Monitor the indexing process\n",
        "TASK_STATUS_URL = f\"{API_URL}/tasks/{TASK_ID}\"\n",
        "while True:\n",
        "    response = requests.get(TASK_STATUS_URL, headers=headers)\n",
        "    STATUS = response.json().get(\"status\")\n",
        "    if STATUS == \"ready\":\n",
        "        print(f\"Status code: {STATUS}\")\n",
        "        break\n",
        "    time.sleep(10)\n",
        "\n",
        "# Define ending time\n",
        "end = time.time()\n",
        "print(\"Finish uploading video\")\n",
        "print(\"Time elapsed (in seconds): \", end - start)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "background_save": true
        },
        "id": "xdZsX_Fh5Fcq",
        "outputId": "45a4587d-c8b1-495c-eef9-ece2bff3868d"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "VIDEO ID: 6526db3043e8c47e4eb47c94\n",
            "{'_id': '6526db2823c1347ffbe3a1fc',\n",
            " 'created_at': '2023-10-11T17:28:08.887Z',\n",
            " 'estimated_time': '2023-10-11T20:50:40.144Z',\n",
            " 'hls': {'status': 'COMPLETE',\n",
            "         'thumbnail_urls': ['https://deuqpmn4rs7j5.cloudfront.net/63f9601b8e079b9c96f4a52e/6526db2823c1347ffbe3a1fc/thumbnails/cf2b1b3f-1bf6-4fda-b1dd-d50209533739.0000001.jpg'],\n",
            "         'updated_at': '2023-10-11T17:28:52.732Z',\n",
            "         'video_url': 'https://deuqpmn4rs7j5.cloudfront.net/63f9601b8e079b9c96f4a52e/6526db2823c1347ffbe3a1fc/stream/cf2b1b3f-1bf6-4fda-b1dd-d50209533739.m3u8'},\n",
            " 'index_id': '6526d94f23c1347ffbe3a1fa',\n",
            " 'metadata': {'duration': 74,\n",
            "              'filename': \"US Open 2009: Roger Federer's Incredible Between \"\n",
            "                          'the Legs Shot against Novak Djokovic HD',\n",
            "              'height': 720,\n",
            "              'width': 1280},\n",
            " 'status': 'ready',\n",
            " 'type': 'index_task_info',\n",
            " 'updated_at': '2023-10-11T20:56:17.814Z',\n",
            " 'video_id': '6526db3043e8c47e4eb47c94'}\n"
          ]
        }
      ],
      "source": [
        "# Retrieve the unique identifier of the video\n",
        "VIDEO_ID = response.json().get('video_id')\n",
        "\n",
        "# Print the status code, the unique identifier of the video, and the response\n",
        "print(f\"VIDEO ID: {VIDEO_ID}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "Note that the 1.2 version of the API is in beta, and videos can take longer to upload and process when using the Pegasus video understanding engine.\n",
        "\n",
        "For the purpose of this demo, let's use a sample account with sample indexes that has been preloaded with videos. These indexes have been processed with both the Marengo 2.5 and the Pegasus 1.0 engines"
      ],
      "metadata": {
        "id": "8oq0w8AuQraT"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "# Specify the API key and the API URL of the sample account\n",
        "%env API_KEY=tlk_2K9E0BB2W5TJY227437G62VR1617\n",
        "%env API_URL=https://api.twelvelabs.io/v1.2"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "JmbZ6gxwRVDt",
        "outputId": "349b2dad-75f3-4f9f-a8ae-67210d614985"
      },
      "execution_count": 3,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "env: API_KEY=tlk_2K9E0BB2W5TJY227437G62VR1617\n",
            "env: API_URL=https://api.twelvelabs.io/v1.2\n"
          ]
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "# Retrieve the new API URL and the new API key\n",
        "API_URL = os.getenv(\"API_URL\")\n",
        "assert API_URL\n",
        "\n",
        "API_KEY = os.getenv(\"API_KEY\")\n",
        "assert API_KEY"
      ],
      "metadata": {
        "id": "CiVOMfRFRdAM"
      },
      "execution_count": 4,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "tm6cSWWruuc-"
      },
      "source": [
        "### 2.3 - List Indexes\n",
        "Let's return a list of the indexes in this sample account. The API returns indexes sorted by creation date, with the oldest indexes at the top of the list."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 5,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "oqzlUiGTu6E1",
        "outputId": "04441c6f-856f-48c2-9f93-93e01c726731"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': [{'_id': '64373b0cc1cb7a672614563e',\n",
            "           'addons': ['thumbnail'],\n",
            "           'created_at': '2023-04-12T23:13:16.365Z',\n",
            "           'engines': [{'engine_name': 'marengo2.5',\n",
            "                        'engine_options': ['visual',\n",
            "                                           'conversation',\n",
            "                                           'text_in_video',\n",
            "                                           'logo']}],\n",
            "           'expires_at': None,\n",
            "           'index_name': 'Some videos for starters 😁',\n",
            "           'total_duration': 35194.141905,\n",
            "           'updated_at': '2023-05-04T06:58:51.026Z',\n",
            "           'video_count': 178},\n",
            "          {'_id': '652793eb23c1347ffbe3a398',\n",
            "           'addons': ['thumbnail'],\n",
            "           'created_at': '2023-10-12T06:36:27.542Z',\n",
            "           'engines': [{'engine_name': 'marengo2.5',\n",
            "                        'engine_options': ['visual',\n",
            "                                           'conversation',\n",
            "                                           'text_in_video']},\n",
            "                       {'engine_name': 'pegasus1',\n",
            "                        'engine_options': ['visual', 'conversation']}],\n",
            "           'expires_at': '2024-01-10T06:36:27.542Z',\n",
            "           'index_name': 'Ads',\n",
            "           'total_duration': 3247,\n",
            "           'updated_at': '2023-10-12T11:11:27.733Z',\n",
            "           'video_count': 33},\n",
            "          {'_id': '6527d89074b5a5ab84015cca',\n",
            "           'addons': ['thumbnail'],\n",
            "           'created_at': '2023-10-12T11:29:20.055Z',\n",
            "           'engines': [{'engine_name': 'pegasus1',\n",
            "                        'engine_options': ['visual', 'conversation']},\n",
            "                       {'engine_name': 'marengo2.5',\n",
            "                        'engine_options': ['visual',\n",
            "                                           'conversation',\n",
            "                                           'text_in_video',\n",
            "                                           'logo']}],\n",
            "           'expires_at': '2024-01-10T11:29:20.055Z',\n",
            "           'index_name': 'Security',\n",
            "           'total_duration': 4648,\n",
            "           'updated_at': '2023-10-12T12:23:56.326Z',\n",
            "           'video_count': 26},\n",
            "          {'_id': '6527e0ab74b5a5ab84015ce2',\n",
            "           'addons': ['thumbnail'],\n",
            "           'created_at': '2023-10-12T12:03:55.772Z',\n",
            "           'engines': [{'engine_name': 'marengo2.5',\n",
            "                        'engine_options': ['visual',\n",
            "                                           'conversation',\n",
            "                                           'text_in_video',\n",
            "                                           'logo']},\n",
            "                       {'engine_name': 'pegasus1',\n",
            "                        'engine_options': ['visual', 'conversation']}],\n",
            "           'expires_at': '2024-01-10T12:03:55.772Z',\n",
            "           'index_name': 'Sports',\n",
            "           'total_duration': 11497,\n",
            "           'updated_at': '2023-10-13T02:24:18.089Z',\n",
            "           'video_count': 24},\n",
            "          {'_id': '6527e59e74b5a5ab84015cf5',\n",
            "           'addons': ['thumbnail'],\n",
            "           'created_at': '2023-10-12T12:25:02.918Z',\n",
            "           'engines': [{'engine_name': 'pegasus1',\n",
            "                        'engine_options': ['visual', 'conversation']},\n",
            "                       {'engine_name': 'marengo2.5',\n",
            "                        'engine_options': ['visual',\n",
            "                                           'conversation',\n",
            "                                           'text_in_video',\n",
            "                                           'logo']}],\n",
            "           'expires_at': '2024-01-10T12:25:02.918Z',\n",
            "           'index_name': 'E-learning',\n",
            "           'total_duration': 12287,\n",
            "           'updated_at': '2023-10-13T02:18:33.721Z',\n",
            "           'video_count': 28},\n",
            "          {'_id': '6528aaad8f9cd95a98cbcfd2',\n",
            "           'addons': ['thumbnail'],\n",
            "           'created_at': '2023-10-13T02:25:49.174Z',\n",
            "           'engines': [{'engine_name': 'marengo2.5',\n",
            "                        'engine_options': ['visual',\n",
            "                                           'conversation',\n",
            "                                           'text_in_video',\n",
            "                                           'logo']},\n",
            "                       {'engine_name': 'pegasus1',\n",
            "                        'engine_options': ['visual', 'conversation']}],\n",
            "           'expires_at': '2024-01-11T02:25:49.174Z',\n",
            "           'index_name': 'Content Creator',\n",
            "           'total_duration': 14566,\n",
            "           'updated_at': '2023-10-13T08:21:16.371Z',\n",
            "           'video_count': 21}],\n",
            " 'page_info': {'limit_per_page': 10,\n",
            "               'page': 1,\n",
            "               'total_page': 1,\n",
            "               'total_results': 6}}\n"
          ]
        }
      ],
      "source": [
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY,\n",
        "    \"Content-Type\": \"application/json\"\n",
        "}\n",
        "\n",
        "# List indexes\n",
        "url = f\"{API_URL}/indexes?page=1&page_limit=10&sort_by=created_at&sort_option=asc\"\n",
        "\n",
        "response = requests.get(url, headers=headers)\n",
        "print(f'Status code: {response.status_code}')\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "For this demo, let's go with Sports videos."
      ],
      "metadata": {
        "id": "r0BQTnrESgNy"
      }
    },
    {
      "cell_type": "code",
      "execution_count": 6,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "HSlZg-S_84cX",
        "outputId": "5b7aaae0-ac92-40bb-a457-c0b8eecda5c0"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "env: INDEX_ID=6527e0ab74b5a5ab84015ce2\n"
          ]
        }
      ],
      "source": [
        "# Specify the unique identifier of the \"Sports\" existing index\n",
        "%env INDEX_ID=6527e0ab74b5a5ab84015ce2"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "SMR6AnEh8tob"
      },
      "source": [
        "### 2.4 - List Videos In An Index\n",
        "Let's list all the videos in this \"Sports\" index for verification."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 7,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "jYGhUdm19FAM",
        "outputId": "7c4cd27b-ab59-4dc8-839b-c6aea0a47963"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "6527e0ab74b5a5ab84015ce2\n",
            "Status code: 200\n",
            "{'data': [{'_id': '6528aa5243e8c47e4eb47e66',\n",
            "           'created_at': '2023-10-13T02:24:00Z',\n",
            "           'metadata': {'duration': 859,\n",
            "                        'engine_ids': ['marengo2.5', 'pegasus1'],\n",
            "                        'filename': 'USA 🇺🇸 vs Germany 🇩🇪 | Full Game '\n",
            "                                    'Highlights | FIBA Basketball World Cup '\n",
            "                                    '2023',\n",
            "                        'fps': 25,\n",
            "                        'height': 720,\n",
            "                        'size': 277128958,\n",
            "                        'vispresso_index_id': '6527e0ab73878b24f9377742',\n",
            "                        'width': 1280},\n",
            "           'updated_at': '2023-10-13T02:24:18Z'},\n",
            "          {'_id': '6528aa4743e8c47e4eb47e65',\n",
            "           'created_at': '2023-10-13T02:23:40Z',\n",
            "           'metadata': {'duration': 969,\n",
            "                        'engine_ids': ['marengo2.5', 'pegasus1'],\n",
            "                        'filename': 'Funniest Moments From the 2022-23 NBA '\n",
            "                                    'Season',\n",
            "                        'fps': 30,\n",
            "                        'height': 720,\n",
            "                        'size': 269315890,\n",
            "                        'vispresso_index_id': '6527e0ab73878b24f9377742',\n",
            "                        'width': 1280},\n",
            "           'updated_at': '2023-10-13T02:24:07Z'},\n",
            "          {'_id': '6528aa1443e8c47e4eb47e64',\n",
            "           'created_at': '2023-10-13T02:23:01Z',\n",
            "           'metadata': {'duration': 1277,\n",
            "                        'engine_ids': ['marengo2.5', 'pegasus1'],\n",
            "                        'filename': 'Super Bowl LV | NFL Films Presents',\n",
            "                        'fps': 30,\n",
            "                        'height': 720,\n",
            "                        'size': 196467410,\n",
            "                        'vispresso_index_id': '6527e0ab73878b24f9377742',\n",
            "                        'width': 1280},\n",
            "           'updated_at': '2023-10-13T02:23:16Z'},\n",
            "          {'_id': '6528aa0a43e8c47e4eb47e63',\n",
            "           'created_at': '2023-10-13T02:22:54Z',\n",
            "           'metadata': {'duration': 692,\n",
            "                        'engine_ids': ['marengo2.5', 'pegasus1'],\n",
            "                        'filename': 'Man. City vs. Real Madrid: Extended '\n",
            "                                    'Highlights | UCL Semi-Finals - Leg 2 | '\n",
            "                                    'CBS Sports Golazo',\n",
            "                        'fps': 30,\n",
            "                        'height': 720,\n",
            "                        'size': 162713669,\n",
            "                        'vispresso_index_id': '6527e0ab73878b24f9377742',\n",
            "                        'width': 1280},\n",
            "           'updated_at': '2023-10-13T02:23:06Z'},\n",
            "          {'_id': '6528a9ec43e8c47e4eb47e62',\n",
            "           'created_at': '2023-10-13T02:22:30Z',\n",
            "           'metadata': {'duration': 549,\n",
            "                        'engine_ids': ['marengo2.5', 'pegasus1'],\n",
            "                        'filename': 'The greatest moment in US Soccer history, '\n",
            "                                    '20 years later (Full Story) | FOX SOCCER',\n",
            "                        'fps': 24,\n",
            "                        'height': 720,\n",
            "                        'size': 62634136,\n",
            "                        'vispresso_index_id': '6527e0ab73878b24f9377742',\n",
            "                        'width': 1280},\n",
            "           'updated_at': '2023-10-13T02:22:36Z'},\n",
            "          {'_id': '6528a9b543e8c47e4eb47e61',\n",
            "           'created_at': '2023-10-13T02:21:32Z',\n",
            "           'metadata': {'duration': 645,\n",
            "                        'engine_ids': ['marengo2.5', 'pegasus1'],\n",
            "                        'filename': 'Final 3:39 of Game 7 of the 2016 NBA '\n",
            "                                    'Finals | Cavaliers vs Warriors',\n",
            "                        'fps': 30,\n",
            "                        'height': 720,\n",
            "                        'size': 134138451,\n",
            "                        'vispresso_index_id': '6527e0ab73878b24f9377742',\n",
            "                        'width': 1280},\n",
            "           'updated_at': '2023-10-13T02:21:41Z'},\n",
            "          {'_id': '6528a9a643e8c47e4eb47e60',\n",
            "           'created_at': '2023-10-13T02:21:15Z',\n",
            "           'metadata': {'duration': 800,\n",
            "                        'engine_ids': ['marengo2.5', 'pegasus1'],\n",
            "                        'filename': 'Usain Bolt Wins Olympic 100m Gold | '\n",
            "                                    'London 2012 Olympic Games',\n",
            "                        'fps': 25,\n",
            "                        'height': 720,\n",
            "                        'size': 120990515,\n",
            "                        'vispresso_index_id': '6527e0ab73878b24f9377742',\n",
            "                        'width': 1280},\n",
            "           'updated_at': '2023-10-13T02:21:26Z'},\n",
            "          {'_id': '6528a99a43e8c47e4eb47e5f',\n",
            "           'created_at': '2023-10-13T02:21:01Z',\n",
            "           'metadata': {'duration': 583,\n",
            "                        'engine_ids': ['marengo2.5', 'pegasus1'],\n",
            "                        'filename': 'Italy WINS Euro 2020 on PENALTIES vs. '\n",
            "                                    'England! | Highlights | ESPN FC',\n",
            "                        'fps': 30,\n",
            "                        'height': 720,\n",
            "                        'size': 185159083,\n",
            "                        'vispresso_index_id': '6527e0ab73878b24f9377742',\n",
            "                        'width': 1280},\n",
            "           'updated_at': '2023-10-13T02:21:15Z'},\n",
            "          {'_id': '6528a97243e8c47e4eb47e5e',\n",
            "           'created_at': '2023-10-13T02:20:23Z',\n",
            "           'metadata': {'duration': 1277,\n",
            "                        'engine_ids': ['marengo2.5', 'pegasus1'],\n",
            "                        'filename': 'Super Bowl LV | NFL Films Presents',\n",
            "                        'fps': 30,\n",
            "                        'height': 720,\n",
            "                        'size': 196467410,\n",
            "                        'vispresso_index_id': '6527e0ab73878b24f9377742',\n",
            "                        'width': 1280},\n",
            "           'updated_at': '2023-10-13T02:20:34Z'},\n",
            "          {'_id': '6528121943e8c47e4eb47e3e',\n",
            "           'created_at': '2023-10-12T15:34:46Z',\n",
            "           'metadata': {'duration': 74,\n",
            "                        'engine_ids': ['marengo2.5', 'pegasus1'],\n",
            "                        'filename': \"US Open 2009: Roger Federer's Incredible \"\n",
            "                                    'Between the Legs Shot against Novak '\n",
            "                                    'Djokovic HD',\n",
            "                        'fps': 30,\n",
            "                        'height': 720,\n",
            "                        'size': 12717789,\n",
            "                        'vispresso_index_id': '6527e0ab73878b24f9377742',\n",
            "                        'width': 1280},\n",
            "           'updated_at': '2023-10-12T15:34:49Z'}],\n",
            " 'page_info': {'limit_per_page': 10,\n",
            "               'page': 1,\n",
            "               'total_duration': 11497,\n",
            "               'total_page': 3,\n",
            "               'total_results': 24}}\n"
          ]
        }
      ],
      "source": [
        "# Retrieve the unique identifier of the existing index\n",
        "INDEX_ID = os.getenv(\"INDEX_ID\")\n",
        "print (INDEX_ID)\n",
        "assert INDEX_ID\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY,\n",
        "    \"Content-Type\": \"application/json\"\n",
        "}\n",
        "\n",
        "# List all the videos in an index\n",
        "INDEXES_VIDEOS_URL = f\"{API_URL}/indexes/{INDEX_ID}/videos\"\n",
        "\n",
        "response = requests.get(INDEXES_VIDEOS_URL, headers=headers)\n",
        "print(f'Status code: {response.status_code}')\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "WIvyhd9qwCPR"
      },
      "source": [
        "## 3 - Search API\n",
        "Twelve Labs provides a holistic understanding of your videos, moving beyond the limitations of relying solely on individual types of data like keywords, metadata, or transcriptions. By simultaneously integrating all available forms of information, including images, sounds, spoken words, and on-screen text, the platform captures the complex relationships among these elements for a more human-like interpretation.\n",
        "\n",
        "Search options specify the source of information the engine uses when performing a search. The following values are supported:\n",
        "\n",
        "*   **visual**: This option allows you to analyze video content as you would see and hear from it, including actions, objects, sounds, and events, and excluding human speech. The following examples are valid search terms: \"birds flying near a castle\", \"sun shining on water\", \"chickens on the road\", \"an officer holding a child's hand.\", \"crowd cheering in the stadium.\"\n",
        "*   **conversation**: This option allows you to analyze human speech within your videos.\n",
        "*   **text_in_video**: This option allows you to detect and extract text (OCR) shown within your videos.\n",
        "*   **logo**: This option allows you to identify the presence of brand logos within your videos."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "GbgqFjaZt7mu"
      },
      "source": [
        "### 3.1 - Visual\n",
        "The platform allows you to analyze video content as you would see and hear from it, including actions, objects, sounds, and events, excluding human speech. The following example sets the value of the `search_options` parameter to  `[\"visual\"]` to search for \"**Players celebrating wildly**\" using visual cues:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 8,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "NNvNPU_n-Hqx",
        "outputId": "26d8ecf6-44a7-401c-d4c3-ff1527652cb2"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': [{'confidence': 'high',\n",
            "           'end': 28.875,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 84.8,\n",
            "           'start': 20.84375,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528121743e8c47e4eb47e3c/21.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135024Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d7806d5d092efd0759a98855d76f9f8a3cc42dd18b8ab4a499385d68e4665179',\n",
            "           'video_id': '6528121743e8c47e4eb47e3c'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 256.40625,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 84.45,\n",
            "           'start': 250.375,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e4df43e8c47e4eb47e0d/251.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135023Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=444857c792abfdb022a862a413517ab4d422a2103ec0a41f1fc058c2fc42b7b1',\n",
            "           'video_id': '6527e4df43e8c47e4eb47e0d'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 87.125,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 84.41,\n",
            "           'start': 80.78125,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e4df43e8c47e4eb47e0d/81.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135023Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=e223022df9bfccc722a2696fbf8d41f9f3b33722a0b65afaa58a96cab92c7c41',\n",
            "           'video_id': '6527e4df43e8c47e4eb47e0d'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 858.5,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 84.35,\n",
            "           'start': 848.21875,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/849.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135024Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d0ee8792f02a7f78e86d7997587d69c732ee19289818847395171e3e2684f01d',\n",
            "           'video_id': '6528aa5243e8c47e4eb47e66'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 39.46875,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 84.31,\n",
            "           'start': 34.9375,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e4df43e8c47e4eb47e0d/35.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135023Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=21c744ae31323e36cbc4b67ad298a716c5367ff9576f50b3d3e834ffd935ece6',\n",
            "           'video_id': '6527e4df43e8c47e4eb47e0d'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 630.1875,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 84.27,\n",
            "           'start': 625.96875,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa1443e8c47e4eb47e64/626.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135024Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=38af30041bc5ba83965aa04bd86b9c537d30e24158c77008922626c1c572437f',\n",
            "           'video_id': '6528aa1443e8c47e4eb47e64'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 630.1875,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 84.25,\n",
            "           'start': 625.96875,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a97243e8c47e4eb47e5e/626.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135024Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=71b439b925593b3d5a7c684e47dbe2c816af605179450f2543bb27655115e7bc',\n",
            "           'video_id': '6528a97243e8c47e4eb47e5e'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 558.875,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 84.19,\n",
            "           'start': 549.40625,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa0a43e8c47e4eb47e63/550.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135024Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=6e43bd18a868c3b5e4171c14a41db58be727023dacff648eb8fdec4f501c39a2',\n",
            "           'video_id': '6528aa0a43e8c47e4eb47e63'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 150.3125,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 84.12,\n",
            "           'start': 143.96875,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e4dc43e8c47e4eb47e0c/144.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135023Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=472afa69916074da0712cbad471867588a2fca78f773b8a5860e73a8b03d479c',\n",
            "           'video_id': '6527e4dc43e8c47e4eb47e0c'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 35.5625,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 84.08,\n",
            "           'start': 25.21875,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a99a43e8c47e4eb47e5f/26.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135024Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=53e3d8f7f3a39a3a17360bced2133c2e39de7f63176ac6a17ac06805e97c4e74',\n",
            "           'video_id': '6528a99a43e8c47e4eb47e5f'}],\n",
            " 'page_info': {'limit_per_page': 10,\n",
            "               'next_page_token': '61554ab0-b85f-45bf-adb1-3958b3690bd0-1',\n",
            "               'page_expired_at': '2023-10-13T13:50:24Z',\n",
            "               'total_results': 633},\n",
            " 'search_pool': {'index_id': '6527e0ab74b5a5ab84015ce2',\n",
            "                 'total_count': 24,\n",
            "                 'total_duration': 11497}}\n"
          ]
        }
      ],
      "source": [
        "# Construct the URL of the `/search` endpoint\n",
        "SEARCH_URL = f\"{API_URL}/search/\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "query = \"Players celebrating wildly\"\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "    \"query\": query,  # Specify your search query\n",
        "    \"index_id\": INDEX_ID,  # Indicate the unique identifier of your index\n",
        "    \"search_options\": [\"visual\"],  # Specify the search options\n",
        "}\n",
        "\n",
        "# Make a search request\n",
        "response = requests.post(SEARCH_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 9,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "id": "HxjRwt6-tlBG",
        "outputId": "d76d1342-6e1d-4e62-d454-0c2b38bbfa2a"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Search Query:  Players celebrating wildly\n",
            "Option: Visual\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528121743e8c47e4eb47e3c/21.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135024Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d7806d5d092efd0759a98855d76f9f8a3cc42dd18b8ab4a499385d68e4665179\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 84.8\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e4df43e8c47e4eb47e0d/251.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135023Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=444857c792abfdb022a862a413517ab4d422a2103ec0a41f1fc058c2fc42b7b1\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 84.45\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e4df43e8c47e4eb47e0d/81.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135023Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=e223022df9bfccc722a2696fbf8d41f9f3b33722a0b65afaa58a96cab92c7c41\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 84.41\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/849.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135024Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d0ee8792f02a7f78e86d7997587d69c732ee19289818847395171e3e2684f01d\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 84.35\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e4df43e8c47e4eb47e0d/35.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135023Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=21c744ae31323e36cbc4b67ad298a716c5367ff9576f50b3d3e834ffd935ece6\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 84.31\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa1443e8c47e4eb47e64/626.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135024Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=38af30041bc5ba83965aa04bd86b9c537d30e24158c77008922626c1c572437f\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 84.27\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a97243e8c47e4eb47e5e/626.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135024Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=71b439b925593b3d5a7c684e47dbe2c816af605179450f2543bb27655115e7bc\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 84.25\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa0a43e8c47e4eb47e63/550.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135024Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=6e43bd18a868c3b5e4171c14a41db58be727023dacff648eb8fdec4f501c39a2\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 84.19\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e4dc43e8c47e4eb47e0c/144.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135023Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=472afa69916074da0712cbad471867588a2fca78f773b8a5860e73a8b03d479c\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 84.12\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a99a43e8c47e4eb47e5f/26.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135024Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=53e3d8f7f3a39a3a17360bced2133c2e39de7f63176ac6a17ac06805e97c4e74\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 84.08\n"
          ]
        }
      ],
      "source": [
        "# Import libraries to display visual in the notebook\n",
        "from IPython.display import display\n",
        "from IPython.display import Image\n",
        "\n",
        "# Display a list of thumbnail URLs of the returning videos\n",
        "res = response.json()\n",
        "print (\"Search Query: \", query)\n",
        "print (\"Option:\", \"Visual\")\n",
        "\n",
        "for item in res[\"data\"]:\n",
        "  display(Image(url=item[\"thumbnail_url\"]))\n",
        "  print(\"Confidence Level:\", item[\"confidence\"])\n",
        "  print(\"Confidence Score:\", item[\"score\"])"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "WxKmySMmAutH"
      },
      "source": [
        "### 3.2 - Conversation\n",
        "The platform allows you to analyze human speech within your videos.\n",
        "The following example sets the value of the `search_options` parameter to `[\"conversation\"]` to perform a semantic search and returns the matches for the specified search term - \"**The greatest player in the game**\":"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 10,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "qLVIrR7tBPV0",
        "outputId": "cdbd313e-6da0-467c-b2bd-b87868ad6f9c"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': [{'confidence': 'high',\n",
            "           'end': 42.27,\n",
            "           'metadata': [{'text': 'This is the biggest game in the lives of '\n",
            "                                 'these USA players. USA attacks hit his face '\n",
            "                                 'on the way outside of the box.',\n",
            "                         'type': 'conversation'}],\n",
            "           'score': 84.28,\n",
            "           'start': 32.959,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9ec43e8c47e4eb47e62/33.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=bc88fe2062e5b99cbbdbe682eae213cbcd2abf9b7e8fb9b8f1901dccb288a4e1',\n",
            "           'video_id': '6528a9ec43e8c47e4eb47e62'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 776.539,\n",
            "           'metadata': [{'text': '  The great Carl Lewis, perhaps the greatest '\n",
            "                                 \"athlete we've seen. But maybe now we should \"\n",
            "                                 \"say that you say B is, if he hadn't done it \"\n",
            "                                 'before in Berlin, in Beijing, once again in '\n",
            "                                 \"London, he's triumphant does the greatest \"\n",
            "                                 'field assembled here and yet he runs away '\n",
            "                                 'from them. Absolutely magnificent. A great, '\n",
            "                                 \"great athlete and he's transformed the world \"\n",
            "                                 'of sprinting. Yes. The tall men they said '\n",
            "                                 \"couldn't sprint. Well, that's not true.\",\n",
            "                         'type': 'conversation'}],\n",
            "           'score': 84.03,\n",
            "           'start': 750.69,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/751.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=e6470907371be4bb52e96868bdc1e2eecd3d5bc124166120de621218c76a77eb',\n",
            "           'video_id': '6528a9a643e8c47e4eb47e60'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 52.5,\n",
            "           'metadata': [{'text': 'Oh sensational, the greatest sportsman in '\n",
            "                                 'the history of the Champions League with an '\n",
            "                                 'A feud.',\n",
            "                         'type': 'conversation'}],\n",
            "           'score': 83.91,\n",
            "           'start': 42.549,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63843e8c47e4eb47e15/43.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=3c9252314fca75878609ddac31f1480318ca26cdcc1132dc9f6f9325c14c8da7',\n",
            "           'video_id': '6527e63843e8c47e4eb47e15'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 556.07,\n",
            "           'metadata': [{'text': \"He can't, he can't guard me. I'm too strong. \"\n",
            "                                 'You talk about anybody in the game? You got '\n",
            "                                 'the ball, good players, make themselves '\n",
            "                                 'good, great players, make everybody good.',\n",
            "                         'type': 'conversation'}],\n",
            "           'score': 83.26,\n",
            "           'start': 542.489,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa4743e8c47e4eb47e65/543.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=0b840b839a480f65ccdc3b214a7ba6de4b0c7258b036e3e1eba932c1d8f89e0b',\n",
            "           'video_id': '6528aa4743e8c47e4eb47e65'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 144.44,\n",
            "           'metadata': [{'text': 'The greatest goal scorer in the world has '\n",
            "                                 'win out of the goal. China must score here. '\n",
            "                                 'The',\n",
            "                         'type': 'conversation'}],\n",
            "           'score': 83.19,\n",
            "           'start': 131.57,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9ec43e8c47e4eb47e62/132.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=bb4e3919ac202935ee56aedbe8d6798badf9aef3dcaef4a7d1858a85bea6b670',\n",
            "           'video_id': '6528a9ec43e8c47e4eb47e62'},\n",
            "          {'confidence': 'medium',\n",
            "           'end': 500.14,\n",
            "           'metadata': [{'text': 'Gets it gets it over to th and he comes in '\n",
            "                                 'and scores. I think this is the best scoring '\n",
            "                                 \"game I've ever seen from Da Utah. Nice.\",\n",
            "                         'type': 'conversation'}],\n",
            "           'score': 78.76,\n",
            "           'start': 491.07,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/492.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d1a94dce70c340ff9878127bac94c6c459e3ee0514b3ca558ebbfb3df3ab4efc',\n",
            "           'video_id': '6528aa5243e8c47e4eb47e66'},\n",
            "          {'confidence': 'medium',\n",
            "           'end': 85.33,\n",
            "           'metadata': [{'text': 'Applauding what an incredible sight you can '\n",
            "                                 'see around the ground, not just the real '\n",
            "                                 'Madrid fans, but Vasquez beaten away by '\n",
            "                                 'Buffon and then run down the sensational, '\n",
            "                                 'the greatest marksman in the history of the '\n",
            "                                 'Champions League with an A.',\n",
            "                         'type': 'conversation'}],\n",
            "           'score': 77.41,\n",
            "           'start': 59.02,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63843e8c47e4eb47e15/60.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=f6228280a36795f90db0dd492a6b51bbc0e4ed79060213ba50c404e7f4c114e0',\n",
            "           'video_id': '6527e63843e8c47e4eb47e15'},\n",
            "          {'confidence': 'medium',\n",
            "           'end': 104.16,\n",
            "           'metadata': [{'text': \"But then it's definitive take on the \"\n",
            "                                 'defender and have a hit and what has caught '\n",
            "                                 'me by surprise throughout this entire '\n",
            "                                 'tournament and especially in this building, '\n",
            "                                 'how composed he is in those critical '\n",
            "                                 'moments.',\n",
            "                         'type': 'conversation'}],\n",
            "           'score': 76.62,\n",
            "           'start': 91.589,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a99a43e8c47e4eb47e5f/92.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=3b8db91cc562dcb66de2716fd81499ef2e5bfa2201dbf51146f091f5e562d4fc',\n",
            "           'video_id': '6528a99a43e8c47e4eb47e5f'},\n",
            "          {'confidence': 'medium',\n",
            "           'end': 1276.66,\n",
            "           'metadata': [{'text': \"Oh my great batting face. I'm like here you \"\n",
            "                                 'fired up. The Buccaneers are Super Bowl. 55 '\n",
            "                                 'champions led by Tom Brady. Absolutely. A '\n",
            "                                 'player for the ages',\n",
            "                         'type': 'conversation'}],\n",
            "           'score': 75.46,\n",
            "           'start': 1261.449,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa1443e8c47e4eb47e64/1262.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=7929b6d153ce236cf0c064fcb624031f6f12e25424b3dfc2b3231c6514ea9b55',\n",
            "           'video_id': '6528aa1443e8c47e4eb47e64'},\n",
            "          {'confidence': 'medium',\n",
            "           'end': 1276.66,\n",
            "           'metadata': [{'text': \"Oh my great batting face. I'm like here you \"\n",
            "                                 'fired up. The Buccaneers are Super Bowl. 55 '\n",
            "                                 'champions led by Tom Brady. Absolutely. A '\n",
            "                                 'player for the ages',\n",
            "                         'type': 'conversation'}],\n",
            "           'score': 75.46,\n",
            "           'start': 1261.449,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a97243e8c47e4eb47e5e/1262.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=3dee8bdb6118d3abc4898b5e9b2144b9cef847e04144f646e2233403bcd96ee9',\n",
            "           'video_id': '6528a97243e8c47e4eb47e5e'}],\n",
            " 'page_info': {'limit_per_page': 10,\n",
            "               'next_page_token': '9d12c50e-6d65-4463-9d82-515d09878856-1',\n",
            "               'page_expired_at': '2023-10-13T13:50:50Z',\n",
            "               'total_results': 55},\n",
            " 'search_pool': {'index_id': '6527e0ab74b5a5ab84015ce2',\n",
            "                 'total_count': 24,\n",
            "                 'total_duration': 11497}}\n"
          ]
        }
      ],
      "source": [
        "# Construct the URL of the `/search` endpoint\n",
        "SEARCH_URL = f\"{API_URL}/search/\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "query = \"The greatest player in the game\"\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "    \"query\": query,  # Specify your search query\n",
        "    \"index_id\": INDEX_ID,  # Indicate the unique identifier of your index\n",
        "    \"search_options\": [\"conversation\"],  # Specify the search options\n",
        "    \"conversation_option\": \"semantic\",  # Specifty the conversation option\n",
        "}\n",
        "\n",
        "# Make a search request\n",
        "response = requests.post(SEARCH_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 11,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "id": "m5r56Sks45nd",
        "outputId": "562178ec-a9a3-402c-a394-dabe93d4ca9e"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Search Query:  The greatest player in the game\n",
            "Option: Conversation\n",
            "GT Text:  This is the biggest game in the lives of these USA players. USA attacks hit his face on the way outside of the box.\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9ec43e8c47e4eb47e62/33.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=bc88fe2062e5b99cbbdbe682eae213cbcd2abf9b7e8fb9b8f1901dccb288a4e1\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 84.28\n",
            "GT Text:    The great Carl Lewis, perhaps the greatest athlete we've seen. But maybe now we should say that you say B is, if he hadn't done it before in Berlin, in Beijing, once again in London, he's triumphant does the greatest field assembled here and yet he runs away from them. Absolutely magnificent. A great, great athlete and he's transformed the world of sprinting. Yes. The tall men they said couldn't sprint. Well, that's not true.\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/751.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=e6470907371be4bb52e96868bdc1e2eecd3d5bc124166120de621218c76a77eb\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 84.03\n",
            "GT Text:  Oh sensational, the greatest sportsman in the history of the Champions League with an A feud.\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63843e8c47e4eb47e15/43.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=3c9252314fca75878609ddac31f1480318ca26cdcc1132dc9f6f9325c14c8da7\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 83.91\n",
            "GT Text:  He can't, he can't guard me. I'm too strong. You talk about anybody in the game? You got the ball, good players, make themselves good, great players, make everybody good.\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa4743e8c47e4eb47e65/543.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=0b840b839a480f65ccdc3b214a7ba6de4b0c7258b036e3e1eba932c1d8f89e0b\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 83.26\n",
            "GT Text:  The greatest goal scorer in the world has win out of the goal. China must score here. The\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9ec43e8c47e4eb47e62/132.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=bb4e3919ac202935ee56aedbe8d6798badf9aef3dcaef4a7d1858a85bea6b670\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 83.19\n",
            "GT Text:  Gets it gets it over to th and he comes in and scores. I think this is the best scoring game I've ever seen from Da Utah. Nice.\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/492.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d1a94dce70c340ff9878127bac94c6c459e3ee0514b3ca558ebbfb3df3ab4efc\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: medium\n",
            "Confidence Score: 78.76\n",
            "GT Text:  Applauding what an incredible sight you can see around the ground, not just the real Madrid fans, but Vasquez beaten away by Buffon and then run down the sensational, the greatest marksman in the history of the Champions League with an A.\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63843e8c47e4eb47e15/60.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=f6228280a36795f90db0dd492a6b51bbc0e4ed79060213ba50c404e7f4c114e0\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: medium\n",
            "Confidence Score: 77.41\n",
            "GT Text:  But then it's definitive take on the defender and have a hit and what has caught me by surprise throughout this entire tournament and especially in this building, how composed he is in those critical moments.\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a99a43e8c47e4eb47e5f/92.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=3b8db91cc562dcb66de2716fd81499ef2e5bfa2201dbf51146f091f5e562d4fc\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: medium\n",
            "Confidence Score: 76.62\n",
            "GT Text:  Oh my great batting face. I'm like here you fired up. The Buccaneers are Super Bowl. 55 champions led by Tom Brady. Absolutely. A player for the ages\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa1443e8c47e4eb47e64/1262.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=7929b6d153ce236cf0c064fcb624031f6f12e25424b3dfc2b3231c6514ea9b55\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: medium\n",
            "Confidence Score: 75.46\n",
            "GT Text:  Oh my great batting face. I'm like here you fired up. The Buccaneers are Super Bowl. 55 champions led by Tom Brady. Absolutely. A player for the ages\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a97243e8c47e4eb47e5e/1262.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135050Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=3dee8bdb6118d3abc4898b5e9b2144b9cef847e04144f646e2233403bcd96ee9\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: medium\n",
            "Confidence Score: 75.46\n"
          ]
        }
      ],
      "source": [
        "# Display a list of thumbnail URLs of the returning videos\n",
        "res = response.json()\n",
        "print (\"Search Query: \", query)\n",
        "print (\"Option:\", \"Conversation\")\n",
        "\n",
        "for item in res[\"data\"]:\n",
        "  print (\"GT Text: \", item[\"metadata\"][0][\"text\"])\n",
        "  display(Image(url=item[\"thumbnail_url\"]))\n",
        "  print(\"Confidence Level:\", item[\"confidence\"])\n",
        "  print(\"Confidence Score:\", item[\"score\"])"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "qVl9drJYBfun"
      },
      "source": [
        "### 3.3 - Text In Video\n",
        "The platform allows you to detect and extract text (OCR) shown within your videos. The following example sets the value of the `search_options` parameter to `[\"text_in_video\"]` to search for text that matches \"**Usain Bolt**\":"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 12,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "2c9zJvy9B37z",
        "outputId": "b9d6c72c-b728-4383-f2b1-29ceb26a9809"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': [{'confidence': 'high',\n",
            "           'end': 12,\n",
            "           'metadata': [{'text': 'Usain BOLT', 'type': 'text_in_video'}],\n",
            "           'score': 92.28,\n",
            "           'start': 4,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528118943e8c47e4eb47e38/5.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=e049b770743b649d564875402d719e3a29b149ced0d6e6697015e700a7dad147',\n",
            "           'video_id': '6528118943e8c47e4eb47e38'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 39,\n",
            "           'metadata': [{'text': 'USAIN BOLT', 'type': 'text_in_video'}],\n",
            "           'score': 92.28,\n",
            "           'start': 30,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/31.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=91515870c4fc34a2223c76731d1561558348b7c669d9f3401a92c7ae8d72a652',\n",
            "           'video_id': '6528a9a643e8c47e4eb47e60'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 53,\n",
            "           'metadata': [{'text': 'USAIN BOLT', 'type': 'text_in_video'}],\n",
            "           'score': 92.28,\n",
            "           'start': 47,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/48.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d85d9eaa7e11088122ed91cf4853adafbd3bdebdf7b6079add6060faa84776e4',\n",
            "           'video_id': '6528a9a643e8c47e4eb47e60'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 203,\n",
            "           'metadata': [{'text': 'USAIN BOLT', 'type': 'text_in_video'}],\n",
            "           'score': 92.28,\n",
            "           'start': 193,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/194.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=dd98ddc9461310b37c2afa0927de49da2fa8d056f028afbce51a032dcf00db26',\n",
            "           'video_id': '6528a9a643e8c47e4eb47e60'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 347,\n",
            "           'metadata': [{'text': 'USAIN BOLT', 'type': 'text_in_video'}],\n",
            "           'score': 92.28,\n",
            "           'start': 337,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/338.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=958525bc7d994d11f4295a8687b5ceca99975e3457001160f343231f629a7eba',\n",
            "           'video_id': '6528a9a643e8c47e4eb47e60'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 543,\n",
            "           'metadata': [{'text': 'USAIN BOLT', 'type': 'text_in_video'}],\n",
            "           'score': 92.28,\n",
            "           'start': 532,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/533.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=b0bd78cea9d0952a301c5c25ef65cbdc14ec140eeb53a13a2aaf6d506c20f236',\n",
            "           'video_id': '6528a9a643e8c47e4eb47e60'},\n",
            "          {'confidence': 'low',\n",
            "           'end': 59,\n",
            "           'metadata': [{'text': 'BOLT', 'type': 'text_in_video'}],\n",
            "           'score': 64.6,\n",
            "           'start': 57,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/58.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=a94d5643f0e0dedff4caabc47a7b28bc8940bbb290f793a0760a8fbbee95a4f0',\n",
            "           'video_id': '6528a9a643e8c47e4eb47e60'},\n",
            "          {'confidence': 'low',\n",
            "           'end': 71,\n",
            "           'metadata': [{'text': 'Bolt', 'type': 'text_in_video'}],\n",
            "           'score': 64.6,\n",
            "           'start': 70,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528118943e8c47e4eb47e38/71.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=3a82f7f1a4b649a804bf6f2b0eb778f9c36038a6ac6c080346bb21e8eccf5fe0',\n",
            "           'video_id': '6528118943e8c47e4eb47e38'},\n",
            "          {'confidence': 'low',\n",
            "           'end': 75,\n",
            "           'metadata': [{'text': 'Bolt', 'type': 'text_in_video'}],\n",
            "           'score': 64.6,\n",
            "           'start': 74,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528118943e8c47e4eb47e38/75.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=c31f521701c59674e8fe41075ba9eea207bc0994c5f6a29bba1f864ed1778349',\n",
            "           'video_id': '6528118943e8c47e4eb47e38'},\n",
            "          {'confidence': 'low',\n",
            "           'end': 82,\n",
            "           'metadata': [{'text': 'BOLT', 'type': 'text_in_video'}],\n",
            "           'score': 64.6,\n",
            "           'start': 80,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/81.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=a8c87f870653501e29b9e430de062cce5245fc81bddae3ed9291f9decb9d6e08',\n",
            "           'video_id': '6528a9a643e8c47e4eb47e60'}],\n",
            " 'page_info': {'limit_per_page': 10,\n",
            "               'next_page_token': '03c83062-1b7b-4cf7-828a-58511a7f07d5-1',\n",
            "               'page_expired_at': '2023-10-13T13:51:08Z',\n",
            "               'total_results': 30},\n",
            " 'search_pool': {'index_id': '6527e0ab74b5a5ab84015ce2',\n",
            "                 'total_count': 24,\n",
            "                 'total_duration': 11497}}\n"
          ]
        }
      ],
      "source": [
        "# Construct the URL of the `/search` endpoint\n",
        "SEARCH_URL = f\"{API_URL}/search/\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "query = \"Usain Bolt\"\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "    \"query\": query,  # Specify your search query\n",
        "    \"index_id\": INDEX_ID,  # Indicate the unique identifier of your index\n",
        "    \"search_options\": [\"text_in_video\"],  # Specify the search options\n",
        "}\n",
        "\n",
        "# Make a search request\n",
        "response = requests.post(SEARCH_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 13,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "id": "SuzeF1Bc5EfR",
        "outputId": "bb5878f8-d796-486f-d45d-992a804314dc"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Search Query:  Usain Bolt\n",
            "Option: Text In Video\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528118943e8c47e4eb47e38/5.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=e049b770743b649d564875402d719e3a29b149ced0d6e6697015e700a7dad147\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/31.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=91515870c4fc34a2223c76731d1561558348b7c669d9f3401a92c7ae8d72a652\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/48.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d85d9eaa7e11088122ed91cf4853adafbd3bdebdf7b6079add6060faa84776e4\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/194.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=dd98ddc9461310b37c2afa0927de49da2fa8d056f028afbce51a032dcf00db26\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/338.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=958525bc7d994d11f4295a8687b5ceca99975e3457001160f343231f629a7eba\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/533.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=b0bd78cea9d0952a301c5c25ef65cbdc14ec140eeb53a13a2aaf6d506c20f236\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/58.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=a94d5643f0e0dedff4caabc47a7b28bc8940bbb290f793a0760a8fbbee95a4f0\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: low\n",
            "Confidence Score: 64.6\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528118943e8c47e4eb47e38/71.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=3a82f7f1a4b649a804bf6f2b0eb778f9c36038a6ac6c080346bb21e8eccf5fe0\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: low\n",
            "Confidence Score: 64.6\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528118943e8c47e4eb47e38/75.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=c31f521701c59674e8fe41075ba9eea207bc0994c5f6a29bba1f864ed1778349\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: low\n",
            "Confidence Score: 64.6\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/81.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135108Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=a8c87f870653501e29b9e430de062cce5245fc81bddae3ed9291f9decb9d6e08\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: low\n",
            "Confidence Score: 64.6\n"
          ]
        }
      ],
      "source": [
        "# Display a list of thumbnail URLs of the returning videos\n",
        "res = response.json()\n",
        "print (\"Search Query: \", query)\n",
        "print (\"Option:\", \"Text In Video\")\n",
        "\n",
        "for item in res[\"data\"]:\n",
        "  display(Image(url=item[\"thumbnail_url\"]))\n",
        "  print(\"Confidence Level:\", item[\"confidence\"])\n",
        "  print(\"Confidence Score:\", item[\"score\"])"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "uNjYx--BuZFA"
      },
      "source": [
        "### 3.4 - Logo\n",
        "The platform allows you to detect and extract brand logos as shown within your videos. For this, call the [`POST`](/reference/make-search-request) method of the `/search` endpoint with the following parameters:\n",
        "\n",
        "- `query`:  The name of the company\n",
        "- `search_options`:  The source of information the platform uses (`logo`)\n",
        "- `index_id`: The unique identifier of the index you've previously created\n",
        "\n",
        "The example code below finds when the Olympic logo appears in your videos:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 14,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "4Z86ZDk5urAS",
        "outputId": "4522116d-5a65-40f9-fcf6-ff90ce651579"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': [{'confidence': 'high',\n",
            "           'end': 18,\n",
            "           'metadata': [{'text': 'Olympic Channel', 'type': 'logo'}],\n",
            "           'score': 92.28,\n",
            "           'start': 0.03125,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527f05e43e8c47e4eb47e31/1.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=744876af84d0518b86399b3755a9590d9d1628872b5a734e8c28090c7d7e2946',\n",
            "           'video_id': '6527f05e43e8c47e4eb47e31'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 213,\n",
            "           'metadata': [{'text': 'Olympic Channel', 'type': 'logo'}],\n",
            "           'score': 92.28,\n",
            "           'start': 0.03125,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/1.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=81c576c57f28c21df27050c9b1bc628660ffa729df89778f220c6c99c6897f46',\n",
            "           'video_id': '6527e63943e8c47e4eb47e17'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 5,\n",
            "           'metadata': [{'text': 'Italian National Olympic Committee',\n",
            "                         'type': 'logo'}],\n",
            "           'score': 92.28,\n",
            "           'start': 4,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a99a43e8c47e4eb47e5f/5.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=da1826ab59c5a87036455bbcc2d9dc032cc0c45d0e081f0d6841d8017db52cdb',\n",
            "           'video_id': '6528a99a43e8c47e4eb47e5f'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 10,\n",
            "           'metadata': [{'text': 'International Olympic Committee',\n",
            "                         'type': 'logo'}],\n",
            "           'score': 92.28,\n",
            "           'start': 9,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/10.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=b905e0ba38b68b907834069c10552f4a58ce029a11e67f8a42032cd1f2ee57b2',\n",
            "           'video_id': '6528a9a643e8c47e4eb47e60'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 11,\n",
            "           'metadata': [{'text': 'Olympic Air', 'type': 'logo'}],\n",
            "           'score': 92.28,\n",
            "           'start': 10,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527f05e43e8c47e4eb47e31/11.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=7d90bf5557a99f6c9b03e5c08c7090235d41f351b650483c72d6431cbe4e119d',\n",
            "           'video_id': '6527f05e43e8c47e4eb47e31'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 16,\n",
            "           'metadata': [{'text': 'International Olympic Committee',\n",
            "                         'type': 'logo'}],\n",
            "           'score': 92.28,\n",
            "           'start': 15,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527f05e43e8c47e4eb47e31/16.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=e7d56a70923ad702a0da721d7b8c371d8308bd1a50471d9c0195dfc5ef5c6052',\n",
            "           'video_id': '6527f05e43e8c47e4eb47e31'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 24,\n",
            "           'metadata': [{'text': 'International Olympic Committee',\n",
            "                         'type': 'logo'}],\n",
            "           'score': 92.28,\n",
            "           'start': 18,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/19.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=1d6d53a5efb114ac67dc66fc9975bd02b56caa671c0ab7f962666e71fd958837',\n",
            "           'video_id': '6528a9a643e8c47e4eb47e60'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 47,\n",
            "           'metadata': [{'text': 'Olympic Channel', 'type': 'logo'}],\n",
            "           'score': 92.28,\n",
            "           'start': 21,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527f05e43e8c47e4eb47e31/22.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=969a012c4568684d7beb2e0c968abe73ddf10692c1ed24aeab1b969f916c53b8',\n",
            "           'video_id': '6527f05e43e8c47e4eb47e31'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 28,\n",
            "           'metadata': [{'text': 'International Olympic Committee',\n",
            "                         'type': 'logo'}],\n",
            "           'score': 92.28,\n",
            "           'start': 27,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527f05e43e8c47e4eb47e31/28.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=be2ffa0f9b92f599588ee9877798ad0d9e0a3cfdfc3abe9a34e6da8bb7e1367f',\n",
            "           'video_id': '6527f05e43e8c47e4eb47e31'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 39,\n",
            "           'metadata': [{'text': 'International Olympic Committee',\n",
            "                         'type': 'logo'}],\n",
            "           'score': 92.28,\n",
            "           'start': 31,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/32.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=aff7d4180b17b64cb4a14a05eb1da85414da3631f971c85120d74c50c6de8baa',\n",
            "           'video_id': '6528a9a643e8c47e4eb47e60'}],\n",
            " 'page_info': {'limit_per_page': 10,\n",
            "               'next_page_token': 'cad63ecb-a272-4746-8d57-1d5712b235ae-1',\n",
            "               'page_expired_at': '2023-10-13T13:51:25Z',\n",
            "               'total_results': 126},\n",
            " 'search_pool': {'index_id': '6527e0ab74b5a5ab84015ce2',\n",
            "                 'total_count': 24,\n",
            "                 'total_duration': 11497}}\n"
          ]
        }
      ],
      "source": [
        "# Construct the URL of the `/search` endpoint\n",
        "SEARCH_URL = f\"{API_URL}/search/\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "query = \"Olympic\"\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "    \"query\": query,  # Specify your search query\n",
        "    \"index_id\": INDEX_ID,  # Indicate the unique identifier of your index\n",
        "    \"search_options\": [\"logo\"],  # Specify the search options\n",
        "}\n",
        "\n",
        "# Make a search request\n",
        "response = requests.post(SEARCH_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 15,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "id": "dzld_8Ex0b6N",
        "outputId": "0c11b3f2-3a85-451c-d4c1-455fca883ae1"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Search Query:  Olympic\n",
            "Option: Logo\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527f05e43e8c47e4eb47e31/1.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=744876af84d0518b86399b3755a9590d9d1628872b5a734e8c28090c7d7e2946\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/1.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=81c576c57f28c21df27050c9b1bc628660ffa729df89778f220c6c99c6897f46\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a99a43e8c47e4eb47e5f/5.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=da1826ab59c5a87036455bbcc2d9dc032cc0c45d0e081f0d6841d8017db52cdb\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/10.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=b905e0ba38b68b907834069c10552f4a58ce029a11e67f8a42032cd1f2ee57b2\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527f05e43e8c47e4eb47e31/11.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=7d90bf5557a99f6c9b03e5c08c7090235d41f351b650483c72d6431cbe4e119d\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527f05e43e8c47e4eb47e31/16.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=e7d56a70923ad702a0da721d7b8c371d8308bd1a50471d9c0195dfc5ef5c6052\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/19.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=1d6d53a5efb114ac67dc66fc9975bd02b56caa671c0ab7f962666e71fd958837\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527f05e43e8c47e4eb47e31/22.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=969a012c4568684d7beb2e0c968abe73ddf10692c1ed24aeab1b969f916c53b8\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527f05e43e8c47e4eb47e31/28.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=be2ffa0f9b92f599588ee9877798ad0d9e0a3cfdfc3abe9a34e6da8bb7e1367f\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9a643e8c47e4eb47e60/32.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T135125Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=aff7d4180b17b64cb4a14a05eb1da85414da3631f971c85120d74c50c6de8baa\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        }
      ],
      "source": [
        "# Display a list of thumbnail URLs of the returning videos\n",
        "res = response.json()\n",
        "print (\"Search Query: \", query)\n",
        "print (\"Option:\", \"Logo\")\n",
        "\n",
        "for item in res[\"data\"]:\n",
        "  display(Image(url=item[\"thumbnail_url\"]))\n",
        "  print(\"Confidence Level:\", item[\"confidence\"])\n",
        "  print(\"Confidence Score:\", item[\"score\"])"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "TQ2Hsn0LwKT2"
      },
      "source": [
        "## 4 - Classify API\n",
        "Content classification is the process of organizing content into distinct categories based on specific criteria. This process helps you organize your videos into more manageable and useful categories, making them easier to find, access, and use.\n",
        "\n",
        "If you have an extensive library of videos you'd like to analyze to identify specific actions or entities, manually finding the segments that meet your criteria is time-consuming. With a single API call, the Twelve Labs platform automatically identifies the actions and entities you specify whenever they appear in your videos and assigns a likelihood score that indicates how likely those actions or entities are to occur in each of your videos.\n",
        "\n",
        "The platform allows you to define either a simple or a hierarchical taxonomy system to organize your videos.  A simple taxonomy system is composed of a single set of categories, similar to [YouTube video categories](https://developers.google.com/youtube/v3/docs/videoCategories/list). A hierarchical taxonomy system is composed of categories and subcategories, similar to [IAB Tech Lab Content Taxonomy](https://iabtechlab.com/standards/content-taxonomy/).\n",
        "\n",
        "The following parameters allow you to control how classification works:\n",
        "\n",
        "- `classes`: An array of objects containing the names and definitions of the entities or actions that the platform must identify. Each object is composed of the following fields:\n",
        "  - `name`: A string representing the name you want to give this class.\n",
        "  - `prompts`: An array of strings that specifies what the class contains. The platform uses the values you provide in this array to classify your videos.\n",
        "- `threshold`: A numerical value that indicates the confidence level of the video segment's match with a certain class.\n",
        "- `ratio`: A numerical value that displays the ratio of the sum of the lengths of the matching video segments divided by the total length of the video."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "KYlCycWht90s"
      },
      "source": [
        "### Classifying videos based on one class\n",
        "The following example code uses the `options` parameter to specify that the platform should classify your video based on one classes - `Basketball`:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 16,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "mBhALApwaLox",
        "outputId": "08303044-bb9e-44d8-8dfc-8ffda6acd6d8"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': [{'classes': [{'duration_ratio': 0.95,\n",
            "                        'name': 'Basketball',\n",
            "                        'score': 94.18}],\n",
            "           'video_id': '6528aa5243e8c47e4eb47e66'},\n",
            "          {'classes': [{'duration_ratio': 0.72,\n",
            "                        'name': 'Basketball',\n",
            "                        'score': 92.67}],\n",
            "           'video_id': '6527e63943e8c47e4eb47e17'},\n",
            "          {'classes': [{'duration_ratio': 0.58,\n",
            "                        'name': 'Basketball',\n",
            "                        'score': 88.71}],\n",
            "           'video_id': '6528a9b543e8c47e4eb47e61'}],\n",
            " 'page_info': {'limit_per_page': 3,\n",
            "               'next_page_token': '',\n",
            "               'page_expired_at': '2023-10-13T14:05:56Z',\n",
            "               'prev_page_token': '',\n",
            "               'total_results': 3}}\n"
          ]
        }
      ],
      "source": [
        "# Construct the URL of the `/classify/bulk` endpoint\n",
        "CLASSIFY_BULK_URL = f\"{API_URL}/classify/bulk\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data =  {\n",
        "  \"options\": [\n",
        "        \"visual\",\n",
        "        \"conversation\",\n",
        "        \"text_in_video\"\n",
        "  ],  # Specify how the platform will analyze your video\n",
        "  \"index_id\": INDEX_ID,  # Indicate the unique identifier of your index\n",
        "  \"classes\": [\n",
        "        {\n",
        "            \"name\": \"Basketball\",\n",
        "            \"prompts\": [\n",
        "                \"Playing basketball\",\n",
        "                \"How to improve basketball skills\",\n",
        "                \"Basic basketball rules\",\n",
        "                \"Best basketball shoes\"\n",
        "            ]\n",
        "        }\n",
        "  ],\n",
        "  \"threshold\": {\n",
        "        \"min_video_score\": 80,  # Minimum video score is 80\n",
        "        \"min_duration_ratio\": 0.5  # Minimum duration ratio is 50%\n",
        "  }\n",
        "}\n",
        "\n",
        "# Make a classification request\n",
        "response = requests.post(CLASSIFY_BULK_URL, headers=headers, json=data)\n",
        "print (f'Status code: {response.status_code}')\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "CPMj836badap"
      },
      "source": [
        "In the example output above, note that the `data` array is composed of three objects. Each object contains the following:\n",
        "\n",
        "*   A field named `video_id` representing the unique identifier of the video that has been classified.\n",
        "*   An array named `labels` containing information about each video. Note that, when classifying a video, the API service finds all video fragments that match the label you've specified in the request. For each video fragment found, the API service determines the level of confidence that the fragment matches the label. The `max_score` field is determined by comparing the confidence scores of each fragment and selecting the highest one.\n",
        "\n",
        "### Retrieving detailed information about each matching video fragment\n",
        "\n",
        "The following example code sets the `include_clips` parameter to true to specify that the API service should retrieve detailed information about each matching video fragment:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 17,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "hzta-Yy7D3Mv",
        "outputId": "dd82df01-582c-4653-aab8-3ecf7caf155c"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': [{'classes': [{'clips': [{'end': 120.4375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.79,\n",
            "                                   'start': 84,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/85.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=8b074e82ad27559f5307c77bcf50a20d53e7694ce5b51f4b985389cad9b2848b'},\n",
            "                                  {'end': 120.4375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.48,\n",
            "                                   'start': 63.71875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/64.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=4cbebf2ae2857d5735f84ef40ece970e5e1d6b8f0ae76add4a715e1285d76132'},\n",
            "                                  {'end': 510.0625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.48,\n",
            "                                   'start': 123.46875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/124.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=32600746c938320d98b6d15d67e96438fd14ed3092202a1acedea3876c889f96'},\n",
            "                                  {'end': 70.65625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.45,\n",
            "                                   'start': 63.71875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/64.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=4cbebf2ae2857d5735f84ef40ece970e5e1d6b8f0ae76add4a715e1285d76132'},\n",
            "                                  {'end': 60.78125,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.44,\n",
            "                                   'start': 19.375,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/20.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=ce876590de9529086f5f1b835a25e159e21f515b6798a7b38fb88846a725b0c5'},\n",
            "                                  {'end': 263.09375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.42,\n",
            "                                   'start': 185.125,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/186.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=45c81743a531cd2f4c2672664b403b649e82bf587df909c5b4bbe138c6587e6a'},\n",
            "                                  {'end': 607.9375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.41,\n",
            "                                   'start': 513.0729166666666,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/514.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=97d1a1eb0b982ef146c83acc9391bd687e3c41453c82fbd05745ada51b8ce39a'},\n",
            "                                  {'end': 848.21875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.37,\n",
            "                                   'start': 611.5625,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/612.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=4f4c0515c15c41a31423f24f78efc8d7405e6857b2c38cb91897ea18ab10611a'},\n",
            "                                  {'end': 764.546875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.34,\n",
            "                                   'start': 674.8125,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/675.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=f3de1c1ebff45345f218d00482cbc4110303a9099433fdd07c09f24739da95f4'},\n",
            "                                  {'end': 182.1875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.31,\n",
            "                                   'start': 123.46875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/124.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=32600746c938320d98b6d15d67e96438fd14ed3092202a1acedea3876c889f96'},\n",
            "                                  {'end': 84,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.27,\n",
            "                                   'start': 74.8125,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/75.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=ae79c0707db3e1d7ea31c4602889cb0c945ad04fde36bafa0130f9929be2f438'},\n",
            "                                  {'end': 60.78125,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.25,\n",
            "                                   'start': 19.375,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/20.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=ce876590de9529086f5f1b835a25e159e21f515b6798a7b38fb88846a725b0c5'},\n",
            "                                  {'end': 368.09375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.25,\n",
            "                                   'start': 268.78125,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/269.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=53c7ef00de0723b0274b82f0642cce89b9921199fd71b2364b36ec5db2cdbd99'},\n",
            "                                  {'end': 409.453125,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.21,\n",
            "                                   'start': 374.765625,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/375.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d6dc4333f82a588efe56aa75c845b1aa2ee6043fcf87f32c92f3fff33b640f98'},\n",
            "                                  {'end': 435.5625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.2,\n",
            "                                   'start': 413.21875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/414.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=8b1f8d234b80ae04db064f76ffbe568da56bc3259882f381923370e19d999ab7'},\n",
            "                                  {'end': 523.09375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.2,\n",
            "                                   'start': 513.0729166666666,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/514.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=97d1a1eb0b982ef146c83acc9391bd687e3c41453c82fbd05745ada51b8ce39a'},\n",
            "                                  {'end': 667.75,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.16,\n",
            "                                   'start': 611.5625,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/612.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=4f4c0515c15c41a31423f24f78efc8d7405e6857b2c38cb91897ea18ab10611a'},\n",
            "                                  {'end': 510.0625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.11,\n",
            "                                   'start': 459.0625,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/460.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=08d361fbdd358f002ad017134a65c1a15f176c6a5107b2767fd1fe1915976b22'},\n",
            "                                  {'end': 576.53125,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.1,\n",
            "                                   'start': 550.28125,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/551.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=6a62f4dd68249ba8ad4f4659d17eddc099ccc7e8e23c1a08378f07578f08ba2c'},\n",
            "                                  {'end': 547.46875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 82.93,\n",
            "                                   'start': 530.65625,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/531.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=58e8168a3baf263650f94cb138f251d53d549b12ed725fac138c0e3a707aca82'},\n",
            "                                  {'end': 827.6,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 82.1,\n",
            "                                   'start': 806.40625,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/807.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=e0cd09596ea2f2239613b32cc8d7803ba7d61703af0e85e39b8bf7a39c4235bd'},\n",
            "                                  {'end': 455.765625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 81.9,\n",
            "                                   'start': 438.53125,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/439.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=2f8ea2b2b8f6499e7ff319444a5590d50fc02f74de9bf8cfc7af8b92bb91e9df'},\n",
            "                                  {'end': 607.9375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 80.87,\n",
            "                                   'start': 583.125,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/584.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=0f7b8e8280e1d74b33460cf6aad13c10674cdad6c7c551ed82c856d6694c8184'},\n",
            "                                  {'end': 120.4375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'How to improve basketball skills',\n",
            "                                   'score': 78.34,\n",
            "                                   'start': 116,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/117.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=415e3604b71fe80895f14e1c6f1aa2e19bf88e0abaa5428e7f5b763cda2898f0'},\n",
            "                                  {'end': 782.8125,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 75.78,\n",
            "                                   'start': 771.25,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528aa5243e8c47e4eb47e66/772.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d0c89b0de02495815acdae1315bc03f78e5c83ab85637aff5272b3c1368b5410'}],\n",
            "                        'duration_ratio': 0.95,\n",
            "                        'name': 'Basketball',\n",
            "                        'score': 94.18}],\n",
            "           'video_id': '6528aa5243e8c47e4eb47e66'},\n",
            "          {'classes': [{'clips': [{'end': 145.0625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.97,\n",
            "                                   'start': 32.65625,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/33.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=1826de6d3b0c05663ba1f6df99e46c0eca32f44c7e5686fc914a796e3de9c07c'},\n",
            "                                  {'end': 377.8125,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.74,\n",
            "                                   'start': 297.1875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/298.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=1cba162b422c087735bcea6fdc35553db6a38ef170946273600b2bc6e6d77dd3'},\n",
            "                                  {'end': 293.625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.7,\n",
            "                                   'start': 256.625,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/257.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d1df1ccc0d2bf5e508b6b1d7c886519f66eeabee8317597c2690a69976843525'},\n",
            "                                  {'end': 187.5,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.69,\n",
            "                                   'start': 152.375,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/153.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=ce79d98d8a80c0aa6f129ebe79d70a8826bac8c9ea4406958009dd5f90ae34f7'},\n",
            "                                  {'end': 108.21875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.57,\n",
            "                                   'start': 85.75,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/86.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=9ecce4e3936f97f8afc93e2ee101be87009d451858f48110cadbd4458176d3eb'},\n",
            "                                  {'end': 199.1875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.54,\n",
            "                                   'start': 192.25,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/193.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=c442a44b9b6ce4755e8d5b51e14ff3b9e945650446454cd913c4dafd54c00395'},\n",
            "                                  {'end': 442.40625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.53,\n",
            "                                   'start': 400.53125,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/401.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=eb9e02483bd43db358172342822fe1735bb292f12d1669e89c87d9fc34fa3612'},\n",
            "                                  {'end': 428.5,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.53,\n",
            "                                   'start': 400.53125,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/401.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=eb9e02483bd43db358172342822fe1735bb292f12d1669e89c87d9fc34fa3612'},\n",
            "                                  {'end': 391.96875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.36,\n",
            "                                   'start': 383.96875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/384.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=366de9dea3548c3f4cb5ef1ff26fea597006a0a22602d556aad3d34edbaefe4f'},\n",
            "                                  {'end': 199.1875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.3,\n",
            "                                   'start': 192.25,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/193.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=c442a44b9b6ce4755e8d5b51e14ff3b9e945650446454cd913c4dafd54c00395'},\n",
            "                                  {'end': 167.09375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.21,\n",
            "                                   'start': 152.375,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/153.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=ce79d98d8a80c0aa6f129ebe79d70a8826bac8c9ea4406958009dd5f90ae34f7'},\n",
            "                                  {'end': 213,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.21,\n",
            "                                   'start': 201.5625,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/202.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=91b6c4474c5af5bb097947205a1701bd62cae2a39fcc21b0a4110780a5b5b6b1'},\n",
            "                                  {'end': 85.75,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.15,\n",
            "                                   'start': 71.46875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/72.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=135d7ab87663befc57a84cb0914ce0c77e582f098ce3b902d244530fa603cd09'},\n",
            "                                  {'end': 293.625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.15,\n",
            "                                   'start': 266.546875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/267.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=142907480bf775099adf1922d254613ba071483f5d0fb7fcf36a6bef3883f446'},\n",
            "                                  {'end': 370.46875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.07,\n",
            "                                   'start': 332.75,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/333.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=2a0a59cb98743e69a595c369f0fcc688268e556319f9ebf87a0aa2cfe70d4d30'},\n",
            "                                  {'end': 53.09375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 82.89,\n",
            "                                   'start': 32.65625,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/33.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=1826de6d3b0c05663ba1f6df99e46c0eca32f44c7e5686fc914a796e3de9c07c'},\n",
            "                                  {'end': 187.5,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 82.66,\n",
            "                                   'start': 169.671875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/170.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=305ad5528f1be879eeed7d337ec602a525aaa846cbff7ec7e2f01ec2ee1769bc'},\n",
            "                                  {'end': 391.96875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 82.26,\n",
            "                                   'start': 383.96875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/384.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=366de9dea3548c3f4cb5ef1ff26fea597006a0a22602d556aad3d34edbaefe4f'},\n",
            "                                  {'end': 62.6875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 82.22,\n",
            "                                   'start': 57.34375,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/58.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=adb20b7ce6192b82e99d88bac1ebe0a575238e7fcf3b28c248d9774ca68c237e'},\n",
            "                                  {'end': 213,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 82.17,\n",
            "                                   'start': 207.9375,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/208.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=91971e7fd4d12b6ba12c0caf108b8ac083a6db34fd4fce18a5bda5e2194884a9'},\n",
            "                                  {'end': 442.40625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 81.17,\n",
            "                                   'start': 435.125,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/436.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=266de3ee5cb54f9820d0fc919fa35725e367ea09fbdc715ae7ce0888e2100117'},\n",
            "                                  {'end': 139.1875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 80.67,\n",
            "                                   'start': 131.5,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/132.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=fdd98e1bee158d6afd5f33f2be2043b3ab36b24bec5b9aa59643a3965f8651b5'},\n",
            "                                  {'end': 256.625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 79.52,\n",
            "                                   'start': 253.0625,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/254.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=c347cca5a95e11810a778736f6b17a51297049df1f294b24f9b3bd5dda72442e'},\n",
            "                                  {'end': 129.421875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 79.2,\n",
            "                                   'start': 108.21875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/109.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=8e1ed127485a3db69599658574437d7c053736c1893d054d4f0e62571f5b3199'},\n",
            "                                  {'end': 320.046875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 79.12,\n",
            "                                   'start': 304.75,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/305.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=53f61aa5a262e0199dd0012f00737b0c4c6146270ff4a3966c3ba690ae805bb9'},\n",
            "                                  {'end': 264.1875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 75.95,\n",
            "                                   'start': 256.625,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/257.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d1df1ccc0d2bf5e508b6b1d7c886519f66eeabee8317597c2690a69976843525'},\n",
            "                                  {'end': 431.8125,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 75.42,\n",
            "                                   'start': 428.5,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527e63943e8c47e4eb47e17/429.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=19a644fd22f5d5019e29064a09a6fb217cf57c71a5a52e24d7373eabc10ea933'}],\n",
            "                        'duration_ratio': 0.72,\n",
            "                        'name': 'Basketball',\n",
            "                        'score': 92.67}],\n",
            "           'video_id': '6527e63943e8c47e4eb47e17'},\n",
            "          {'classes': [{'clips': [{'end': 74.8125,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.89,\n",
            "                                   'start': 60.84375,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9b543e8c47e4eb47e61/61.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=ec2d2e224664c2dc1a2374c89e4577cd9eb2d5d3f4d4868294405939295f4888'},\n",
            "                                  {'end': 229.78125,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.57,\n",
            "                                   'start': 158.84375,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9b543e8c47e4eb47e61/159.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=9c6acc8db4be0952d88432c3227e3b0a8592349faf2bb28d32b8e4ffb2680ff4'},\n",
            "                                  {'end': 262.25,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.56,\n",
            "                                   'start': 237.5,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9b543e8c47e4eb47e61/238.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=bdec8a77f48dfa74cd1c89a3909986e5436316dd56ccaa7f246fe8d34e6d0579'},\n",
            "                                  {'end': 392.28125,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.55,\n",
            "                                   'start': 360.875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9b543e8c47e4eb47e61/361.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d0be062c5ff05e5d4c0cd8e63a182f30049d8cc529698ebde18209b23e1b29e2'},\n",
            "                                  {'end': 158.84375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.4,\n",
            "                                   'start': 110.5625,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9b543e8c47e4eb47e61/111.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=3db1e4ef31ffd7e445c203a690c075a82f1f962f67891eb61a13824ee4e3b745'},\n",
            "                                  {'end': 50.9375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.37,\n",
            "                                   'start': 0,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9b543e8c47e4eb47e61/1.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=b3d30e438c482642a028f09ec7a08d37969194b4c360bf35463052fc7e3082e5'},\n",
            "                                  {'end': 465.625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.36,\n",
            "                                   'start': 447.46875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9b543e8c47e4eb47e61/448.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d8be313c3535281d056c861dd938869ce4a02b33a10102cf2b4ab0b271a78add'},\n",
            "                                  {'end': 347.625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.34,\n",
            "                                   'start': 283.46875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9b543e8c47e4eb47e61/284.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=8a9cb9240106d71638fa8a2f4a8b41f42016e99a0aceeeee55a8754abf3faabb'},\n",
            "                                  {'end': 107.125,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.28,\n",
            "                                   'start': 92,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9b543e8c47e4eb47e61/93.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=a271f57cdcb100092dca0845881a52e91523293becc1ac92afda5bcd22e440ce'},\n",
            "                                  {'end': 437.84375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 83.26,\n",
            "                                   'start': 407.09375,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9b543e8c47e4eb47e61/408.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=3cb44e07bc402ffb757921a3bfe4a31ba235cc85fbc9c42af739e1f409c98959'},\n",
            "                                  {'end': 68.375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 83.07,\n",
            "                                   'start': 60.84375,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9b543e8c47e4eb47e61/61.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=ec2d2e224664c2dc1a2374c89e4577cd9eb2d5d3f4d4868294405939295f4888'},\n",
            "                                  {'end': 96,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Best basketball shoes',\n",
            "                                   'score': 80.75,\n",
            "                                   'start': 88.3125,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9b543e8c47e4eb47e61/89.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=ddde242cf1cd64789d07ea372412c6e08e06ff8137d3195b4e5ad3b0bb5b7933'},\n",
            "                                  {'end': 388.6640625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Basic basketball rules',\n",
            "                                   'score': 77.8,\n",
            "                                   'start': 381.046875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9b543e8c47e4eb47e61/382.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=601236ce4ed88e0ca76eaaf05a693b9a6c5ba333c31c357aefee2c52922b39cc'},\n",
            "                                  {'end': 77.25,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Playing basketball',\n",
            "                                   'score': 75.06,\n",
            "                                   'start': 74.8125,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6528a9b543e8c47e4eb47e61/75.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T140128Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=affbce914a92d22dca6b7e97439e636ca951a90332c1711ff71aacef366e3b6a'}],\n",
            "                        'duration_ratio': 0.58,\n",
            "                        'name': 'Basketball',\n",
            "                        'score': 88.71}],\n",
            "           'video_id': '6528a9b543e8c47e4eb47e61'}],\n",
            " 'page_info': {'limit_per_page': 10,\n",
            "               'next_page_token': '',\n",
            "               'page_expired_at': '2023-10-13T14:06:28Z',\n",
            "               'prev_page_token': '',\n",
            "               'total_results': 3}}\n"
          ]
        }
      ],
      "source": [
        "# Construct the URL of the `/classify/bulk` endpoint\n",
        "CLASSIFY_BULK_URL = f\"{API_URL}/classify/bulk\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data =  {\n",
        "  \"options\": [\n",
        "        \"visual\",\n",
        "        \"conversation\",\n",
        "        \"text_in_video\"\n",
        "  ],\n",
        "  \"index_id\": INDEX_ID,\n",
        "  \"include_clips\": True,\n",
        "  \"classes\": [\n",
        "        {\n",
        "            \"name\": \"Basketball\",\n",
        "            \"prompts\": [\n",
        "                \"Playing basketball\",\n",
        "                \"How to improve basketball skills\",\n",
        "                \"Basic basketball rules\",\n",
        "                \"Best basketball shoes\"\n",
        "            ]\n",
        "        }\n",
        "  ],\n",
        "  \"threshold\": {\n",
        "        \"min_video_score\": 80,  # Minimum video score is 80\n",
        "        \"min_duration_ratio\": 0.5  # Minimum duration ratio is 50%\n",
        "  }\n",
        "}\n",
        "\n",
        "# Make a classification request\n",
        "response = requests.post(CLASSIFY_BULK_URL, headers=headers, json=data)\n",
        "print (f'Status code: {response.status_code}')\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "bF6hzOM_lmGZ"
      },
      "source": [
        "In the example output above, note that, for each video, the API service returns an array named `clips` containing detailed information about a single matching video fragment.\n",
        "\n",
        "### Classifying a video based on multiple classes\n",
        "\n",
        "The following example code classifies the content of your videos based on two classes - `DanceTok` and `CookTok`:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 18,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "tGrp5ldymSxf",
        "outputId": "0a49e7c6-80ca-4c25-9784-6a0c94d9afd2"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': [{'classes': [{'duration_ratio': 0.99,\n",
            "                        'name': 'American Football',\n",
            "                        'score': 100}],\n",
            "           'video_id': '6528a97243e8c47e4eb47e5e'},\n",
            "          {'classes': [{'duration_ratio': 0.99,\n",
            "                        'name': 'American Football',\n",
            "                        'score': 100}],\n",
            "           'video_id': '6528aa1443e8c47e4eb47e64'},\n",
            "          {'classes': [{'duration_ratio': 0.94,\n",
            "                        'name': 'Basketball',\n",
            "                        'score': 100}],\n",
            "           'video_id': '6528a9b543e8c47e4eb47e61'},\n",
            "          {'classes': [{'duration_ratio': 0.9,\n",
            "                        'name': 'Basketball',\n",
            "                        'score': 100}],\n",
            "           'video_id': '6528aa4743e8c47e4eb47e65'},\n",
            "          {'classes': [{'duration_ratio': 0.99,\n",
            "                        'name': 'American Football',\n",
            "                        'score': 96.23},\n",
            "                       {'duration_ratio': 0.76,\n",
            "                        'name': 'Baseball',\n",
            "                        'score': 90.78}],\n",
            "           'video_id': '6528121643e8c47e4eb47e3b'},\n",
            "          {'classes': [{'duration_ratio': 0.93,\n",
            "                        'name': 'Basketball',\n",
            "                        'score': 95.1}],\n",
            "           'video_id': '6527e63943e8c47e4eb47e17'},\n",
            "          {'classes': [{'duration_ratio': 0.99,\n",
            "                        'name': 'Basketball',\n",
            "                        'score': 94.91}],\n",
            "           'video_id': '6528aa5243e8c47e4eb47e66'},\n",
            "          {'classes': [{'duration_ratio': 0.84,\n",
            "                        'name': 'Baseball',\n",
            "                        'score': 90.15}],\n",
            "           'video_id': '6528121b43e8c47e4eb47e3f'}],\n",
            " 'page_info': {'limit_per_page': 8,\n",
            "               'next_page_token': '',\n",
            "               'page_expired_at': '2023-10-13T14:10:09Z',\n",
            "               'prev_page_token': '',\n",
            "               'total_results': 8}}\n"
          ]
        }
      ],
      "source": [
        "# Construct the URL of the `/classify/bulk` endpoint\n",
        "CLASSIFY_BULK_URL = f\"{API_URL}/classify/bulk\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data =  {\n",
        "  \"options\": [\n",
        "        \"visual\",\n",
        "        \"conversation\",\n",
        "        \"text_in_video\"\n",
        "  ],\n",
        "  \"index_id\": INDEX_ID,\n",
        "  \"classes\": [\n",
        "        {\n",
        "            \"name\": \"Basketball\",\n",
        "            \"prompts\": [\n",
        "                \"Playing Basketball\",\n",
        "                \"How to improve basketball skills\",\n",
        "                \"Basic basketball rules\",\n",
        "                \"NBA\"\n",
        "            ]\n",
        "        },\n",
        "        {\n",
        "            \"name\": \"Baseball\",\n",
        "            \"prompts\": [\n",
        "                \"Playing Baseball\",\n",
        "                \"MLB\",\n",
        "                \"Pitcher\"\n",
        "            ]\n",
        "        },\n",
        "        {\n",
        "            \"name\": \"Soccer\",\n",
        "            \"prompts\": [\n",
        "                \"Playing Soccer\",\n",
        "                \"Scoring goals\"\n",
        "            ]\n",
        "        },\n",
        "        {\n",
        "            \"name\": \"American Football\",\n",
        "            \"prompts\": [\n",
        "                \"Playing American Football\",\n",
        "                \"Quaterback\",\n",
        "                \"Touchdown\",\n",
        "                \"NFL\",\n",
        "                \"Super Bowl\"\n",
        "            ]\n",
        "        },\n",
        "        {\n",
        "            \"name\": \"Golf\",\n",
        "            \"prompts\": [\n",
        "                \"Playing Golf\"\n",
        "            ]\n",
        "        }\n",
        "  ],\n",
        "  \"threshold\": {\n",
        "        \"min_video_score\": 80,\n",
        "        \"min_duration_ratio\": 0.5\n",
        "  }\n",
        "}\n",
        "\n",
        "# Make a classification request\n",
        "response = requests.post(CLASSIFY_BULK_URL, headers=headers, json=data)\n",
        "print (f'Status code: {response.status_code}')\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "QgY8gyXnnE1w"
      },
      "source": [
        "In the example output above, note that the `data` array contains three objects, each corresponding to a different video. For each video, the response contains information that helps you determine the likelihood that each of the labels you've specified in the request appears in that video.\n",
        "\n",
        "### Retrieving a detailed score for each class\n",
        "\n",
        "The following example code sets the `show_detailed_score` parameter to `true` to specify that the platform should retrieve the maximum score, average score, duration weighted score, and normalized score for each class:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 19,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "bo2cXWD82cv7",
        "outputId": "2713981a-31f4-477f-96d1-2ad35d4cbb91"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': [{'classes': [{'detailed_scores': {'avg_score': 82.76,\n",
            "                                            'max_score': 92.28,\n",
            "                                            'normalized_score': 100},\n",
            "                        'duration_ratio': 0.99,\n",
            "                        'name': 'American Football',\n",
            "                        'score': 100}],\n",
            "           'video_id': '6528a97243e8c47e4eb47e5e'},\n",
            "          {'classes': [{'detailed_scores': {'avg_score': 82.7,\n",
            "                                            'max_score': 92.28,\n",
            "                                            'normalized_score': 100},\n",
            "                        'duration_ratio': 0.99,\n",
            "                        'name': 'American Football',\n",
            "                        'score': 100}],\n",
            "           'video_id': '6528aa1443e8c47e4eb47e64'},\n",
            "          {'classes': [{'detailed_scores': {'avg_score': 84.91,\n",
            "                                            'max_score': 92.28,\n",
            "                                            'normalized_score': 100},\n",
            "                        'duration_ratio': 0.9,\n",
            "                        'name': 'Basketball',\n",
            "                        'score': 100}],\n",
            "           'video_id': '6528aa4743e8c47e4eb47e65'},\n",
            "          {'classes': [{'detailed_scores': {'avg_score': 86,\n",
            "                                            'max_score': 92.28,\n",
            "                                            'normalized_score': 100},\n",
            "                        'duration_ratio': 0.94,\n",
            "                        'name': 'Basketball',\n",
            "                        'score': 100}],\n",
            "           'video_id': '6528a9b543e8c47e4eb47e61'},\n",
            "          {'classes': [{'detailed_scores': {'avg_score': 82.72,\n",
            "                                            'max_score': 85.76,\n",
            "                                            'normalized_score': 51.45714132934067},\n",
            "                        'duration_ratio': 0.99,\n",
            "                        'name': 'American Football',\n",
            "                        'score': 96.23},\n",
            "                       {'detailed_scores': {'avg_score': 79.65,\n",
            "                                            'max_score': 83.2,\n",
            "                                            'normalized_score': 48.54285867065932},\n",
            "                        'duration_ratio': 0.76,\n",
            "                        'name': 'Baseball',\n",
            "                        'score': 90.78}],\n",
            "           'video_id': '6528121643e8c47e4eb47e3b'},\n",
            "          {'classes': [{'detailed_scores': {'avg_score': 82.49,\n",
            "                                            'max_score': 84.49,\n",
            "                                            'normalized_score': 100},\n",
            "                        'duration_ratio': 0.93,\n",
            "                        'name': 'Basketball',\n",
            "                        'score': 95.1}],\n",
            "           'video_id': '6527e63943e8c47e4eb47e17'},\n",
            "          {'classes': [{'detailed_scores': {'avg_score': 82.32,\n",
            "                                            'max_score': 84.28,\n",
            "                                            'normalized_score': 100},\n",
            "                        'duration_ratio': 0.99,\n",
            "                        'name': 'Basketball',\n",
            "                        'score': 94.91}],\n",
            "           'video_id': '6528aa5243e8c47e4eb47e66'},\n",
            "          {'classes': [{'detailed_scores': {'avg_score': 77.76,\n",
            "                                            'max_score': 80.89,\n",
            "                                            'normalized_score': 100},\n",
            "                        'duration_ratio': 0.84,\n",
            "                        'name': 'Baseball',\n",
            "                        'score': 90.15}],\n",
            "           'video_id': '6528121b43e8c47e4eb47e3f'}],\n",
            " 'page_info': {'limit_per_page': 8,\n",
            "               'next_page_token': '',\n",
            "               'page_expired_at': '2023-10-13T14:11:16Z',\n",
            "               'prev_page_token': '',\n",
            "               'total_results': 8}}\n"
          ]
        }
      ],
      "source": [
        "# Construct the URL of the `/classify/bulk` endpoint\n",
        "CLASSIFY_BULK_URL = f\"{API_URL}/classify/bulk\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data =  {\n",
        "  \"options\": [\n",
        "        \"visual\",\n",
        "        \"conversation\",\n",
        "        \"text_in_video\"\n",
        "  ],\n",
        "  \"index_id\": INDEX_ID,\n",
        "  \"show_detailed_score\": True,\n",
        "  \"classes\": [\n",
        "        {\n",
        "            \"name\": \"Basketball\",\n",
        "            \"prompts\": [\n",
        "                \"Playing Basketball\",\n",
        "                \"How to improve basketball skills\",\n",
        "                \"Basic basketball rules\",\n",
        "                \"NBA\"\n",
        "            ]\n",
        "        },\n",
        "        {\n",
        "            \"name\": \"Baseball\",\n",
        "            \"prompts\": [\n",
        "                \"Playing Baseball\",\n",
        "                \"MLB\",\n",
        "                \"Pitcher\"\n",
        "            ]\n",
        "        },\n",
        "        {\n",
        "            \"name\": \"Soccer\",\n",
        "            \"prompts\": [\n",
        "                \"Playing Soccer\",\n",
        "                \"Scoring goals\"\n",
        "            ]\n",
        "        },\n",
        "        {\n",
        "            \"name\": \"American Football\",\n",
        "            \"prompts\": [\n",
        "                \"Playing American Football\",\n",
        "                \"Quaterback\",\n",
        "                \"Touchdown\",\n",
        "                \"NFL\",\n",
        "                \"Super Bowl\"\n",
        "            ]\n",
        "        },\n",
        "        {\n",
        "            \"name\": \"Golf\",\n",
        "            \"prompts\": [\n",
        "                \"Playing Golf\"\n",
        "            ]\n",
        "        }\n",
        "  ],\n",
        "  \"threshold\": {\n",
        "        \"min_video_score\": 80,\n",
        "        \"min_duration_ratio\": 0.5\n",
        "  }\n",
        "}\n",
        "\n",
        "# Make a classification request\n",
        "response = requests.post(CLASSIFY_BULK_URL, headers=headers, json=data)\n",
        "print (f'Status code: {response.status_code}')\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "3E9b76L0wD1f"
      },
      "source": [
        "## 5 - Generate API\n",
        "The Generate API suite creates concise textual representations such as titles, summaries, chapters, and highlights for your videos, to name as a few. Unlike conventional models limited to unimodal interpretations (for example, summary videos relying solely on video transcription), the Generate API suite uses a multimodal approach that analyzes the whole context of a video, including visuals, sounds, spoken words, and texts and their relationship with one another. This ensures a holistic understanding of your videos, capturing nuances that an unimodal interpretation might miss. And then, using video-to-text generative capabilities, our model can turn that understanding into actual text format of your choice.\n",
        "\n",
        "The Generate API suite offers three distinct endpoints tailored to meet various requirements for creating concise textual representations from videos. Each endpoint has been designed with specific levels of flexibility and customization to accommodate different needs.\n",
        "\n",
        "**1 - The `/gist` endpoint**\n",
        "\n",
        "- **Function**: Generates topics, titles, and hashtags.\n",
        "- **Customization**: Uses predefined templates.\n",
        "- **Prompt **: No.\n",
        "- **Best use**: To generate an immediate and straightforward text representation without specific customization.\n",
        "\n",
        "**2 - The `/summarize` endpoint**\n",
        "\n",
        "- **Function**: Generates summaries, chapters, and highlights.\n",
        "- **Customization**: Operates primarily on predefined templates, similar to `/gist`. However, you can provide a custom prompt that guides the model on how to generate the output.\n",
        "- **Prompt**: Optional. While you can invoke this endpoint without a prompt, providing one allows for tailored outputs.\n",
        "- **Best use:** To balance the efficiency of built-in templates and bespoke customization abilities.\n",
        "\n",
        "**3 - The `/generate` endpoint**\n",
        "\n",
        "- **Function**: Generates open-ended text representations from videos.\n",
        "- **Customization**: Relies solely on user-defined prompts, ensuring maximum flexibility.\n",
        "- **Prompt**: Required. You must provide clear instructions to guide the model.\n",
        "- **Best use**: Ideal for advanced users with specific output requirements beyond the built-in templates.\n"
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "# Specify the unique identifier of this existing video ('Italy WINS Euro 2020 on PENALTIES vs. England! | Highlights | ESPN FC')\n",
        "%env VIDEO_ID=6528a99a43e8c47e4eb47e5f"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "XwUHg4qDAd4D",
        "outputId": "f248d36d-fbcf-460a-f693-6953f4f81e60"
      },
      "execution_count": 20,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "env: VIDEO_ID=6528a99a43e8c47e4eb47e5f\n"
          ]
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "# Retrieve the unique identifier of the existing video\n",
        "VIDEO_ID = os.getenv(\"VIDEO_ID\")\n",
        "print (VIDEO_ID)\n",
        "assert VIDEO_ID"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "Hc1wY3A3Audj",
        "outputId": "e0af49a5-1d58-49f3-a25a-b0060a3c4c00"
      },
      "execution_count": 21,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "6528a99a43e8c47e4eb47e5f\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "To demonstrate the Generate API, let's work with this video: [Italy WINS Euro 2020 on PENALTIES vs. England! | Highlights | ESPN FC](https://youtu.be/nhY1s6CZziE?si=CyTUSc3nv4XeDnNG)"
      ],
      "metadata": {
        "id": "eZK1V88FYFkp"
      }
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "8G_u7-emIseC"
      },
      "source": [
        "### 5.1 - Generate titles, topics, and hashtags\n",
        "Use the `/gist` endpoint if you require a swift breakdown of the essence of your videos. This endpoint operates exclusively on a set of predefined templates to generate the following concise and accurate textual representations:\n",
        "\n",
        "- **Title**: Distills the essence of a video into a brief, coherent phrase, facilitating quick understanding and categorization. For example, a title like \"From Consumerism to Minimalism: A Journey Toward Sustainable Living\" clearly indicates the video's narrative trajectory,  emphasizing themes related to consumption patterns and sustainable lifestyles.\n",
        "- **Topic**: Represents the central themes or subjects of a video and provides a high-level understanding based on the meaning conveyed by all modalities. Topics enable effective categorization and quick referencing. For example, \"Shopping Vlog Lifestyle\" denotes a video covering aspects related to shopping experiences, vlogging, and the associated lifestyle.\n",
        "- **Hashtag**: Concisely summarizes the themes, subjects, or sentiments expressed within a video. Hashtags improve categorization and searchability on social media platforms. For example, hashtags such as `#BlackFriday,` `#ShoppingMania,` and `#Consumerism` indicate key focal points in a video, potentially related to shopping events, consumer behaviors, or broader commentary on consumption patterns.\n",
        "\n",
        "Handling this set of predefined tasks offers a streamlined approach to obtaining concise textual representations, essential for rapid content understanding and categorization."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "M0aONOTLM4O2"
      },
      "source": [
        "The following example generates a title, topic, and hashtag for the specified video:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 22,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "2hXru2ujzFp5",
        "outputId": "4824ca35-6776-4223-841f-94726ff0bd45"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'hashtags': ['England vs Italy',\n",
            "              'rivalry',\n",
            "              'football match',\n",
            "              'historic rivalry',\n",
            "              'goal',\n",
            "              'back post',\n",
            "              'early strike',\n",
            "              'Harry Kane',\n",
            "              'skillful pass',\n",
            "              'overlapping run',\n",
            "              'exciting play',\n",
            "              'intense soccer match',\n",
            "              'on the edge of their seats',\n",
            "              'crucial moment',\n",
            "              'penalty kick',\n",
            "              'free kick',\n",
            "              'yellow card',\n",
            "              'tie game',\n",
            "              'goalkeeper',\n",
            "              'strategic play',\n",
            "              'break through defense',\n",
            "              'thrilling match',\n",
            "              'corner kick',\n",
            "              'level the game',\n",
            "              'tie game',\n",
            "              'critical moment',\n",
            "              'pressure on England',\n",
            "              'anxious supporters',\n",
            "              'crucial goal',\n",
            "              'victory',\n",
            "              'penalty shootout',\n",
            "              'heartbreaking loss',\n",
            "              'emotional moment.'],\n",
            " 'id': '4cb8edf3-327d-4b67-b6a0-eb095e18a7b2',\n",
            " 'title': 'Thrilling Rivalry: England vs Italy in a Historic Football Showdown',\n",
            " 'topics': ['Football']}\n"
          ]
        }
      ],
      "source": [
        "# Define the /gist endpoint\n",
        "GIST_URL = f\"{API_URL}/gist\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "  \"video_id\": VIDEO_ID,\n",
        "  \"types\": [\"title\", \"topic\", \"hashtag\"]\n",
        "}\n",
        "\n",
        "# Make a gist request\n",
        "response = requests.post(GIST_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "fJ201R6-DezM"
      },
      "source": [
        "### 5.2 - Generate summaries, chapters, and highlights\n",
        "Use the `/summarize` endpoint if you want to utilize pre-defined templates for general summarization tasks and, optionally, provide a prompt to customize the output. This endpoint generates the following textual representations:\n",
        "\n",
        "- **Summaries**:  The platform returns a brief that encapsulates the key points of a video, presenting the most important information clearly and concisely. Depending on your prompt, a summary can take various forms, such as a single paragraph, a series of paragraphs, an email, or a structured list of bullet points. For example, a summary highlighting Black Friday events might include a description of a crowded mall, key commentary by a news reporter on consumer behavior, and individual perspectives on societal values associated with consumption.\n",
        "- **Chapters**: The platform returns a chronological list of all the segments in a video, providing a granular breakdown of its content. For each chapter, the platform returns its starting and end times, measured in seconds from the beginning of the video segment, a descriptive headline that offers a brief of the events or activities within that segment, and an accompanying summary that elaborates on the headline. For example, the first chapter of a stand-up comedy might describe the comedian's entrance and the first joke. The accompanying summary could delve into the content, detailing the comedian's humorous take on a specific subject, such as the cultural nuances of Tai Chi exercises.\n",
        "- **Highlights**: The platform returns a chronologically ordered list of the most important events within a video. Unlike chapters, highlights only capture the key moments, providing a snapshot of the video's main topics. For each highlight, the platform returns its starting and end times, measured in seconds from the beginning of the video, and a brief description that captures the essence of the segment. For example, a highlight might capture a significant event like a bank heist in a video with multiple scenes."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "AM1Qd39MPCAo"
      },
      "source": [
        "The following example code generates a summary for the specified video:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 23,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "Gn2RMdjuny_f",
        "outputId": "6ee518d1-ecc7-4e14-8e5c-bfec1e5879d2"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'id': 'deac88ef-9c4e-45ef-b64c-5b72c63fe8d5',\n",
            " 'summary': 'The most anticipated match in football history takes place '\n",
            "            'between England and Italy, two teams with a historic rivalry. The '\n",
            "            'game starts with an early goal by Trippier from Team England, '\n",
            "            \"giving them the lead. England's star player, Harry Kane, plays a \"\n",
            "            'crucial role in their fantastic start. The intensity rises as a '\n",
            "            'skillful pass allows Kyle Walker to score a goal, creating an '\n",
            "            'exciting and impactful play. Amidst the nail-biting action, an '\n",
            "            'Italian player takes a powerful shot but narrowly misses the '\n",
            "            'target. As the match progresses, both teams display their skills '\n",
            "            'and strategy, resulting in a thrilling and intense atmosphere. '\n",
            "            'Italy scores a critical goal through a penalty kick, breaking the '\n",
            "            'tie, but England quickly responds with a goal from a free kick. '\n",
            "            'The game reaches a crucial moment when an Italian player takes '\n",
            "            'another penalty shot, leaving spectators on the edge of their '\n",
            "            'seats. The drama continues as both teams fight for victory, '\n",
            "            'showcasing their determination and tactical play. Ultimately, the '\n",
            "            'match concludes with a penalty shootout, with Italy emerging as '\n",
            "            'the winner. The heart-wrenching defeat leaves England fans '\n",
            "            'devastated, while Italy celebrates their hard-fought victory. The '\n",
            "            'intense gameplay and emotional rollercoaster make this football '\n",
            "            'match one for the books.'}\n"
          ]
        }
      ],
      "source": [
        "# Define the /summarize endpoint\n",
        "SUMMARIZE_URL = f\"{API_URL}/summarize\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "  \"video_id\": VIDEO_ID,\n",
        "  \"type\": \"summary\"\n",
        "}\n",
        "\n",
        "# Make a summarization request\n",
        "response = requests.post(SUMMARIZE_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "7CYf7KKBPWSi"
      },
      "source": [
        "Optionally, you can use the `prompt` field to provide context for the summarization task. The following example specifies the purpose and the desired length:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 24,
      "metadata": {
        "id": "r_go51_bPbLY",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "684f9921-3db2-445d-91b5-831c48584030"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'id': 'e539a644-ac1b-49e7-b266-faf36f941b8a',\n",
            " 'summary': 'In an intense football match between England and Italy, both '\n",
            "            'teams show great skill and determination. Trippier scores an '\n",
            "            'early goal for England, followed by a skillful pass from a '\n",
            "            'teammate to Kyle Walker resulting in another goal. However, Italy '\n",
            "            'fights back with a penalty kick and a goal from a corner kick. '\n",
            "            'The match goes into a penalty shootout, with Italy ultimately '\n",
            "            'emerging as the victors.'}\n"
          ]
        }
      ],
      "source": [
        "# Define the /summarize endpoint\n",
        "SUMMARIZE_URL = f\"{API_URL}/summarize\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "  \"video_id\": VIDEO_ID,\n",
        "  \"type\": \"summary\",\n",
        "  \"prompt\": \"Generate a summary of this video for a sports commentary segment, up to three sentences.\"\n",
        "}\n",
        "\n",
        "# Make a summarization request\n",
        "response = requests.post(SUMMARIZE_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "NVvS8QrsPnPU"
      },
      "source": [
        "The following example generates a list of chapters for the specified video:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 25,
      "metadata": {
        "id": "KS3KRyXDPpHK",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "7c0ac168-f39a-4ccd-b352-bcca1f1e04ec"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'chapters': [{'chapter_number': 0,\n",
            "               'chapter_summary': 'The most anticipated match in football '\n",
            "                                  'history pits England against Italy, two '\n",
            "                                  'teams with a historic rivalry.',\n",
            "               'chapter_title': 'The Most Anticipated Match',\n",
            "               'end': 75,\n",
            "               'start': 0},\n",
            "              {'chapter_number': 1,\n",
            "               'chapter_summary': \"England's Trippier scores an early goal, \"\n",
            "                                  'followed by a skillful pass allowing Kyle '\n",
            "                                  'Walker to score. The game starts with '\n",
            "                                  'excitement and impactful plays.',\n",
            "               'chapter_title': 'Early Goals and Skillful Pass',\n",
            "               'end': 150,\n",
            "               'start': 75},\n",
            "              {'chapter_number': 2,\n",
            "               'chapter_summary': 'The match intensifies with goals from '\n",
            "                                  'penalty kicks and a tie game. Spectators '\n",
            "                                  'are on the edge of their seats as the game '\n",
            "                                  'reaches crucial moments.',\n",
            "               'chapter_title': 'Intense Gameplay and Penalty Kicks',\n",
            "               'end': 405,\n",
            "               'start': 150},\n",
            "              {'chapter_number': 3,\n",
            "               'chapter_summary': 'Pickford executes a brilliant save, while '\n",
            "                                  'England takes the lead with a magnificent '\n",
            "                                  'penalty. The momentum changes as the game '\n",
            "                                  'becomes more thrilling.',\n",
            "               'chapter_title': 'Crucial Saves and Magnificent Penalty',\n",
            "               'end': 495,\n",
            "               'start': 405},\n",
            "              {'chapter_number': 4,\n",
            "               'chapter_summary': 'Saka is in tears as Italy celebrates their '\n",
            "                                  'victory in a penalty shootout. The intense '\n",
            "                                  'match ends with heartbreak for England and '\n",
            "                                  'a stunning victory for Italy.',\n",
            "               'chapter_title': 'Emotional Moments and Stunning Victory',\n",
            "               'end': 570,\n",
            "               'start': 495}],\n",
            " 'id': '5effa8f5-75b3-46c4-b85f-1db1d9fd7bcb'}\n"
          ]
        }
      ],
      "source": [
        "# Define the /summarize endpoint\n",
        "SUMMARIZE_URL = f\"{API_URL}/summarize\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "  \"video_id\": VIDEO_ID,\n",
        "  \"type\": \"chapter\"\n",
        "}\n",
        "\n",
        "# Make a summarization request\n",
        "response = requests.post(SUMMARIZE_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "uJsEMtxQPxqS"
      },
      "source": [
        "Optionally, you can use the `prompt` parameter to indicate that the tone of voice should be thrilling and enthusiastic:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 26,
      "metadata": {
        "id": "IEpeMHGaPzUE",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "38a388e8-ab6f-41c2-9c2c-941ff5dbaef2"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'chapters': [{'chapter_number': 0,\n",
            "               'chapter_summary': 'The most anticipated match in football '\n",
            "                                  'history pits England against Italy, two '\n",
            "                                  'teams with a historic rivalry. The game '\n",
            "                                  'starts with an early goal by Trippier from '\n",
            "                                  'Team England, giving them the lead. '\n",
            "                                  \"England's star player, Harry Kane, plays a \"\n",
            "                                  'crucial role in their fantastic start. The '\n",
            "                                  'intensity rises as a skillful pass allows '\n",
            "                                  'Kyle Walker to score a goal, creating an '\n",
            "                                  'exciting and impactful play. Amidst the '\n",
            "                                  'nail-biting action, an Italian player takes '\n",
            "                                  'a powerful shot but narrowly misses the '\n",
            "                                  'target.',\n",
            "               'chapter_title': 'The Most Anticipated Match',\n",
            "               'end': 75,\n",
            "               'start': 0},\n",
            "              {'chapter_number': 1,\n",
            "               'chapter_summary': 'Both teams display their skills and '\n",
            "                                  'strategy, resulting in a thrilling and '\n",
            "                                  'intense atmosphere. Italy scores a critical '\n",
            "                                  'goal through a penalty kick, breaking the '\n",
            "                                  'tie, but England quickly responds with a '\n",
            "                                  'goal from a free kick. The game reaches a '\n",
            "                                  'crucial moment when an Italian player takes '\n",
            "                                  'another penalty shot, leaving spectators on '\n",
            "                                  'the edge of their seats. The drama '\n",
            "                                  'continues as both teams fight for victory, '\n",
            "                                  'showcasing their determination and tactical '\n",
            "                                  'play.',\n",
            "               'chapter_title': 'Intense Gameplay and Exciting Moments',\n",
            "               'end': 150,\n",
            "               'start': 75},\n",
            "              {'chapter_number': 2,\n",
            "               'chapter_summary': 'The intense soccer match between England '\n",
            "                                  'and Italy reaches a crucial moment as an '\n",
            "                                  'Italian player scores a goal, with '\n",
            "                                  'spectators on the edge of their seats. The '\n",
            "                                  'Italian goalkeeper is left devastated after '\n",
            "                                  'failing to save a shot from the English '\n",
            "                                  'team, resulting in a tie game. In a '\n",
            "                                  'football match between two teams, the '\n",
            "                                  'player in white jerseys scores a goal with '\n",
            "                                  'a header, followed by some attempts by the '\n",
            "                                  'opponent defender to block but fails. Italy '\n",
            "                                  'extends their lead with an impressive goal '\n",
            "                                  'against England in a football match.',\n",
            "               'chapter_title': 'Tense Moments and Key Plays',\n",
            "               'end': 285,\n",
            "               'start': 150},\n",
            "              {'chapter_number': 3,\n",
            "               'chapter_summary': 'Italy puts pressure on England as the score '\n",
            "                                  'remains tied at 1-1, making the England '\n",
            "                                  'supporters anxious. Italy scores a goal to '\n",
            "                                  'level the game during a corner kick in a '\n",
            "                                  'thrilling Italy vs. England soccer match. A '\n",
            "                                  'player from the blue jersey team deflects a '\n",
            "                                  'ball and scores it in the goal post of the '\n",
            "                                  'opposing team. England takes the lead with '\n",
            "                                  'a magnificent penalty, securing a 2-1 '\n",
            "                                  'score. Donnarumma makes a crucial save for '\n",
            "                                  'Italy, keeping them in the game.',\n",
            "               'chapter_title': 'Tensions Rise and Game Changing Moments',\n",
            "               'end': 435,\n",
            "               'start': 285},\n",
            "              {'chapter_number': 4,\n",
            "               'chapter_summary': 'The crucial moment arrives as Marcus '\n",
            "                                  'Rashford and Jadon Sancho step up to take '\n",
            "                                  'penalty shots in the last minute of extra '\n",
            "                                  'time in the Italy vs England football '\n",
            "                                  'match. However, both players miss their '\n",
            "                                  'shots, allowing Italy to secure the '\n",
            "                                  'European title. The video captures the '\n",
            "                                  \"emotional moment when England's player, \"\n",
            "                                  'Saka, is in tears. Italy celebrates their '\n",
            "                                  'victory in a penalty shootout against '\n",
            "                                  'England at Wembley. The heart-wrenching '\n",
            "                                  'defeat leaves England fans devastated, '\n",
            "                                  'while Italy celebrates their hard-fought '\n",
            "                                  'victory.',\n",
            "               'chapter_title': 'Penalty Shootout and Emotional Rollercoaster',\n",
            "               'end': 570,\n",
            "               'start': 435}],\n",
            " 'id': '2ff5a8c9-8d58-4b38-8b67-0c1816fc8a11'}\n"
          ]
        }
      ],
      "source": [
        "# Define the /summarize endpoint\n",
        "SUMMARIZE_URL = f\"{API_URL}/summarize\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "  \"video_id\": VIDEO_ID,\n",
        "  \"type\": \"chapter\",\n",
        "  \"prompt\": \"Generate chapters using thrilling and enthusiastic language.\"\n",
        "}\n",
        "\n",
        "# Make a summarization request\n",
        "response = requests.post(SUMMARIZE_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "flUhM8kSP7CQ"
      },
      "source": [
        "The following example generates a list of the important events or activities within a video:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 27,
      "metadata": {
        "id": "3fRtWUmqP7db",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "e0d76cd5-c59e-406d-96df-e78d80013565"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'highlights': [{'end': 60,\n",
            "                 'highlight': 'A player from Team England, Trippier, scores a '\n",
            "                              'goal by kicking the ball towards the back post. '\n",
            "                              'This early strike gives England the lead.',\n",
            "                 'highlight_summary': 'An early goal by Trippier gives England '\n",
            "                                      'the lead.',\n",
            "                 'start': 15},\n",
            "                {'end': 105,\n",
            "                 'highlight': 'In a huge moment, a player from the white team '\n",
            "                              'makes a skillful pass to his teammate, allowing '\n",
            "                              'for an overlapping run by Kyle Walker. There is '\n",
            "                              'no pressure on the ball, and the pass is '\n",
            "                              'executed perfectly. The teammate receives the '\n",
            "                              'ball with a dink over the top and scores a '\n",
            "                              'goal, resulting in an exciting and impactful '\n",
            "                              'play.',\n",
            "                 'highlight_summary': 'A skillful pass leads to an overlapping '\n",
            "                                      'run and a well-executed goal.',\n",
            "                 'start': 45},\n",
            "                {'end': 420,\n",
            "                 'highlight': 'England takes the lead with a magnificent '\n",
            "                              'penalty, securing a 2-1 score.',\n",
            "                 'highlight_summary': 'England goes ahead with a brilliant '\n",
            "                                      'penalty.',\n",
            "                 'start': 240}],\n",
            " 'id': '0d328e44-2c08-4c2f-9a1d-ea789a616a57'}\n"
          ]
        }
      ],
      "source": [
        "# Define the /summarize endpoint\n",
        "SUMMARIZE_URL = f\"{API_URL}/summarize\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "  \"video_id\": VIDEO_ID,\n",
        "  \"type\": \"highlight\"\n",
        "}\n",
        "\n",
        "# Make a summarization request\n",
        "response = requests.post(SUMMARIZE_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "L9idbrj8QBwD"
      },
      "source": [
        "Optionally, you can use the `prompt` parameter to generate highlights for the same video, showcasing the most emotional parts:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 28,
      "metadata": {
        "id": "g4azaGnUQDr4",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "7488c587-89f5-44a1-e090-271c20ef9c25"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'highlights': [{'end': 465,\n",
            "                 'highlight': 'Player from Team Italy scores a goal, putting '\n",
            "                              'Italy ahead.',\n",
            "                 'highlight_summary': 'Italy takes the lead with a crucial '\n",
            "                                      'goal.',\n",
            "                 'start': 435},\n",
            "                {'end': 495,\n",
            "                 'highlight': 'In this thrilling football match between '\n",
            "                              'England and Italy, the score is tied at 1-1.',\n",
            "                 'highlight_summary': 'After an amazing save by Pickford, the '\n",
            "                                      'crowd is in disbelief.',\n",
            "                 'start': 480},\n",
            "                {'end': 525,\n",
            "                 'highlight': 'Italy celebrates their victory in a penalty '\n",
            "                              'shootout against England at Wembley.',\n",
            "                 'highlight_summary': 'Italy celebrates their victory in a '\n",
            "                                      'penalty shootout.',\n",
            "                 'start': 510}],\n",
            " 'id': 'c34083eb-af9f-44ad-85f9-e0e7a27a52ad'}\n"
          ]
        }
      ],
      "source": [
        "# Define the /summarize endpoint\n",
        "SUMMARIZE_URL = f\"{API_URL}/summarize\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "  \"video_id\": VIDEO_ID,\n",
        "  \"type\": \"highlight\",\n",
        "  \"prompt\": \"Generate highlights that showcase the most emotional parts of the video.\"\n",
        "}\n",
        "\n",
        "# Make a summarization request\n",
        "response = requests.post(SUMMARIZE_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "oUn2t1Oa4JI3"
      },
      "source": [
        "### 5.3 - Generate open-ended textual representations\n",
        "Use the `/generate` endpoint for open-ended textual representations that are more customizable and tailor-made than the templates offered by the `/gist` and `/summarize` endpoints. This endpoint can produce a diverse range of textual representations based on your prompt, including, but not limited to, tables of content, action items, memos, reports and comprehensive analyses.\n",
        "\n",
        "The following example generates brief summary with a specific format:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 30,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "YV4bfITL4Nke",
        "outputId": "1686b79c-1b36-4a72-b34f-90251480a601"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': 'Title of the video: \"Intense Football Match: England vs Italy - '\n",
            "         'Highlights and Winner Celebration\"\\n'\n",
            "         '\\n'\n",
            "         'Summary: This video captures the excitement of an intense football '\n",
            "         'match between England and Italy. Both teams, clad in their '\n",
            "         'respective white and blue jerseys, showcase their skills and '\n",
            "         'determination. The match is characterized by thrilling goals, close '\n",
            "         'saves, and moments of celebration. In the end, Italy emerges as the '\n",
            "         'victor, leading to jubilant celebrations from the Italian team and '\n",
            "         'their fans.',\n",
            " 'id': '330348ec-6e12-44cd-a0fa-a665839ec981'}\n"
          ]
        }
      ],
      "source": [
        "# Define the /generate endpoint\n",
        "GENERATE_URL = f\"{API_URL}/generate\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "  \"video_id\": VIDEO_ID,\n",
        "  \"prompt\": \"I want to generate a description for my video with the following format: Title of the video, followed by a summary in 2-3 sentences, highlighting the main topic, key events, and concluding remarks.\"\n",
        "}\n",
        "\n",
        "# Make a generation request\n",
        "response = requests.post(GENERATE_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "kuMxEBx1Q4_k"
      },
      "source": [
        "The following example generates a rap song based on the provided template:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 31,
      "metadata": {
        "id": "2j9F1N6xQ7Ax",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "0522268c-7a1f-4abb-b8b8-c6d6c9b87cef"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': '(Verse 1)\\n'\n",
            "         \"Yo, check it out, the crowd's gone wild,\\n\"\n",
            "         \"Eng vs Italy, it's a battle on the field,\\n\"\n",
            "         'In white and blue jerseys, they clash for real,\\n'\n",
            "         \"The commentator's voice, they all wanna hear.\\n\"\n",
            "         '\\n'\n",
            "         'A player from England, he makes his move,\\n'\n",
            "         'Dribbles past defenders, with skills smooth,\\n'\n",
            "         'Scores a goal, the crowd erupts in cheer,\\n'\n",
            "         \"Trippier's the hero, in the second-half premiere.\\n\"\n",
            "         '\\n'\n",
            "         '(Chorus)\\n'\n",
            "         'In the video, you can feel the energy,\\n'\n",
            "         \"The passion, the game, it's a sight to see,\\n\"\n",
            "         'England vs Italy, football at its best,\\n'\n",
            "         'The tension, the drama, it puts us to the test.\\n'\n",
            "         '\\n'\n",
            "         '(Verse 2)\\n'\n",
            "         'But hold up, Italy strikes back with might,\\n'\n",
            "         'Barella and Chiesa, showing their fight,\\n'\n",
            "         'With 10 minutes remaining, they equalize,\\n'\n",
            "         'The score is tied at 2-2, they mesmerize.\\n'\n",
            "         '\\n'\n",
            "         'The stadium roars, as players give their all,\\n'\n",
            "         'Both teams push forward, answering the call,\\n'\n",
            "         'A white-jerseyed player, he takes the stage,\\n'\n",
            "         'Scores a powerful shot, unleashing his rage.\\n'\n",
            "         '\\n'\n",
            "         '(Chorus)\\n'\n",
            "         'In the video, you can feel the energy,\\n'\n",
            "         \"The passion, the game, it's a sight to see,\\n\"\n",
            "         'England vs Italy, football at its best,\\n'\n",
            "         'The tension, the drama, it puts us to the test.\\n'\n",
            "         '\\n'\n",
            "         '(Bridge)\\n'\n",
            "         'From Italy to England, the battle rages on,\\n'\n",
            "         'Tactics and skills, they bring the dawn,\\n'\n",
            "         \"The referee's whistle, the yellow cards fly,\\n\"\n",
            "         \"Unsportsmanlike conduct, they can't deny.\\n\"\n",
            "         '\\n'\n",
            "         '(Verse 3)\\n'\n",
            "         'With the score tied at 1-1, tensions rise,\\n'\n",
            "         \"Pickford's save, it's a moment to prize,\\n\"\n",
            "         \"But Italy's relentless, they're on the attack,\\n\"\n",
            "         'Bonucci scrambles the ball, finds the back.\\n'\n",
            "         '\\n'\n",
            "         'The clock ticks away, the pressure intensifies,\\n'\n",
            "         \"Extra time, penalties, it's a rollercoaster ride,\\n\"\n",
            "         \"Rashford and Sancho miss, England's dream fades,\\n\"\n",
            "         'Italy claims the title, victory cascades.\\n'\n",
            "         '\\n'\n",
            "         '(Chorus)\\n'\n",
            "         'In the video, you can feel the energy,\\n'\n",
            "         \"The passion, the game, it's a sight to see,\\n\"\n",
            "         'England vs Italy, football at its best,\\n'\n",
            "         'The tension, the drama, it puts us to the test.\\n'\n",
            "         '\\n'\n",
            "         '(Outro)\\n'\n",
            "         \"So let's raise our voices, celebrate the game,\\n\"\n",
            "         'Football unites us, no matter the fame,\\n'\n",
            "         'England and Italy, they left it all on the field,\\n'\n",
            "         'In this epic battle, their legacy is sealed.',\n",
            " 'id': '1e8a848a-ecb9-4436-b542-4daf6d674b4a'}\n"
          ]
        }
      ],
      "source": [
        "# Define the /generate endpoint\n",
        "GENERATE_URL = f\"{API_URL}/generate\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "  \"video_id\": VIDEO_ID,\n",
        "  \"prompt\": \"Write a rap song based on this video.\"\n",
        "}\n",
        "\n",
        "# Make a generation request\n",
        "response = requests.post(GENERATE_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "Have fun playing around with the Twelve Labs API!🚀"
      ],
      "metadata": {
        "id": "ChjhkRsaZkPV"
      }
    }
  ],
  "metadata": {
    "colab": {
      "provenance": [],
      "toc_visible": true
    },
    "kernelspec": {
      "display_name": "Python 3",
      "name": "python3"
    },
    "language_info": {
      "name": "python"
    }
  },
  "nbformat": 4,
  "nbformat_minor": 0
}