Twelve_Labs_API_Ads_Demo.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "oT_AjsAurpIR"
      },
      "source": [
        "Twelve Labs Video Understanding Platform, currently in beta, offers an API suite for integrating a state-of-the-art (“SOTA”) foundation model that understands contextual information from your videos, making it accessible to your applications. The API is organized around REST and is compatible with most programming languages. You can also use Postman or other REST clients to send requests and view responses.\n",
        "\n",
        "The following diagram illustrates the architecture of the Twelve Labs Video Understanding Platform and how different parts interact:\n",
        "\n",
        "![](https://files.readme.io/5fb7a80-image.png)\n",
        "\n",
        "## 1 - Setup and Requirements\n",
        "The Twelve Labs Video Understanding API is currently in open beta. Before you begin, [sign up](https://api.twelvelabs.io) for a free account, or if you already have one, [sign in](https://api.twelvelabs.io).\n",
        "\n",
        "You will receive a signup code that you can use to create an account. Once you have created an account, you can access the API Dashboard.\n",
        "\n",
        "This demo will use an existing account. To make calls to the API, you need your secret key and specify the URL of the API. You can use environment variables to pass configuration to your application."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "ydgqdioXpkq1",
        "outputId": "765c1fe4-d079-489f-e366-5afa47e70f07"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "env: API_KEY=tlk_0BKG1ZQ08FCHV92X59YZG3NR7T1Q\n",
            "env: API_URL=https://api.twelvelabs.io/p/v1.2\n"
          ]
        }
      ],
      "source": [
        "# Specify the API key and the URL of the API\n",
        "%env API_KEY=tlk_0BKG1ZQ08FCHV92X59YZG3NR7T1Q\n",
        "%env API_URL=https://api.twelvelabs.io/p/v1.2"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "31isfodVuYPx"
      },
      "source": [
        "The next step is to install the required package."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "RpJCQ42RuxFF",
        "outputId": "9d6b7f71-0ccb-47cc-9065-3832bf5d33b9"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (2.31.0)\n",
            "Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests) (3.3.0)\n",
            "Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests) (3.4)\n",
            "Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests) (2.0.6)\n",
            "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests) (2023.7.22)\n"
          ]
        }
      ],
      "source": [
        "!pip install requests"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "XgLXWW74u59S"
      },
      "source": [
        "You want to import the required Python packages and retrieve the API key as well as the API URL."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 2,
      "metadata": {
        "id": "GW9vRq7NuycH"
      },
      "outputs": [],
      "source": [
        "# Import the required packages\n",
        "import requests\n",
        "import glob\n",
        "from pprint import pprint\n",
        "import os"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "jpAEIBMavBZv"
      },
      "outputs": [],
      "source": [
        "# Retrieve the URL of the API and my API key\n",
        "API_URL = os.getenv(\"API_URL\")\n",
        "assert API_URL\n",
        "\n",
        "API_KEY = os.getenv(\"API_KEY\")\n",
        "assert API_KEY"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "zUkH6-QZuZ6Y"
      },
      "source": [
        "## 2 - Index API\n",
        "The next step is to [create a video index](https://docs.twelvelabs.io/v1.2/docs/create-indexes). An index groups one or more video vectors and is the most granular level at which you can perform a search."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "dHHc7mOEvaUS"
      },
      "source": [
        "### 2.1 - Create An Index\n",
        "An index is a basic unit to organize and store your video data (video embeddings and metadata) to facilitate information retrieval and processing.\n",
        "\n",
        "You can use indexes to group related videos. For example, if you want to upload multiple videos from a car race, Twelve Labs recommends you create a single index and upload all the videos to it. Then, to find a specific moment in that race, you call the /search endpoint once, passing it the unique identifier of the index.\n",
        "\n",
        "When creating a new index, you must specify the following information:\n",
        "\n",
        "*   **Name**: Use a brief and descriptive name to facilitate future reference and management.\n",
        "*   **Engine configuration**: Provide a list containing the [video understanding engines](https://docs.twelvelabs.io/v1.2/docs/video-understanding-engines) and the associated [engine options](https://docs.twelvelabs.io/v1.2/docs/indexing-options) you want to enable.\n",
        "\n",
        "#### Video Understanding Engines\n",
        "Twelve Labs' video understanding engines consist of a family of deep neural networks built on our multimodal foundation model for video understanding that you can use for the following downstream tasks:\n",
        "\n",
        "*   Search using natural language queries\n",
        "*   Zero-shot classification\n",
        "*   Generate concise textual representations\n",
        "\n",
        "Twelve Labs provides two distinct engine types - embedding and generative, each serving unique purposes in multimodal video understanding.\n",
        "*   **Embedding engines**: These engines are proficient at performing tasks such as search and classification, enabling enhanced video understanding. We recommend choosing Marengo2.5.\n",
        "*   **Generative engines**: These engines specialize in generating concise textual representations for video. We recommend choosing Pegasus1.0.\n",
        "\n",
        "#### Engine Options\n",
        "\n",
        "Engine options indicate the types of information a video understanding engine will process. When creating a new index, you must specify the engines and the associated engines options that you want to enable.\n",
        "\n",
        "The following engine options are available:\n",
        "\n",
        "*   **visual**: This option allows you to analyze video content as you would see and hear from it, including actions, objects, sounds, and events, and excluding human speech.\n",
        "*   **conversation**: This option allows you to analyze human speech within your videos.\n",
        "*   **text_in_video**: This option allows you to detect and extract text (OCR) shown within your videos.\n",
        "*   **logo**: This option allows you to identify the presence of brand logos within your videos."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "ZSmhDwX-wtUR",
        "outputId": "3f94af81-758e-482e-af8c-d59ad7f0dc1a"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Status code: 201\n",
            "{'_id': '6528dde58f9cd95a98cbd075'}\n"
          ]
        }
      ],
      "source": [
        "# Construct the URL of the `/indexes` endpoint\n",
        "INDEXES_URL = f\"{API_URL}/indexes\"\n",
        "\n",
        "# Specify the name of the index\n",
        "INDEX_NAME = \"Ads Videos\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named data\n",
        "data = {\n",
        "  \"engines\": [\n",
        "    {\n",
        "      \"engine_name\": \"marengo2.5\",  # Configure the video understanding engine\n",
        "      \"engine_options\": [\"visual\", \"conversation\", \"text_in_video\", \"logo\"]  # Specify the engine options\n",
        "    },\n",
        "    {\n",
        "      \"engine_name\": \"pegasus1\",  # Configure the video understanding engine\n",
        "      \"engine_options\": [\"visual\", \"conversation\"]  # Specify the engine options\n",
        "    }\n",
        "  ],\n",
        "  \"index_name\": INDEX_NAME,\n",
        "  \"addons\": [\"thumbnail\"]  # Enable the thumbnail generation feature\n",
        "}\n",
        "\n",
        "# Create an index\n",
        "response = requests.post(INDEXES_URL, headers=headers, json=data)\n",
        "\n",
        "# Store the unique identifier of your index\n",
        "INDEX_ID = response.json().get('_id')\n",
        "\n",
        "# Print the status code and response\n",
        "print(f'Status code: {response.status_code}')\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "cgGpRwEMyeQ6"
      },
      "source": [
        "### 2.2 - Upload A Video\n",
        "Once you've created an index, you can upload a video. When the video has finished uploading, the API service will automatically create a rich set of vectors containing all the information it needs to perform fast, semantic, accurate, and scalable searches.\n",
        "\n",
        "For this demo, we will work with sports videos. The video resolution must be greater or equal than 360p and less or equal than 4K.\n",
        "\n",
        "Below, we show how to upload a video file from YouTube: [NEW Heineken Commercial - verry funny](https://youtu.be/S1ZZreXEqSY?si=oKfCYqoJ1t8BfkZZ)\n",
        "\n",
        "The API service will retrieve the file directly from the specified URL, so your application doesn't have to store the video locally and upload the bytes. Our platform currently supports only YouTube as an external provider, but we will add support for additional providers in the future."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "D3ob1vEEbdGV",
        "outputId": "e76f7a35-0529-4a99-da59-acce1bfcfecd"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Status code: 201\n",
            "{'_id': '6528dded8f9cd95a98cbd076'}\n"
          ]
        }
      ],
      "source": [
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare the /tasks/external-provider endpoint\n",
        "TASKS_URL = f\"{API_URL}/tasks/external-provider\"\n",
        "\n",
        "# Construct the body of the request\n",
        "data = {\n",
        "    \"index_id\": INDEX_ID,  # Specify the unique ID of the index\n",
        "    \"url\": \"https://youtu.be/S1ZZreXEqSY?si=oKfCYqoJ1t8BfkZZ\",  # Specify the YouTube URL of the video\n",
        "}\n",
        "\n",
        "# Upload the video\n",
        "response = requests.post(TASKS_URL, headers=headers, json=data)\n",
        "\n",
        "# Store the ID of the task in a variable named TASK_ID\n",
        "TASK_ID = response.json().get(\"_id\")\n",
        "\n",
        "# Print the status code and response\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "n7kjB-kq3d5C"
      },
      "source": [
        "The API service must have finished indexing the video before it becomes searchable. You can use the `GET` method of the `/tasks/{_id}` endpoint to monitor the indexing process. Construct the URL for monitoring the indexing process based on the `TASK_ID` variable you’ve declared in the previous step, and wait until the status shows as `ready`:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "background_save": true,
          "base_uri": "https://localhost:8080/"
        },
        "id": "cYuL6V3L3b-T",
        "outputId": "a9263ff8-f214-4711-e93d-ca83f5cb3bd6"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Start uploading video\n",
            "Status code: ready\n",
            "Finish uploading video\n",
            "Time elapsed (in seconds):  3066.5430154800415\n"
          ]
        }
      ],
      "source": [
        "import time\n",
        "\n",
        "# Define starting time\n",
        "start = time.time()\n",
        "print(\"Start uploading video\")\n",
        "\n",
        "# Monitor the indexing process\n",
        "TASK_STATUS_URL = f\"{API_URL}/tasks/{TASK_ID}\"\n",
        "while True:\n",
        "    response = requests.get(TASK_STATUS_URL, headers=headers)\n",
        "    STATUS = response.json().get(\"status\")\n",
        "    if STATUS == \"ready\":\n",
        "        print(f\"Status code: {STATUS}\")\n",
        "        break\n",
        "    time.sleep(10)\n",
        "\n",
        "# Define ending time\n",
        "end = time.time()\n",
        "print(\"Finish uploading video\")\n",
        "print(\"Time elapsed (in seconds): \", end - start)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "background_save": true
        },
        "id": "xdZsX_Fh5Fcq",
        "outputId": "932c85bd-2a6f-4d26-a24c-a0fb2828e62c"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "VIDEO ID: 6528ddf943e8c47e4eb47e9d\n",
            "{'_id': '6528dded8f9cd95a98cbd076',\n",
            " 'created_at': '2023-10-13T06:04:29.454Z',\n",
            " 'estimated_time': '2023-10-13T06:49:43.885Z',\n",
            " 'hls': {'status': 'COMPLETE',\n",
            "         'thumbnail_urls': ['https://deuqpmn4rs7j5.cloudfront.net/63f9601b8e079b9c96f4a52e/6528dded8f9cd95a98cbd076/thumbnails/0c425430-ecd6-45cc-8ac9-4eac0dfbd822.0000001.jpg'],\n",
            "         'updated_at': '2023-10-13T06:04:54.733Z',\n",
            "         'video_url': 'https://deuqpmn4rs7j5.cloudfront.net/63f9601b8e079b9c96f4a52e/6528dded8f9cd95a98cbd076/stream/0c425430-ecd6-45cc-8ac9-4eac0dfbd822.m3u8'},\n",
            " 'index_id': '6528dde58f9cd95a98cbd075',\n",
            " 'metadata': {'duration': 32,\n",
            "              'filename': 'NEW Heineken Commercial - verry funny',\n",
            "              'height': 354,\n",
            "              'width': 640},\n",
            " 'status': 'ready',\n",
            " 'type': 'index_task_info',\n",
            " 'updated_at': '2023-10-13T06:55:41.655Z',\n",
            " 'video_id': '6528ddf943e8c47e4eb47e9d'}\n"
          ]
        }
      ],
      "source": [
        "# Retrieve the unique identifier of the video\n",
        "VIDEO_ID = response.json().get('video_id')\n",
        "\n",
        "# Print the status code, the unique identifier of the video, and the response\n",
        "print(f\"VIDEO ID: {VIDEO_ID}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "Note that the 1.2 version of the API is in beta, and videos can take longer to upload and process when using the Pegasus video understanding engine.\n",
        "\n",
        "For the purpose of this demo, let's use a sample account with sample indexes that has been preloaded with videos. These indexes have been processed with both the Marengo 2.5 and the Pegasus 1.0 engines."
      ],
      "metadata": {
        "id": "lktF-_p7cYr2"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "# Specify the API key and the API URL of the sample account\n",
        "%env API_KEY=tlk_2K9E0BB2W5TJY227437G62VR1617\n",
        "%env API_URL=https://api.twelvelabs.io/v1.2"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "5spPa-Zmca3R",
        "outputId": "1c0a9ac7-2632-4743-b183-a75b4d7717c5"
      },
      "execution_count": 3,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "env: API_KEY=tlk_2K9E0BB2W5TJY227437G62VR1617\n",
            "env: API_URL=https://api.twelvelabs.io/v1.2\n"
          ]
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "# Retrieve the new API URL and the new API key\n",
        "API_URL = os.getenv(\"API_URL\")\n",
        "assert API_URL\n",
        "\n",
        "API_KEY = os.getenv(\"API_KEY\")\n",
        "assert API_KEY"
      ],
      "metadata": {
        "id": "mM_DTsIqcbdY"
      },
      "execution_count": 4,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "tm6cSWWruuc-"
      },
      "source": [
        "### 2.3 - List Indexes\n",
        "Let's return a list of the indexes in this account. The API returns indexes sorted by creation date, with the oldest indexes at the top of the list."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 5,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "oqzlUiGTu6E1",
        "outputId": "0eeea097-7fdc-431a-ab4f-adb74d68f676"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': [{'_id': '64373b0cc1cb7a672614563e',\n",
            "           'addons': ['thumbnail'],\n",
            "           'created_at': '2023-04-12T23:13:16.365Z',\n",
            "           'engines': [{'engine_name': 'marengo2.5',\n",
            "                        'engine_options': ['visual',\n",
            "                                           'conversation',\n",
            "                                           'text_in_video',\n",
            "                                           'logo']}],\n",
            "           'expires_at': None,\n",
            "           'index_name': 'Some videos for starters 😁',\n",
            "           'total_duration': 35194.141905,\n",
            "           'updated_at': '2023-05-04T06:58:51.026Z',\n",
            "           'video_count': 178},\n",
            "          {'_id': '652793eb23c1347ffbe3a398',\n",
            "           'addons': ['thumbnail'],\n",
            "           'created_at': '2023-10-12T06:36:27.542Z',\n",
            "           'engines': [{'engine_name': 'marengo2.5',\n",
            "                        'engine_options': ['visual',\n",
            "                                           'conversation',\n",
            "                                           'text_in_video']},\n",
            "                       {'engine_name': 'pegasus1',\n",
            "                        'engine_options': ['visual', 'conversation']}],\n",
            "           'expires_at': '2024-01-10T06:36:27.542Z',\n",
            "           'index_name': 'Ads',\n",
            "           'total_duration': 3247,\n",
            "           'updated_at': '2023-10-12T11:11:27.733Z',\n",
            "           'video_count': 33},\n",
            "          {'_id': '6527d89074b5a5ab84015cca',\n",
            "           'addons': ['thumbnail'],\n",
            "           'created_at': '2023-10-12T11:29:20.055Z',\n",
            "           'engines': [{'engine_name': 'marengo2.5',\n",
            "                        'engine_options': ['visual',\n",
            "                                           'conversation',\n",
            "                                           'text_in_video',\n",
            "                                           'logo']},\n",
            "                       {'engine_name': 'pegasus1',\n",
            "                        'engine_options': ['visual', 'conversation']}],\n",
            "           'expires_at': '2024-01-10T11:29:20.055Z',\n",
            "           'index_name': 'Security',\n",
            "           'total_duration': 4648,\n",
            "           'updated_at': '2023-10-12T12:23:56.326Z',\n",
            "           'video_count': 26},\n",
            "          {'_id': '6527e0ab74b5a5ab84015ce2',\n",
            "           'addons': ['thumbnail'],\n",
            "           'created_at': '2023-10-12T12:03:55.772Z',\n",
            "           'engines': [{'engine_name': 'marengo2.5',\n",
            "                        'engine_options': ['visual',\n",
            "                                           'conversation',\n",
            "                                           'text_in_video',\n",
            "                                           'logo']},\n",
            "                       {'engine_name': 'pegasus1',\n",
            "                        'engine_options': ['visual', 'conversation']}],\n",
            "           'expires_at': '2024-01-10T12:03:55.772Z',\n",
            "           'index_name': 'Sports',\n",
            "           'total_duration': 11497,\n",
            "           'updated_at': '2023-10-13T02:24:18.089Z',\n",
            "           'video_count': 24},\n",
            "          {'_id': '6527e59e74b5a5ab84015cf5',\n",
            "           'addons': ['thumbnail'],\n",
            "           'created_at': '2023-10-12T12:25:02.918Z',\n",
            "           'engines': [{'engine_name': 'marengo2.5',\n",
            "                        'engine_options': ['visual',\n",
            "                                           'conversation',\n",
            "                                           'text_in_video',\n",
            "                                           'logo']},\n",
            "                       {'engine_name': 'pegasus1',\n",
            "                        'engine_options': ['visual', 'conversation']}],\n",
            "           'expires_at': '2024-01-10T12:25:02.918Z',\n",
            "           'index_name': 'E-learning',\n",
            "           'total_duration': 12287,\n",
            "           'updated_at': '2023-10-13T02:18:33.721Z',\n",
            "           'video_count': 28},\n",
            "          {'_id': '6528aaad8f9cd95a98cbcfd2',\n",
            "           'addons': ['thumbnail'],\n",
            "           'created_at': '2023-10-13T02:25:49.174Z',\n",
            "           'engines': [{'engine_name': 'marengo2.5',\n",
            "                        'engine_options': ['visual',\n",
            "                                           'conversation',\n",
            "                                           'text_in_video',\n",
            "                                           'logo']},\n",
            "                       {'engine_name': 'pegasus1',\n",
            "                        'engine_options': ['visual', 'conversation']}],\n",
            "           'expires_at': '2024-01-11T02:25:49.174Z',\n",
            "           'index_name': 'Content Creator',\n",
            "           'total_duration': 14566,\n",
            "           'updated_at': '2023-10-13T08:21:16.371Z',\n",
            "           'video_count': 21}],\n",
            " 'page_info': {'limit_per_page': 10,\n",
            "               'page': 1,\n",
            "               'total_page': 1,\n",
            "               'total_results': 6}}\n"
          ]
        }
      ],
      "source": [
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY,\n",
        "    \"Content-Type\": \"application/json\"\n",
        "}\n",
        "\n",
        "# List indexes\n",
        "url = f\"{API_URL}/indexes?page=1&page_limit=10&sort_by=created_at&sort_option=asc\"\n",
        "\n",
        "response = requests.get(url, headers=headers)\n",
        "print(f'Status code: {response.status_code}')\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "For this demo, let's go with Adss videos."
      ],
      "metadata": {
        "id": "xJlOCtS-cnSv"
      }
    },
    {
      "cell_type": "code",
      "execution_count": 6,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "HSlZg-S_84cX",
        "outputId": "a12096a3-2b40-45a3-dbbe-92bf86bbf607"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "env: INDEX_ID=652793eb23c1347ffbe3a398\n"
          ]
        }
      ],
      "source": [
        "# Specify the unique identifier of the \"Ads\" existing index\n",
        "%env INDEX_ID=652793eb23c1347ffbe3a398"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "SMR6AnEh8tob"
      },
      "source": [
        "### 2.4 - List Videos In An Index\n",
        "Let's list all the videos in this \"Ads\" index for verification."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 7,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "jYGhUdm19FAM",
        "outputId": "0e11732d-1452-4f89-ef6f-15ba2c8d4ba9"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "652793eb23c1347ffbe3a398\n",
            "Status code: 200\n",
            "{'data': [{'_id': '6527d45e43e8c47e4eb47ded',\n",
            "           'created_at': '2023-10-12T11:11:19Z',\n",
            "           'metadata': {'duration': 298,\n",
            "                        'engine_ids': ['marengo2.5', 'pegasus1'],\n",
            "                        'filename': '\"The Pitch\" | 2022 Toyota GR Supra '\n",
            "                                    'Commercial | Toyota',\n",
            "                        'fps': 24,\n",
            "                        'height': 720,\n",
            "                        'size': 34012089,\n",
            "                        'vispresso_index_id': '652793eb73878b24f937773e',\n",
            "                        'width': 1280},\n",
            "           'updated_at': '2023-10-12T11:11:26Z'},\n",
            "          {'_id': '6527d45f43e8c47e4eb47dee',\n",
            "           'created_at': '2023-10-12T11:11:19Z',\n",
            "           'metadata': {'duration': 392,\n",
            "                        'engine_ids': ['marengo2.5', 'pegasus1'],\n",
            "                        'filename': 'Nike: Find Your Greatness',\n",
            "                        'fps': 24,\n",
            "                        'height': 720,\n",
            "                        'size': 34258316,\n",
            "                        'vispresso_index_id': '652793eb73878b24f937773e',\n",
            "                        'width': 1204},\n",
            "           'updated_at': '2023-10-12T11:11:27Z'},\n",
            "          {'_id': '652794bd43e8c47e4eb47d8e',\n",
            "           'created_at': '2023-10-12T06:39:54Z',\n",
            "           'metadata': {'duration': 30,\n",
            "                        'engine_ids': ['marengo2.5', 'pegasus1'],\n",
            "                        'filename': 'Breakroom Ostrich - Doritos Crash the '\n",
            "                                    'Super Bowl',\n",
            "                        'fps': 24,\n",
            "                        'height': 720,\n",
            "                        'size': 1961606,\n",
            "                        'vispresso_index_id': '652793eb73878b24f937773e',\n",
            "                        'width': 1280},\n",
            "           'updated_at': '2023-10-12T06:39:57Z'},\n",
            "          {'_id': '652794b843e8c47e4eb47d8d',\n",
            "           'created_at': '2023-10-12T06:39:49Z',\n",
            "           'metadata': {'duration': 32,\n",
            "                        'engine_ids': ['marengo2.5', 'pegasus1'],\n",
            "                        'filename': 'NEW Heineken Commercial - verry funny',\n",
            "                        'fps': 25,\n",
            "                        'height': 354,\n",
            "                        'size': 1773629,\n",
            "                        'vispresso_index_id': '652793eb73878b24f937773e',\n",
            "                        'width': 640},\n",
            "           'updated_at': '2023-10-12T06:39:52Z'},\n",
            "          {'_id': '652794b343e8c47e4eb47d8b',\n",
            "           'created_at': '2023-10-12T06:39:44Z',\n",
            "           'metadata': {'duration': 62,\n",
            "                        'engine_ids': ['marengo2.5', 'pegasus1'],\n",
            "                        'filename': 'Coca-Cola Happiness Factory',\n",
            "                        'fps': 25,\n",
            "                        'height': 240,\n",
            "                        'size': 0,\n",
            "                        'vispresso_index_id': '652793eb73878b24f937773e',\n",
            "                        'width': 320},\n",
            "           'updated_at': '2023-10-12T06:39:47Z'},\n",
            "          {'_id': '652794aa43e8c47e4eb47d8a',\n",
            "           'created_at': '2023-10-12T06:39:35Z',\n",
            "           'metadata': {'duration': 180,\n",
            "                        'engine_ids': ['marengo2.5', 'pegasus1'],\n",
            "                        'filename': 'Dove Real Beauty Sketches | You’re more '\n",
            "                                    'beautiful than you think (3mins)',\n",
            "                        'fps': 30,\n",
            "                        'height': 720,\n",
            "                        'size': 14346178,\n",
            "                        'vispresso_index_id': '652793eb73878b24f937773e',\n",
            "                        'width': 1280},\n",
            "           'updated_at': '2023-10-12T06:39:38Z'},\n",
            "          {'_id': '652794a543e8c47e4eb47d89',\n",
            "           'created_at': '2023-10-12T06:39:30Z',\n",
            "           'metadata': {'duration': 52,\n",
            "                        'engine_ids': ['pegasus1', 'marengo2.5'],\n",
            "                        'filename': 'Parisian Love',\n",
            "                        'fps': 30,\n",
            "                        'height': 720,\n",
            "                        'size': 3066139,\n",
            "                        'vispresso_index_id': '652793eb73878b24f937773e',\n",
            "                        'width': 1280},\n",
            "           'updated_at': '2023-10-12T06:39:33Z'},\n",
            "          {'_id': '652794a343e8c47e4eb47d88',\n",
            "           'created_at': '2023-10-12T06:39:26Z',\n",
            "           'metadata': {'duration': 74,\n",
            "                        'engine_ids': ['marengo2.5', 'pegasus1'],\n",
            "                        'filename': 'Always #LikeAGirl Campaign Ad: \"Super '\n",
            "                                    'Bowl XLIX\"',\n",
            "                        'fps': 24,\n",
            "                        'height': 720,\n",
            "                        'size': 11527537,\n",
            "                        'vispresso_index_id': '652793eb73878b24f937773e',\n",
            "                        'width': 1280},\n",
            "           'updated_at': '2023-10-12T06:39:31Z'},\n",
            "          {'_id': '6527949c43e8c47e4eb47d87',\n",
            "           'created_at': '2023-10-12T06:39:21Z',\n",
            "           'metadata': {'duration': 91,\n",
            "                        'engine_ids': ['marengo2.5', 'pegasus1'],\n",
            "                        'filename': 'Volkswagen-Darth Vader 2011 Super Bowl '\n",
            "                                    'Commercial',\n",
            "                        'fps': 24,\n",
            "                        'height': 360,\n",
            "                        'size': 2368550,\n",
            "                        'vispresso_index_id': '652793eb73878b24f937773e',\n",
            "                        'width': 640},\n",
            "           'updated_at': '2023-10-12T06:39:24Z'},\n",
            "          {'_id': '6527949943e8c47e4eb47d86',\n",
            "           'created_at': '2023-10-12T06:39:18Z',\n",
            "           'metadata': {'duration': 60,\n",
            "                        'engine_ids': ['marengo2.5', 'pegasus1'],\n",
            "                        'filename': 'Budweiser: Super Bowl XLVIII Puppy Love '\n",
            "                                    '#BudEpicAds',\n",
            "                        'fps': 24,\n",
            "                        'height': 720,\n",
            "                        'size': 7873935,\n",
            "                        'vispresso_index_id': '652793eb73878b24f937773e',\n",
            "                        'width': 1280},\n",
            "           'updated_at': '2023-10-12T06:39:21Z'}],\n",
            " 'page_info': {'limit_per_page': 10,\n",
            "               'page': 1,\n",
            "               'total_duration': 3247,\n",
            "               'total_page': 4,\n",
            "               'total_results': 33}}\n"
          ]
        }
      ],
      "source": [
        "# Retrieve the unique identifier of the existing index\n",
        "INDEX_ID = os.getenv(\"INDEX_ID\")\n",
        "print (INDEX_ID)\n",
        "assert INDEX_ID\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY,\n",
        "    \"Content-Type\": \"application/json\"\n",
        "}\n",
        "\n",
        "# List all the videos in an index\n",
        "INDEXES_VIDEOS_URL = f\"{API_URL}/indexes/{INDEX_ID}/videos\"\n",
        "\n",
        "response = requests.get(INDEXES_VIDEOS_URL, headers=headers)\n",
        "print(f'Status code: {response.status_code}')\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "WIvyhd9qwCPR"
      },
      "source": [
        "## 3 - Search API\n",
        "Twelve Labs provides a holistic understanding of your videos, moving beyond the limitations of relying solely on individual types of data like keywords, metadata, or transcriptions. By simultaneously integrating all available forms of information, including images, sounds, spoken words, and on-screen text, the platform captures the complex relationships among these elements for a more human-like interpretation.\n",
        "\n",
        "Search options specify the source of information the engine uses when performing a search. The following values are supported:\n",
        "\n",
        "*   **visual**: This option allows you to analyze video content as you would see and hear from it, including actions, objects, sounds, and events, and excluding human speech. The following examples are valid search terms: \"birds flying near a castle\", \"sun shining on water\", \"chickens on the road\", \"an officer holding a child's hand.\", \"crowd cheering in the stadium.\"\n",
        "*   **conversation**: This option allows you to analyze human speech within your videos.\n",
        "*   **text_in_video**: This option allows you to detect and extract text (OCR) shown within your videos.\n",
        "*   **logo**: This option allows you to identify the presence of brand logos within your videos."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "GbgqFjaZt7mu"
      },
      "source": [
        "### 3.1 - Visual\n",
        "The platform allows you to analyze video content as you would see and hear from it, including actions, objects, sounds, and events, excluding human speech. The following example sets the value of the `search_options` parameter to  `[\"visual\"]` to search for \"**A man drinks Coca Cola**\" using visual cues:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 8,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "NNvNPU_n-Hqx",
        "outputId": "8bfa23f2-7b50-4ea7-b26a-c7b61d3cc32b"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': [{'confidence': 'high',\n",
            "           'end': 99.78125,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 84.25,\n",
            "           'start': 93.09375,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527941b43e8c47e4eb47d6f/94.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d0abe3660a6c834f9e49836e68a60d5a15c93c742593c1182a02bbc1c53839cf',\n",
            "           'video_id': '6527941b43e8c47e4eb47d6f'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 61.0625,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 83.52,\n",
            "           'start': 50.40625,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794b343e8c47e4eb47d8b/51.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=80930579abd5f3189a56549b19455220ccb0149fb5f285b7286f649f0bf1bd67',\n",
            "           'video_id': '652794b343e8c47e4eb47d8b'},\n",
            "          {'confidence': 'medium',\n",
            "           'end': 93.09375,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 82.56,\n",
            "           'start': 88.375,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527941b43e8c47e4eb47d6f/89.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=88c68a39d9184efdd89a8df0ffbfd570f77721a455c28634041f867e61638ccb',\n",
            "           'video_id': '6527941b43e8c47e4eb47d6f'},\n",
            "          {'confidence': 'low',\n",
            "           'end': 62,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 67.39,\n",
            "           'start': 61.0625,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794b343e8c47e4eb47d8b/62.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=5f02a7d193a082097fdf41183b55fa29b038c88c4dd242901ce84a40f6ac2857',\n",
            "           'video_id': '652794b343e8c47e4eb47d8b'},\n",
            "          {'confidence': 'low',\n",
            "           'end': 88.375,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 57.03,\n",
            "           'start': 84.25,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527941b43e8c47e4eb47d6f/85.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=fe68d01ff3de28e63e2f38f7291128d1371ea512f6c1cec66522960c683407a9',\n",
            "           'video_id': '6527941b43e8c47e4eb47d6f'},\n",
            "          {'confidence': 'low',\n",
            "           'end': 44.125,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 57.01,\n",
            "           'start': 38.28125,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794b343e8c47e4eb47d8b/39.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=3abdff54a6deab622b61da79772130ba52b968ae76d5137ae0655cc0d5ac28de',\n",
            "           'video_id': '652794b343e8c47e4eb47d8b'},\n",
            "          {'confidence': 'low',\n",
            "           'end': 51.84375,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 57,\n",
            "           'start': 39.84375,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527941b43e8c47e4eb47d6f/40.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=7acde30834230809a2917c7db8bc9842dbeee935feb73505044bdaa4521e60ac',\n",
            "           'video_id': '6527941b43e8c47e4eb47d6f'},\n",
            "          {'confidence': 'low',\n",
            "           'end': 73.96875,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 56.38,\n",
            "           'start': 69.90625,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527941843e8c47e4eb47d6e/70.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=f8a24aae51e1f6823fed05c5821e94656441673e6d94b84941772b15a07edf40',\n",
            "           'video_id': '6527941843e8c47e4eb47d6e'},\n",
            "          {'confidence': 'low',\n",
            "           'end': 23.40625,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 55.66,\n",
            "           'start': 17.96875,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794b343e8c47e4eb47d8b/18.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=aeba4c1b619999b8e739f632759de8b9d19fcde75017c42019f604216e4683ff',\n",
            "           'video_id': '652794b343e8c47e4eb47d8b'},\n",
            "          {'confidence': 'low',\n",
            "           'end': 69.90625,\n",
            "           'metadata': [{'type': 'visual'}],\n",
            "           'score': 54.92,\n",
            "           'start': 51.375,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527941843e8c47e4eb47d6e/52.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=171061b02eaa182a5ae550c657e991b48d2b66789df2788307af8b3653abf43a',\n",
            "           'video_id': '6527941843e8c47e4eb47d6e'}],\n",
            " 'page_info': {'limit_per_page': 10,\n",
            "               'next_page_token': '6785b870-66fb-4c0f-a80c-cbf307d2d0f9-1',\n",
            "               'page_expired_at': '2023-10-13T14:33:51Z',\n",
            "               'total_results': 16},\n",
            " 'search_pool': {'index_id': '652793eb23c1347ffbe3a398',\n",
            "                 'total_count': 33,\n",
            "                 'total_duration': 3247}}\n"
          ]
        }
      ],
      "source": [
        "# Construct the URL of the `/search` endpoint\n",
        "SEARCH_URL = f\"{API_URL}/search/\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "query = \"A man drinks Coca Cola\"\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "    \"query\": query,  # Specify your search query\n",
        "    \"index_id\": INDEX_ID,  # Indicate the unique identifier of your index\n",
        "    \"search_options\": [\"visual\"],  # Specify the search options\n",
        "}\n",
        "\n",
        "# Make a search request\n",
        "response = requests.post(SEARCH_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 9,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "id": "HxjRwt6-tlBG",
        "outputId": "712fc135-bcb0-4d4f-a0cb-8549d026b011"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Search Query:  A man drinks Coca Cola\n",
            "Option: Visual\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527941b43e8c47e4eb47d6f/94.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d0abe3660a6c834f9e49836e68a60d5a15c93c742593c1182a02bbc1c53839cf\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 84.25\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794b343e8c47e4eb47d8b/51.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=80930579abd5f3189a56549b19455220ccb0149fb5f285b7286f649f0bf1bd67\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 83.52\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527941b43e8c47e4eb47d6f/89.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=88c68a39d9184efdd89a8df0ffbfd570f77721a455c28634041f867e61638ccb\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: medium\n",
            "Confidence Score: 82.56\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794b343e8c47e4eb47d8b/62.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=5f02a7d193a082097fdf41183b55fa29b038c88c4dd242901ce84a40f6ac2857\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: low\n",
            "Confidence Score: 67.39\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527941b43e8c47e4eb47d6f/85.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=fe68d01ff3de28e63e2f38f7291128d1371ea512f6c1cec66522960c683407a9\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: low\n",
            "Confidence Score: 57.03\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794b343e8c47e4eb47d8b/39.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=3abdff54a6deab622b61da79772130ba52b968ae76d5137ae0655cc0d5ac28de\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: low\n",
            "Confidence Score: 57.01\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527941b43e8c47e4eb47d6f/40.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=7acde30834230809a2917c7db8bc9842dbeee935feb73505044bdaa4521e60ac\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: low\n",
            "Confidence Score: 57\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527941843e8c47e4eb47d6e/70.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=f8a24aae51e1f6823fed05c5821e94656441673e6d94b84941772b15a07edf40\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: low\n",
            "Confidence Score: 56.38\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794b343e8c47e4eb47d8b/18.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=aeba4c1b619999b8e739f632759de8b9d19fcde75017c42019f604216e4683ff\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: low\n",
            "Confidence Score: 55.66\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527941843e8c47e4eb47d6e/52.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143351Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=171061b02eaa182a5ae550c657e991b48d2b66789df2788307af8b3653abf43a\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: low\n",
            "Confidence Score: 54.92\n"
          ]
        }
      ],
      "source": [
        "# Import libraries to display visual in the notebook\n",
        "from IPython.display import display\n",
        "from IPython.display import Image\n",
        "\n",
        "# Display a list of thumbnail URLs of the returning videos\n",
        "res = response.json()\n",
        "print (\"Search Query: \", query)\n",
        "print (\"Option:\", \"Visual\")\n",
        "\n",
        "for item in res[\"data\"]:\n",
        "  display(Image(url=item[\"thumbnail_url\"]))\n",
        "  print(\"Confidence Level:\", item[\"confidence\"])\n",
        "  print(\"Confidence Score:\", item[\"score\"])"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "WxKmySMmAutH"
      },
      "source": [
        "### 3.2 - Conversation\n",
        "The platform allows you to analyze human speech within your videos.\n",
        "The following example sets the value of the `search_options` parameter to `[\"conversation\"]` to perform a semantic search and returns the matches for the specified search term - \"**Throw like a girl**\":"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 10,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "qLVIrR7tBPV0",
        "outputId": "05ec8be5-ebe6-42a1-9fc5-16dfccf8665f"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': [{'confidence': 'high',\n",
            "           'end': 43.599,\n",
            "           'metadata': [{'text': 'Show me what it looks like to run like a '\n",
            "                                 'girl, throw like a girl fight like a girl.',\n",
            "                         'type': 'conversation'}],\n",
            "           'score': 86.38,\n",
            "           'start': 33.22,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a343e8c47e4eb47d88/34.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143654Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=59ddb33319e98aaa7b0db4bc9a67cc3a6b416d36670945f582959a23fbe29859',\n",
            "           'video_id': '652794a343e8c47e4eb47d88'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 24.069,\n",
            "           'metadata': [{'text': 'My hair, show me what it looks like to fight '\n",
            "                                 'like a girl now throw like a girl. A so do '\n",
            "                                 'you think you just insulted your sister?',\n",
            "                         'type': 'conversation'}],\n",
            "           'score': 84.96,\n",
            "           'start': 7.71,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a343e8c47e4eb47d88/8.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143654Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=6b7b6ef89226f037e8ee0d14cd7dedb867f1d6064907e09ae088324c70368da6',\n",
            "           'video_id': '652794a343e8c47e4eb47d88'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 5.38,\n",
            "           'metadata': [{'text': 'Hi, Aaron. Show me what it looks like to run '\n",
            "                                 'like a girl.',\n",
            "                         'type': 'conversation'}],\n",
            "           'score': 83.48,\n",
            "           'start': 0.5,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a343e8c47e4eb47d88/1.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143654Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=3f267b01698bf611d4d81c62265079a1166bafc898abbeff6b5e71f1f2ec613e',\n",
            "           'video_id': '652794a343e8c47e4eb47d88'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 54.31,\n",
            "           'metadata': [{'text': 'What does it mean to you when I say run like '\n",
            "                                 'a girl, I mean, run fast as you can.',\n",
            "                         'type': 'conversation'}],\n",
            "           'score': 83.06,\n",
            "           'start': 47.65,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a343e8c47e4eb47d88/48.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143654Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=082422f51496fb5f58cafac860812702b75f28a13c7188a8b3ab229a27dc21ce',\n",
            "           'video_id': '652794a343e8c47e4eb47d88'}],\n",
            " 'page_info': {'limit_per_page': 10,\n",
            "               'page_expired_at': '2023-10-13T14:36:54Z',\n",
            "               'total_results': 4},\n",
            " 'search_pool': {'index_id': '652793eb23c1347ffbe3a398',\n",
            "                 'total_count': 33,\n",
            "                 'total_duration': 3247}}\n"
          ]
        }
      ],
      "source": [
        "# Construct the URL of the `/search` endpoint\n",
        "SEARCH_URL = f\"{API_URL}/search/\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "query = \"Throw like a girl\"\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "    \"query\": query,  # Specify your search query\n",
        "    \"index_id\": INDEX_ID,  # Indicate the unique identifier of your index\n",
        "    \"search_options\": [\"conversation\"],  # Specify the search options\n",
        "    \"conversation_option\": \"semantic\",  # Specifty the conversation option\n",
        "}\n",
        "\n",
        "# Make a search request\n",
        "response = requests.post(SEARCH_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 11,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "id": "m5r56Sks45nd",
        "outputId": "49827024-bc92-4154-beb8-d325c1ead241"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Search Query:  Throw like a girl\n",
            "Option: Conversation\n",
            "GT Text:  Show me what it looks like to run like a girl, throw like a girl fight like a girl.\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a343e8c47e4eb47d88/34.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143654Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=59ddb33319e98aaa7b0db4bc9a67cc3a6b416d36670945f582959a23fbe29859\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 86.38\n",
            "GT Text:  My hair, show me what it looks like to fight like a girl now throw like a girl. A so do you think you just insulted your sister?\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a343e8c47e4eb47d88/8.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143654Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=6b7b6ef89226f037e8ee0d14cd7dedb867f1d6064907e09ae088324c70368da6\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 84.96\n",
            "GT Text:  Hi, Aaron. Show me what it looks like to run like a girl.\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a343e8c47e4eb47d88/1.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143654Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=3f267b01698bf611d4d81c62265079a1166bafc898abbeff6b5e71f1f2ec613e\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 83.48\n",
            "GT Text:  What does it mean to you when I say run like a girl, I mean, run fast as you can.\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a343e8c47e4eb47d88/48.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143654Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=082422f51496fb5f58cafac860812702b75f28a13c7188a8b3ab229a27dc21ce\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 83.06\n"
          ]
        }
      ],
      "source": [
        "# Display a list of thumbnail URLs of the returning videos\n",
        "res = response.json()\n",
        "print (\"Search Query: \", query)\n",
        "print (\"Option:\", \"Conversation\")\n",
        "\n",
        "for item in res[\"data\"]:\n",
        "  print (\"GT Text: \", item[\"metadata\"][0][\"text\"])\n",
        "  display(Image(url=item[\"thumbnail_url\"]))\n",
        "  print(\"Confidence Level:\", item[\"confidence\"])\n",
        "  print(\"Confidence Score:\", item[\"score\"])"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "qVl9drJYBfun"
      },
      "source": [
        "### 3.3 - Text In Video\n",
        "The platform allows you to detect and extract text (OCR) shown within your videos. The following example sets the value of the `search_options` parameter to `[\"text_in_video\"]` to search for text that matches \"**Paris**\":"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 12,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "2c9zJvy9B37z",
        "outputId": "5c52dbfe-3563-488f-d8d2-f8823566ba6c"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': [{'confidence': 'high',\n",
            "           'end': 5,\n",
            "           'metadata': [{'text': 'study abroad paris',\n",
            "                         'type': 'text_in_video'}],\n",
            "           'score': 92.28,\n",
            "           'start': 4,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/5.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=f8350a77edfd8ab6a847bc3a10d7e591c556795e3d2f1a7dd5a1c5d78fd9c341',\n",
            "           'video_id': '652794a543e8c47e4eb47d89'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 6,\n",
            "           'metadata': [{'text': 'study abroad paris france',\n",
            "                         'type': 'text_in_video'}],\n",
            "           'score': 92.28,\n",
            "           'start': 4,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/5.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=f8350a77edfd8ab6a847bc3a10d7e591c556795e3d2f1a7dd5a1c5d78fd9c341',\n",
            "           'video_id': '652794a543e8c47e4eb47d89'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 7,\n",
            "           'metadata': [{'text': 'Study abroad programs in Paris, France - '\n",
            "                                 'Study French in France - CEA',\n",
            "                         'type': 'text_in_video'}],\n",
            "           'score': 92.28,\n",
            "           'start': 6,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/7.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=6b3569e753ed3d0293383cf4220cc1acba381b53dd8277e5aee9077a1e19accf',\n",
            "           'video_id': '652794a543e8c47e4eb47d89'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 7,\n",
            "           'metadata': [{'text': 'Study abroad programs in Paris, France. '\n",
            "                                 'Study French in France, live and travel in '\n",
            "                                 'Paris.',\n",
            "                         'type': 'text_in_video'}],\n",
            "           'score': 92.28,\n",
            "           'start': 6,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/7.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=6b3569e753ed3d0293383cf4220cc1acba381b53dd8277e5aee9077a1e19accf',\n",
            "           'video_id': '652794a543e8c47e4eb47d89'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 13,\n",
            "           'metadata': [{'text': 'More results near The Louvre, Paris, France '\n",
            "                                 '>>',\n",
            "                         'type': 'text_in_video'}],\n",
            "           'score': 92.28,\n",
            "           'start': 12,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/13.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=a3f4907e5c96c876034fa38fc46e715519e02a3923d9cccdd6fe83e3bd4178b0',\n",
            "           'video_id': '652794a543e8c47e4eb47d89'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 19,\n",
            "           'metadata': [{'text': 'How to Impress a French Woman Paris Logue',\n",
            "                         'type': 'text_in_video'}],\n",
            "           'score': 92.28,\n",
            "           'start': 18,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/19.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d87e8bc4a35279224b45e419d6272af7781d72a848fc082ec5b840f3e778bc42',\n",
            "           'video_id': '652794a543e8c47e4eb47d89'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 21,\n",
            "           'metadata': [{'text': 'chocolate shops in paris',\n",
            "                         'type': 'text_in_video'}],\n",
            "           'score': 92.28,\n",
            "           'start': 20,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/21.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=59a302e5d4ba21dff4e23ef96362f4723e3a78f14f496d0377ff8ac661153d4e',\n",
            "           'video_id': '652794a543e8c47e4eb47d89'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 22,\n",
            "           'metadata': [{'text': 'chocolate shops paris france',\n",
            "                         'type': 'text_in_video'}],\n",
            "           'score': 92.28,\n",
            "           'start': 21,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/22.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d9377a40eecb02c6745588cbf69ed806ec258021970202ed157b9382e40cb577',\n",
            "           'video_id': '652794a543e8c47e4eb47d89'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 22,\n",
            "           'metadata': [{'text': 'Local business results for chocolate shops '\n",
            "                                 'near Paris, France',\n",
            "                         'type': 'text_in_video'}],\n",
            "           'score': 92.28,\n",
            "           'start': 21,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/22.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d9377a40eecb02c6745588cbf69ed806ec258021970202ed157b9382e40cb577',\n",
            "           'video_id': '652794a543e8c47e4eb47d89'},\n",
            "          {'confidence': 'high',\n",
            "           'end': 34,\n",
            "           'metadata': [{'text': 'jobs in paris', 'type': 'text_in_video'}],\n",
            "           'score': 92.28,\n",
            "           'start': 33,\n",
            "           'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/34.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=2f3d299787ce9a1b7e08d50c3eb8a9902b252e318911cbb0fa371c91a0b5d827',\n",
            "           'video_id': '652794a543e8c47e4eb47d89'}],\n",
            " 'page_info': {'limit_per_page': 10,\n",
            "               'next_page_token': 'e4df9f03-3ce4-49a9-9dce-bbf1f12679f7-1',\n",
            "               'page_expired_at': '2023-10-13T14:39:33Z',\n",
            "               'total_results': 14},\n",
            " 'search_pool': {'index_id': '652793eb23c1347ffbe3a398',\n",
            "                 'total_count': 33,\n",
            "                 'total_duration': 3247}}\n"
          ]
        }
      ],
      "source": [
        "# Construct the URL of the `/search` endpoint\n",
        "SEARCH_URL = f\"{API_URL}/search/\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "query = \"Paris\"\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "    \"query\": query,  # Specify your search query\n",
        "    \"index_id\": INDEX_ID,  # Indicate the unique identifier of your index\n",
        "    \"search_options\": [\"text_in_video\"],  # Specify the search options\n",
        "}\n",
        "\n",
        "# Make a search request\n",
        "response = requests.post(SEARCH_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 13,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "id": "SuzeF1Bc5EfR",
        "outputId": "069c2f9f-b693-49cf-df11-771e466d2058"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Search Query:  Paris\n",
            "Option: Text In Video\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/5.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=f8350a77edfd8ab6a847bc3a10d7e591c556795e3d2f1a7dd5a1c5d78fd9c341\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/5.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=f8350a77edfd8ab6a847bc3a10d7e591c556795e3d2f1a7dd5a1c5d78fd9c341\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/7.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=6b3569e753ed3d0293383cf4220cc1acba381b53dd8277e5aee9077a1e19accf\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/7.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=6b3569e753ed3d0293383cf4220cc1acba381b53dd8277e5aee9077a1e19accf\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/13.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=a3f4907e5c96c876034fa38fc46e715519e02a3923d9cccdd6fe83e3bd4178b0\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/19.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d87e8bc4a35279224b45e419d6272af7781d72a848fc082ec5b840f3e778bc42\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/21.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=59a302e5d4ba21dff4e23ef96362f4723e3a78f14f496d0377ff8ac661153d4e\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/22.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d9377a40eecb02c6745588cbf69ed806ec258021970202ed157b9382e40cb577\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/22.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d9377a40eecb02c6745588cbf69ed806ec258021970202ed157b9382e40cb577\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<img src=\"https://project-one-thumbnail.s3.us-west-2.amazonaws.com/652794a543e8c47e4eb47d89/34.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T143933Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=2f3d299787ce9a1b7e08d50c3eb8a9902b252e318911cbb0fa371c91a0b5d827\"/>"
            ],
            "text/plain": [
              "<IPython.core.display.Image object>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Confidence Level: high\n",
            "Confidence Score: 92.28\n"
          ]
        }
      ],
      "source": [
        "# Display a list of thumbnail URLs of the returning videos\n",
        "res = response.json()\n",
        "print (\"Search Query: \", query)\n",
        "print (\"Option:\", \"Text In Video\")\n",
        "\n",
        "for item in res[\"data\"]:\n",
        "  display(Image(url=item[\"thumbnail_url\"]))\n",
        "  print(\"Confidence Level:\", item[\"confidence\"])\n",
        "  print(\"Confidence Score:\", item[\"score\"])"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "TQ2Hsn0LwKT2"
      },
      "source": [
        "## 4 - Classify API\n",
        "Content classification is the process of organizing content into distinct categories based on specific criteria. This process helps you organize your videos into more manageable and useful categories, making them easier to find, access, and use.\n",
        "\n",
        "If you have an extensive library of videos you'd like to analyze to identify specific actions or entities, manually finding the segments that meet your criteria is time-consuming. With a single API call, the Twelve Labs platform automatically identifies the actions and entities you specify whenever they appear in your videos and assigns a likelihood score that indicates how likely those actions or entities are to occur in each of your videos.\n",
        "\n",
        "The platform allows you to define either a simple or a hierarchical taxonomy system to organize your videos.  A simple taxonomy system is composed of a single set of categories, similar to [YouTube video categories](https://developers.google.com/youtube/v3/docs/videoCategories/list). A hierarchical taxonomy system is composed of categories and subcategories, similar to [IAB Tech Lab Content Taxonomy](https://iabtechlab.com/standards/content-taxonomy/).\n",
        "\n",
        "The following parameters allow you to control how classification works:\n",
        "\n",
        "- `classes`: An array of objects containing the names and definitions of the entities or actions that the platform must identify. Each object is composed of the following fields:\n",
        "  - `name`: A string representing the name you want to give this class.\n",
        "  - `prompts`: An array of strings that specifies what the class contains. The platform uses the values you provide in this array to classify your videos.\n",
        "- `threshold`: A numerical value that indicates the confidence level of the video segment's match with a certain class.\n",
        "- `ratio`: A numerical value that displays the ratio of the sum of the lengths of the matching video segments divided by the total length of the video."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "KYlCycWht90s"
      },
      "source": [
        "### Classifying videos based on one class\n",
        "The following example code uses the `options` parameter to specify that the platform should classify your video based on one classes - `Style & Fashion`:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 14,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "mBhALApwaLox",
        "outputId": "1aae717b-6dc9-44af-e61a-74a9372c982c"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': [{'classes': [{'duration_ratio': 1,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 100}],\n",
            "           'video_id': '6527947443e8c47e4eb47d7e'},\n",
            "          {'classes': [{'duration_ratio': 0.73,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 98.29}],\n",
            "           'video_id': '6527947943e8c47e4eb47d7f'},\n",
            "          {'classes': [{'duration_ratio': 1,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 95.36}],\n",
            "           'video_id': '6527946f43e8c47e4eb47d7d'},\n",
            "          {'classes': [{'duration_ratio': 1,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 94.15}],\n",
            "           'video_id': '6527945543e8c47e4eb47d7c'},\n",
            "          {'classes': [{'duration_ratio': 0.68,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 91}],\n",
            "           'video_id': '6527945143e8c47e4eb47d7b'},\n",
            "          {'classes': [{'duration_ratio': 0.57,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 87.27}],\n",
            "           'video_id': '6527942a43e8c47e4eb47d73'}],\n",
            " 'page_info': {'limit_per_page': 6,\n",
            "               'next_page_token': '',\n",
            "               'page_expired_at': '2023-10-13T14:52:48Z',\n",
            "               'prev_page_token': '',\n",
            "               'total_results': 6}}\n"
          ]
        }
      ],
      "source": [
        "# Construct the URL of the `/classify/bulk` endpoint\n",
        "CLASSIFY_BULK_URL = f\"{API_URL}/classify/bulk\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data =  {\n",
        "  \"options\": [\n",
        "        \"visual\",\n",
        "        \"conversation\",\n",
        "        \"text_in_video\"\n",
        "  ],  # Specify how the platform will analyze your video\n",
        "  \"index_id\": INDEX_ID,  # Indicate the unique identifier of your index\n",
        "  \"classes\": [\n",
        "      {\n",
        "        \"name\": \"Style & Fashion\",\n",
        "        \"prompts\": [\n",
        "                \"Beauty\",\n",
        "                \"Designer Clothing\",\n",
        "                \"Fashion Trends\",\n",
        "                \"Men's Fashion\",\n",
        "                \"Women's Fashion\",\n",
        "                \"Hairstyles\",\n",
        "                \"Makeup\",\n",
        "                \"Accessories\",\n",
        "                \"Footwear\",\n",
        "                \"Jewelry\",\n",
        "                \"Outfits\",\n",
        "                \"Clothing Care\",\n",
        "                \"Sewing\"\n",
        "          ]\n",
        "      }\n",
        "  ],\n",
        "  \"threshold\": {\n",
        "        \"min_video_score\": 80,  # Minimum video score is 80\n",
        "        \"min_duration_ratio\": 0.5  # Minimum duration ratio is 50%\n",
        "  }\n",
        "}\n",
        "\n",
        "# Make a classification request\n",
        "response = requests.post(CLASSIFY_BULK_URL, headers=headers, json=data)\n",
        "print (f'Status code: {response.status_code}')\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "CPMj836badap"
      },
      "source": [
        "In the example output above, note that the `data` array is composed of three objects. Each object contains the following:\n",
        "\n",
        "*   A field named `video_id` representing the unique identifier of the video that has been classified.\n",
        "*   An array named `labels` containing information about each video. Note that, when classifying a video, the API service finds all video fragments that match the label you've specified in the request. For each video fragment found, the API service determines the level of confidence that the fragment matches the label. The `max_score` field is determined by comparing the confidence scores of each fragment and selecting the highest one.\n",
        "\n",
        "### Retrieving detailed information about each matching video fragment\n",
        "\n",
        "The following example code sets the `include_clips` parameter to true to specify that the API service should retrieve detailed information about each matching video fragment:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 15,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "hzta-Yy7D3Mv",
        "outputId": "30199ce3-f25a-4571-ede7-1a1a3e7abac7"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': [{'classes': [{'clips': [{'end': 30,\n",
            "                                   'option': 'text_in_video',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 92.28,\n",
            "                                   'start': 29,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947443e8c47e4eb47d7e/30.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=f4178b50c455540002b1cafb8e74a452db318563aec9953672669978978823c0'},\n",
            "                                  {'end': 14.96875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Makeup',\n",
            "                                   'score': 83.86,\n",
            "                                   'start': 10.25,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947443e8c47e4eb47d7e/11.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=9026ec8a3ce9305034e45f267bd38ec0ee46b17d296ebf93bdf67b94827f261b'},\n",
            "                                  {'end': 14.96875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 83.44,\n",
            "                                   'start': 6,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947443e8c47e4eb47d7e/7.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=c9d77b6e2d0f1a8241cceb3c827fa139acac16fce2694c7c6b958b7b49d5224b'},\n",
            "                                  {'end': 30,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Makeup',\n",
            "                                   'score': 83.27,\n",
            "                                   'start': 14.96875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947443e8c47e4eb47d7e/15.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=b1891de7950fe4aa0a6a87f092a908e3f8710e4acfa61a42f1b82f9621ea158e'},\n",
            "                                  {'end': 30,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 83.18,\n",
            "                                   'start': 19.6875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947443e8c47e4eb47d7e/20.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=4a6a9f5cc727ebece340445a538cc8f73e6e47825135ea646d81166f8a71dee6'},\n",
            "                                  {'end': 10.25,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Makeup',\n",
            "                                   'score': 82.92,\n",
            "                                   'start': 6,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947443e8c47e4eb47d7e/7.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=c9d77b6e2d0f1a8241cceb3c827fa139acac16fce2694c7c6b958b7b49d5224b'},\n",
            "                                  {'end': 30,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Fashion Trends',\n",
            "                                   'score': 79.7,\n",
            "                                   'start': 19.6875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947443e8c47e4eb47d7e/20.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=4a6a9f5cc727ebece340445a538cc8f73e6e47825135ea646d81166f8a71dee6'},\n",
            "                                  {'end': 6,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Makeup',\n",
            "                                   'score': 78.97,\n",
            "                                   'start': 0,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947443e8c47e4eb47d7e/1.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=f18a2e1af5ca839c8a2aecbb70e354dab94e6a7f9824fc0efcae19a8eed06301'},\n",
            "                                  {'end': 6,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Fashion Trends',\n",
            "                                   'score': 75.7,\n",
            "                                   'start': 0,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947443e8c47e4eb47d7e/1.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=f18a2e1af5ca839c8a2aecbb70e354dab94e6a7f9824fc0efcae19a8eed06301'},\n",
            "                                  {'end': 6,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': \"Women's Fashion\",\n",
            "                                   'score': 74.25,\n",
            "                                   'start': 0,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947443e8c47e4eb47d7e/1.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=f18a2e1af5ca839c8a2aecbb70e354dab94e6a7f9824fc0efcae19a8eed06301'},\n",
            "                                  {'end': 6,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 74.23,\n",
            "                                   'start': 0,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947443e8c47e4eb47d7e/1.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=f18a2e1af5ca839c8a2aecbb70e354dab94e6a7f9824fc0efcae19a8eed06301'}],\n",
            "                        'duration_ratio': 1,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 100}],\n",
            "           'video_id': '6527947443e8c47e4eb47d7e'},\n",
            "          {'classes': [{'clips': [{'end': 1,\n",
            "                                   'option': 'text_in_video',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 92.28,\n",
            "                                   'start': 0.03125,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947943e8c47e4eb47d7f/1.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=1919756d7ff83874dd3d7d71fb45f276b93a1b38bb3bfed1a1eb0a164b457b02'},\n",
            "                                  {'end': 62,\n",
            "                                   'option': 'text_in_video',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 92.28,\n",
            "                                   'start': 61,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947943e8c47e4eb47d7f/62.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=1072412640807b411a11ed309ee6862e263205ee52f61c0e0e0d64dffc3ebc18'},\n",
            "                                  {'end': 61.15,\n",
            "                                   'option': 'conversation',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 84.55,\n",
            "                                   'start': 60.159,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947943e8c47e4eb47d7f/61.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=3aa142b9cdc24c365ff43c5ba3f9c2b9aac1639f4109fda70d6af47a2ce3e268'},\n",
            "                                  {'end': 11.78125,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 83.74,\n",
            "                                   'start': 0,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947943e8c47e4eb47d7f/1.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=1919756d7ff83874dd3d7d71fb45f276b93a1b38bb3bfed1a1eb0a164b457b02'},\n",
            "                                  {'end': 62.8,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 83.3,\n",
            "                                   'start': 46.34375,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947943e8c47e4eb47d7f/47.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=55edf727c1aa75f01afe60d957e0f639e9c36745f1d89c01dd875ae9ca8d7a63'},\n",
            "                                  {'end': 36.09375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Makeup',\n",
            "                                   'score': 82.86,\n",
            "                                   'start': 26.84375,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947943e8c47e4eb47d7f/27.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=63fa39a83087e47511dfa4b7d7609069ceb6f8db41903f13270ba674735874f4'},\n",
            "                                  {'end': 6.90625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Makeup',\n",
            "                                   'score': 78.91,\n",
            "                                   'start': 0,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947943e8c47e4eb47d7f/1.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=1919756d7ff83874dd3d7d71fb45f276b93a1b38bb3bfed1a1eb0a164b457b02'},\n",
            "                                  {'end': 62.8,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Makeup',\n",
            "                                   'score': 77.39,\n",
            "                                   'start': 53.8125,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947943e8c47e4eb47d7f/54.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=c8cd32fb5eab889b126acbccfdca8dbbf044ef8329e054d59bd56ddd92bae662'},\n",
            "                                  {'end': 20.40625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 76.2,\n",
            "                                   'start': 11.78125,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947943e8c47e4eb47d7f/12.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=0a1f99952636db19fd41c085f8ca6132549982670b5a57d3de9bd5558ef091e1'},\n",
            "                                  {'end': 11.78125,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Makeup',\n",
            "                                   'score': 75.18,\n",
            "                                   'start': 6.90625,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527947943e8c47e4eb47d7f/7.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=fd37a4b382b75c547b95f5235dcba17c9fef1fd04d7a7b7cc37f7bd78fa37c97'}],\n",
            "                        'duration_ratio': 0.73,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 98.29}],\n",
            "           'video_id': '6527947943e8c47e4eb47d7f'},\n",
            "          {'classes': [{'clips': [{'end': 28.049,\n",
            "                                   'option': 'conversation',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 84.78,\n",
            "                                   'start': 22.78,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527946f43e8c47e4eb47d7d/23.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=ca9f71641db28f86ac48b90158653b2d33be9cb7fb301a6870461c4e0f3771fc'},\n",
            "                                  {'end': 28.049,\n",
            "                                   'option': 'conversation',\n",
            "                                   'prompt': 'Hairstyles',\n",
            "                                   'score': 84.04,\n",
            "                                   'start': 22.78,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527946f43e8c47e4eb47d7d/23.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=ca9f71641db28f86ac48b90158653b2d33be9cb7fb301a6870461c4e0f3771fc'},\n",
            "                                  {'end': 5.86,\n",
            "                                   'option': 'conversation',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 83.56,\n",
            "                                   'start': 0.829,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527946f43e8c47e4eb47d7d/1.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d3b3f4141f1080bcba695b99a83eb24d2356daa6e51f06e4ebc5c65e14978dac'},\n",
            "                                  {'end': 21.46875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Hairstyles',\n",
            "                                   'score': 83.44,\n",
            "                                   'start': 4.9375,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527946f43e8c47e4eb47d7d/5.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=3c7caf785e243913ed91428298a31b930f20177fb128795d46297f570d3dbbf1'},\n",
            "                                  {'end': 21.46875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 83.08,\n",
            "                                   'start': 0,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527946f43e8c47e4eb47d7d/1.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d3b3f4141f1080bcba695b99a83eb24d2356daa6e51f06e4ebc5c65e14978dac'},\n",
            "                                  {'end': 30,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 80.9,\n",
            "                                   'start': 25.84375,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527946f43e8c47e4eb47d7d/26.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=1cbf99d4b50dfd2f74633bc5dbd72e51f77d853d9be0f9f7c6b0bc55a0532349'},\n",
            "                                  {'end': 21.85,\n",
            "                                   'option': 'conversation',\n",
            "                                   'prompt': 'Hairstyles',\n",
            "                                   'score': 75.02,\n",
            "                                   'start': 0.829,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527946f43e8c47e4eb47d7d/1.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d3b3f4141f1080bcba695b99a83eb24d2356daa6e51f06e4ebc5c65e14978dac'},\n",
            "                                  {'end': 25.84375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Fashion Trends',\n",
            "                                   'score': 74.3,\n",
            "                                   'start': 21.46875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527946f43e8c47e4eb47d7d/22.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=b87015672827fafc12d2b942913bee725f5b61910f6997a7edd8c60051cf9ead'},\n",
            "                                  {'end': 4.9375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Makeup',\n",
            "                                   'score': 74.06,\n",
            "                                   'start': 0,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527946f43e8c47e4eb47d7d/1.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d3b3f4141f1080bcba695b99a83eb24d2356daa6e51f06e4ebc5c65e14978dac'}],\n",
            "                        'duration_ratio': 1,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 95.36}],\n",
            "           'video_id': '6527946f43e8c47e4eb47d7d'},\n",
            "          {'classes': [{'clips': [{'end': 45,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 83.42,\n",
            "                                   'start': 40.46875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527945543e8c47e4eb47d7c/41.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=e46eca0890c66d16e897d35790069865b3b6150e4cca0bde655604eb1a429cfb'},\n",
            "                                  {'end': 5.375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 83.39,\n",
            "                                   'start': 0,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527945543e8c47e4eb47d7c/1.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=c0589cb880c9c3b9e30c182878e50a75d4df814e7a3e25b7c24b2c500c32f9a3'},\n",
            "                                  {'end': 19.46875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 80.59,\n",
            "                                   'start': 15.46875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527945543e8c47e4eb47d7c/16.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=6c4ff2d57fbc7ca9889ffd8c6983ea2865c4930f1444404c1270aac67b25c3ec'},\n",
            "                                  {'end': 43.869,\n",
            "                                   'option': 'conversation',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 76.09,\n",
            "                                   'start': 4.67,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527945543e8c47e4eb47d7c/5.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=6977cc104bcb8072574e222d6df31001138f48f0404f67ec02b85c63b14c0b06'}],\n",
            "                        'duration_ratio': 1,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 94.15}],\n",
            "           'video_id': '6527945543e8c47e4eb47d7c'},\n",
            "          {'classes': [{'clips': [{'end': 27.6875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Footwear',\n",
            "                                   'score': 83.62,\n",
            "                                   'start': 14.0625,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527945143e8c47e4eb47d7b/15.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=2962d91f01ad508a1c0452e394f8c38d94e3cc34a3538e5a196d77d6f8ab1cbd'},\n",
            "                                  {'end': 61.25,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Footwear',\n",
            "                                   'score': 83.58,\n",
            "                                   'start': 56.78125,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527945143e8c47e4eb47d7b/57.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=6c7be5c9de258c44c527ea41d52f11218a50e13f93caeb1f68e616f568ddbeb6'},\n",
            "                                  {'end': 85.15,\n",
            "                                   'option': 'conversation',\n",
            "                                   'prompt': 'Footwear',\n",
            "                                   'score': 78.77,\n",
            "                                   'start': 79.3,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527945143e8c47e4eb47d7b/80.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=22b80747d7bab9986391eb5730a368d2b2253edf4b15304b23198ce8ecba932f'},\n",
            "                                  {'end': 78.959,\n",
            "                                   'option': 'conversation',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 76.29,\n",
            "                                   'start': 11.3,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527945143e8c47e4eb47d7b/12.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=60d31fb6148bee50fa659e36b3242fc109100f3bf3672f800e10bfb874dd1a45'},\n",
            "                                  {'end': 27.6875,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Fashion Trends',\n",
            "                                   'score': 75.55,\n",
            "                                   'start': 14.0625,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527945143e8c47e4eb47d7b/15.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=2962d91f01ad508a1c0452e394f8c38d94e3cc34a3538e5a196d77d6f8ab1cbd'}],\n",
            "                        'duration_ratio': 0.68,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 91}],\n",
            "           'video_id': '6527945143e8c47e4eb47d7b'},\n",
            "          {'classes': [{'clips': [{'end': 39.4375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Makeup',\n",
            "                                   'score': 82.19,\n",
            "                                   'start': 34.59375,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527942a43e8c47e4eb47d73/35.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=8ce2009a7cacda70a01abea570842c10e2746584fa8eba40034dfde967d8f096'},\n",
            "                                  {'end': 39.4375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Beauty',\n",
            "                                   'score': 81.53,\n",
            "                                   'start': 29.96875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527942a43e8c47e4eb47d73/30.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=55b61840a2d84e3ebfa959fa64a64f2f7a8253321a67ef7706a710edf851a32e'},\n",
            "                                  {'end': 14.65625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Makeup',\n",
            "                                   'score': 79.12,\n",
            "                                   'start': 10,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527942a43e8c47e4eb47d73/11.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=a785546b86cfbca4c7b6a01ed02a68f4eb0be87dc561b5cbdc525eed2a5a98dd'},\n",
            "                                  {'end': 44.90625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Makeup',\n",
            "                                   'score': 78.4,\n",
            "                                   'start': 39.4375,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527942a43e8c47e4eb47d73/40.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=a3498ea542747e78d865fb32fe1b4506eb444a5b74b4bafd008556d398d38041'},\n",
            "                                  {'end': 14.65625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Hairstyles',\n",
            "                                   'score': 75.86,\n",
            "                                   'start': 10,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527942a43e8c47e4eb47d73/11.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=a785546b86cfbca4c7b6a01ed02a68f4eb0be87dc561b5cbdc525eed2a5a98dd'},\n",
            "                                  {'end': 25.65625,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Makeup',\n",
            "                                   'score': 75.36,\n",
            "                                   'start': 14.65625,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527942a43e8c47e4eb47d73/15.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=20c546c62084d0cf37f26d6e6a09f3e2615583ef5bc31c3868b20a7ace12c3ca'},\n",
            "                                  {'end': 34.59375,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Makeup',\n",
            "                                   'score': 74.43,\n",
            "                                   'start': 29.96875,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527942a43e8c47e4eb47d73/30.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=55b61840a2d84e3ebfa959fa64a64f2f7a8253321a67ef7706a710edf851a32e'},\n",
            "                                  {'end': 60,\n",
            "                                   'option': 'visual',\n",
            "                                   'prompt': 'Makeup',\n",
            "                                   'score': 73.86,\n",
            "                                   'start': 56.06666666666666,\n",
            "                                   'thumbnail_url': 'https://project-one-thumbnail.s3.us-west-2.amazonaws.com/6527942a43e8c47e4eb47d73/57.jpeg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAYRWJPOVHXE5SJ77T%2F20231013%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20231013T144847Z&X-Amz-Expires=604799&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=e2d1306d472552d20ab08172e5a0c190d13c0b731e4b594af6b13e4f8c76276c'}],\n",
            "                        'duration_ratio': 0.57,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 87.27}],\n",
            "           'video_id': '6527942a43e8c47e4eb47d73'}],\n",
            " 'page_info': {'limit_per_page': 10,\n",
            "               'next_page_token': '',\n",
            "               'page_expired_at': '2023-10-13T14:53:47Z',\n",
            "               'prev_page_token': '',\n",
            "               'total_results': 6}}\n"
          ]
        }
      ],
      "source": [
        "# Construct the URL of the `/classify/bulk` endpoint\n",
        "CLASSIFY_BULK_URL = f\"{API_URL}/classify/bulk\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data =  {\n",
        "  \"options\": [\n",
        "        \"visual\",\n",
        "        \"conversation\",\n",
        "        \"text_in_video\"\n",
        "  ],\n",
        "  \"index_id\": INDEX_ID,\n",
        "  \"include_clips\": True,\n",
        "  \"classes\": [\n",
        "      {\n",
        "        \"name\": \"Style & Fashion\",\n",
        "        \"prompts\": [\n",
        "                \"Beauty\",\n",
        "                \"Designer Clothing\",\n",
        "                \"Fashion Trends\",\n",
        "                \"Men's Fashion\",\n",
        "                \"Women's Fashion\",\n",
        "                \"Hairstyles\",\n",
        "                \"Makeup\",\n",
        "                \"Accessories\",\n",
        "                \"Footwear\",\n",
        "                \"Jewelry\",\n",
        "                \"Outfits\",\n",
        "                \"Clothing Care\",\n",
        "                \"Sewing\"\n",
        "          ]\n",
        "      }\n",
        "  ],\n",
        "  \"threshold\": {\n",
        "        \"min_video_score\": 80,  # Minimum video score is 80\n",
        "        \"min_duration_ratio\": 0.5  # Minimum duration ratio is 50%\n",
        "  }\n",
        "}\n",
        "\n",
        "# Make a classification request\n",
        "response = requests.post(CLASSIFY_BULK_URL, headers=headers, json=data)\n",
        "print (f'Status code: {response.status_code}')\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "bF6hzOM_lmGZ"
      },
      "source": [
        "In the example output above, note that, for each video, the API service returns an array named `clips` containing detailed information about a single matching video fragment.\n",
        "\n",
        "### Classifying a video based on multiple classes\n",
        "\n",
        "The following example code classifies the content of your videos based on four classes - `Style & Fashion`, `Automotive`, `Pets`, and `Technology & Computing`:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 16,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "tGrp5ldymSxf",
        "outputId": "2e834718-02a5-4d8c-8d68-b5c8fa8ca4d3"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': [{'classes': [{'duration_ratio': 1,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 100}],\n",
            "           'video_id': '6527947443e8c47e4eb47d7e'},\n",
            "          {'classes': [{'duration_ratio': 0.73,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 98.29}],\n",
            "           'video_id': '6527947943e8c47e4eb47d7f'},\n",
            "          {'classes': [{'duration_ratio': 0.86,\n",
            "                        'name': 'Automotive',\n",
            "                        'score': 95.5}],\n",
            "           'video_id': '6527948c43e8c47e4eb47d83'},\n",
            "          {'classes': [{'duration_ratio': 1,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 95.36}],\n",
            "           'video_id': '6527946f43e8c47e4eb47d7d'},\n",
            "          {'classes': [{'duration_ratio': 0.85,\n",
            "                        'name': 'Pets',\n",
            "                        'score': 94.97}],\n",
            "           'video_id': '6527949943e8c47e4eb47d86'},\n",
            "          {'classes': [{'duration_ratio': 0.9,\n",
            "                        'name': 'Automotive',\n",
            "                        'score': 94.52}],\n",
            "           'video_id': '6527947d43e8c47e4eb47d80'},\n",
            "          {'classes': [{'duration_ratio': 1,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 94.15}],\n",
            "           'video_id': '6527945543e8c47e4eb47d7c'},\n",
            "          {'classes': [{'duration_ratio': 0.87,\n",
            "                        'name': 'Technology & Computing',\n",
            "                        'score': 91.05}],\n",
            "           'video_id': '652794a543e8c47e4eb47d89'},\n",
            "          {'classes': [{'duration_ratio': 0.68,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 91}],\n",
            "           'video_id': '6527945143e8c47e4eb47d7b'},\n",
            "          {'classes': [{'duration_ratio': 0.52,\n",
            "                        'name': 'Automotive',\n",
            "                        'score': 88.8}],\n",
            "           'video_id': '6527d45e43e8c47e4eb47ded'},\n",
            "          {'classes': [{'duration_ratio': 0.57,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 87.27}],\n",
            "           'video_id': '6527942a43e8c47e4eb47d73'}],\n",
            " 'page_info': {'limit_per_page': 11,\n",
            "               'next_page_token': '',\n",
            "               'page_expired_at': '2023-10-13T14:59:38Z',\n",
            "               'prev_page_token': '',\n",
            "               'total_results': 11}}\n"
          ]
        }
      ],
      "source": [
        "# Construct the URL of the `/classify/bulk` endpoint\n",
        "CLASSIFY_BULK_URL = f\"{API_URL}/classify/bulk\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data =  {\n",
        "  \"options\": [\n",
        "        \"visual\",\n",
        "        \"conversation\",\n",
        "        \"text_in_video\"\n",
        "  ],\n",
        "  \"index_id\": INDEX_ID,\n",
        "  \"classes\": [\n",
        "        {\n",
        "            \"name\": \"Automotive\",\n",
        "            \"prompts\": [\n",
        "                \"Motorcycles\",\n",
        "                \"Automotive\",\n",
        "                \"Cars\",\n",
        "                \"Trucks\",\n",
        "                \"SUVs\",\n",
        "                \"Vans\",\n",
        "                \"Electric Vehicles\"\n",
        "            ]\n",
        "        },\n",
        "        {\n",
        "            \"name\": \"Pets\",\n",
        "            \"prompts\": [\n",
        "                \"Birds\",\n",
        "                \"Cats\",\n",
        "                \"Dogs\",\n",
        "                \"Pet\",\n",
        "                \"Fish\"\n",
        "            ]\n",
        "        },\n",
        "        {\n",
        "            \"name\": \"Style & Fashion\",\n",
        "            \"prompts\": [\n",
        "                \"Beauty\",\n",
        "                \"Designer Clothing\",\n",
        "                \"Fashion Trends\",\n",
        "                \"Men's Fashion\",\n",
        "                \"Women's Fashion\",\n",
        "                \"Hairstyles\",\n",
        "                \"Makeup\",\n",
        "                \"Accessories\",\n",
        "                \"Footwear\",\n",
        "                \"Jewelry\",\n",
        "                \"Outfits\",\n",
        "                \"Clothing Care\",\n",
        "                \"Sewing\"\n",
        "            ]\n",
        "        },\n",
        "        {\n",
        "            \"name\": \"Technology & Computing\",\n",
        "            \"prompts\": [\n",
        "                \"Artificial Intelligence\",\n",
        "                \"Augmented Reality\",\n",
        "                \"Consumer Electronics\",\n",
        "                \"Robotics\",\n",
        "                \"AWS\",\n",
        "                \"Microsoft\",\n",
        "                \"GPUS\",\n",
        "                \"Data Mining\",\n",
        "                \"Big Data\",\n",
        "                \"Cloud Computing\"\n",
        "            ]\n",
        "        }\n",
        "  ],\n",
        "  \"threshold\": {\n",
        "        \"min_video_score\": 80,\n",
        "        \"min_duration_ratio\": 0.5\n",
        "  }\n",
        "}\n",
        "\n",
        "# Make a classification request\n",
        "response = requests.post(CLASSIFY_BULK_URL, headers=headers, json=data)\n",
        "print (f'Status code: {response.status_code}')\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "QgY8gyXnnE1w"
      },
      "source": [
        "In the example output above, note that the `data` array contains three objects, each corresponding to a different video. For each video, the response contains information that helps you determine the likelihood that each of the labels you've specified in the request appears in that video.\n",
        "\n",
        "### Retrieving a detailed score for each class\n",
        "\n",
        "The following example code sets the `show_detailed_score` parameter to `true` to specify that the platform should retrieve the maximum score, average score, duration weighted score, and normalized score for each class:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 17,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "bo2cXWD82cv7",
        "outputId": "908f99ee-969d-4596-ccbd-912b6ed0f503"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': [{'classes': [{'detailed_scores': {'avg_score': 81.07,\n",
            "                                            'max_score': 92.28,\n",
            "                                            'normalized_score': 100},\n",
            "                        'duration_ratio': 1,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 100}],\n",
            "           'video_id': '6527947443e8c47e4eb47d7e'},\n",
            "          {'classes': [{'detailed_scores': {'avg_score': 82.66,\n",
            "                                            'max_score': 92.28,\n",
            "                                            'normalized_score': 100},\n",
            "                        'duration_ratio': 0.73,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 98.29}],\n",
            "           'video_id': '6527947943e8c47e4eb47d7f'},\n",
            "          {'classes': [{'detailed_scores': {'avg_score': 81.08,\n",
            "                                            'max_score': 84.94,\n",
            "                                            'normalized_score': 100},\n",
            "                        'duration_ratio': 0.86,\n",
            "                        'name': 'Automotive',\n",
            "                        'score': 95.5}],\n",
            "           'video_id': '6527948c43e8c47e4eb47d83'},\n",
            "          {'classes': [{'detailed_scores': {'avg_score': 80.35,\n",
            "                                            'max_score': 84.78,\n",
            "                                            'normalized_score': 100},\n",
            "                        'duration_ratio': 1,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 95.36}],\n",
            "           'video_id': '6527946f43e8c47e4eb47d7d'},\n",
            "          {'classes': [{'detailed_scores': {'avg_score': 80.68,\n",
            "                                            'max_score': 84.54,\n",
            "                                            'normalized_score': 100},\n",
            "                        'duration_ratio': 0.85,\n",
            "                        'name': 'Pets',\n",
            "                        'score': 94.97}],\n",
            "           'video_id': '6527949943e8c47e4eb47d86'},\n",
            "          {'classes': [{'detailed_scores': {'avg_score': 80.32,\n",
            "                                            'max_score': 83.9,\n",
            "                                            'normalized_score': 100},\n",
            "                        'duration_ratio': 0.9,\n",
            "                        'name': 'Automotive',\n",
            "                        'score': 94.52}],\n",
            "           'video_id': '6527947d43e8c47e4eb47d80'},\n",
            "          {'classes': [{'detailed_scores': {'avg_score': 80.87,\n",
            "                                            'max_score': 83.42,\n",
            "                                            'normalized_score': 100},\n",
            "                        'duration_ratio': 1,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 94.15}],\n",
            "           'video_id': '6527945543e8c47e4eb47d7c'},\n",
            "          {'classes': [{'detailed_scores': {'avg_score': 80.27,\n",
            "                                            'max_score': 81.19,\n",
            "                                            'normalized_score': 100},\n",
            "                        'duration_ratio': 0.87,\n",
            "                        'name': 'Technology & Computing',\n",
            "                        'score': 91.05}],\n",
            "           'video_id': '652794a543e8c47e4eb47d89'},\n",
            "          {'classes': [{'detailed_scores': {'avg_score': 79.56,\n",
            "                                            'max_score': 83.62,\n",
            "                                            'normalized_score': 100},\n",
            "                        'duration_ratio': 0.68,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 91}],\n",
            "           'video_id': '6527945143e8c47e4eb47d7b'},\n",
            "          {'classes': [{'detailed_scores': {'avg_score': 81.56,\n",
            "                                            'max_score': 92.28,\n",
            "                                            'normalized_score': 100},\n",
            "                        'duration_ratio': 0.52,\n",
            "                        'name': 'Automotive',\n",
            "                        'score': 88.8}],\n",
            "           'video_id': '6527d45e43e8c47e4eb47ded'},\n",
            "          {'classes': [{'detailed_scores': {'avg_score': 79.22,\n",
            "                                            'max_score': 92.28,\n",
            "                                            'normalized_score': 100},\n",
            "                        'duration_ratio': 0.57,\n",
            "                        'name': 'Style & Fashion',\n",
            "                        'score': 87.27}],\n",
            "           'video_id': '6527942a43e8c47e4eb47d73'}],\n",
            " 'page_info': {'limit_per_page': 11,\n",
            "               'next_page_token': '',\n",
            "               'page_expired_at': '2023-10-13T14:59:55Z',\n",
            "               'prev_page_token': '',\n",
            "               'total_results': 11}}\n"
          ]
        }
      ],
      "source": [
        "# Construct the URL of the `/classify/bulk` endpoint\n",
        "CLASSIFY_BULK_URL = f\"{API_URL}/classify/bulk\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data =  {\n",
        "  \"options\": [\n",
        "        \"visual\",\n",
        "        \"conversation\",\n",
        "        \"text_in_video\"\n",
        "  ],\n",
        "  \"index_id\": INDEX_ID,\n",
        "  \"show_detailed_score\": True,\n",
        "  \"classes\": [\n",
        "        {\n",
        "            \"name\": \"Automotive\",\n",
        "            \"prompts\": [\n",
        "                \"Motorcycles\",\n",
        "                \"Automotive\",\n",
        "                \"Cars\",\n",
        "                \"Trucks\",\n",
        "                \"SUVs\",\n",
        "                \"Vans\",\n",
        "                \"Electric Vehicles\"\n",
        "            ]\n",
        "        },\n",
        "        {\n",
        "            \"name\": \"Pets\",\n",
        "            \"prompts\": [\n",
        "                \"Birds\",\n",
        "                \"Cats\",\n",
        "                \"Dogs\",\n",
        "                \"Pet\",\n",
        "                \"Fish\"\n",
        "            ]\n",
        "        },\n",
        "        {\n",
        "            \"name\": \"Style & Fashion\",\n",
        "            \"prompts\": [\n",
        "                \"Beauty\",\n",
        "                \"Designer Clothing\",\n",
        "                \"Fashion Trends\",\n",
        "                \"Men's Fashion\",\n",
        "                \"Women's Fashion\",\n",
        "                \"Hairstyles\",\n",
        "                \"Makeup\",\n",
        "                \"Accessories\",\n",
        "                \"Footwear\",\n",
        "                \"Jewelry\",\n",
        "                \"Outfits\",\n",
        "                \"Clothing Care\",\n",
        "                \"Sewing\"\n",
        "            ]\n",
        "        },\n",
        "        {\n",
        "            \"name\": \"Technology & Computing\",\n",
        "            \"prompts\": [\n",
        "                \"Artificial Intelligence\",\n",
        "                \"Augmented Reality\",\n",
        "                \"Consumer Electronics\",\n",
        "                \"Robotics\",\n",
        "                \"AWS\",\n",
        "                \"Microsoft\",\n",
        "                \"GPUS\",\n",
        "                \"Data Mining\",\n",
        "                \"Big Data\",\n",
        "                \"Cloud Computing\"\n",
        "            ]\n",
        "        }\n",
        "  ],\n",
        "  \"threshold\": {\n",
        "        \"min_video_score\": 80,\n",
        "        \"min_duration_ratio\": 0.5\n",
        "  }\n",
        "}\n",
        "\n",
        "# Make a classification request\n",
        "response = requests.post(CLASSIFY_BULK_URL, headers=headers, json=data)\n",
        "print (f'Status code: {response.status_code}')\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "3E9b76L0wD1f"
      },
      "source": [
        "## 5 - Generate API\n",
        "The Generate API suite creates concise textual representations such as titles, summaries, chapters, and highlights for your videos, to name as a few. Unlike conventional models limited to unimodal interpretations (for example, summary videos relying solely on video transcription), the Generate API suite uses a multimodal approach that analyzes the whole context of a video, including visuals, sounds, spoken words, and texts and their relationship with one another. This ensures a holistic understanding of your videos, capturing nuances that an unimodal interpretation might miss. And then, using video-to-text generative capabilities, our model can turn that understanding into actual text format of your choice.\n",
        "\n",
        "The Generate API suite offers three distinct endpoints tailored to meet various requirements for creating concise textual representations from videos. Each endpoint has been designed with specific levels of flexibility and customization to accommodate different needs.\n",
        "\n",
        "**1 - The `/gist` endpoint**\n",
        "\n",
        "- **Function**: Generates topics, titles, and hashtags.\n",
        "- **Customization**: Uses predefined templates.\n",
        "- **Prompt **: No.\n",
        "- **Best use**: To generate an immediate and straightforward text representation without specific customization.\n",
        "\n",
        "**2 - The `/summarize` endpoint**\n",
        "\n",
        "- **Function**: Generates summaries, chapters, and highlights.\n",
        "- **Customization**: Operates primarily on predefined templates, similar to `/gist`. However, you can provide a custom prompt that guides the model on how to generate the output.\n",
        "- **Prompt**: Optional. While you can invoke this endpoint without a prompt, providing one allows for tailored outputs.\n",
        "- **Best use:** To balance the efficiency of built-in templates and bespoke customization abilities.\n",
        "\n",
        "**3 - The `/generate` endpoint**\n",
        "\n",
        "- **Function**: Generates open-ended text representations from videos.\n",
        "- **Customization**: Relies solely on user-defined prompts, ensuring maximum flexibility.\n",
        "- **Prompt**: Required. You must provide clear instructions to guide the model.\n",
        "- **Best use**: Ideal for advanced users with specific output requirements beyond the built-in templates.\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 18,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "XwUHg4qDAd4D",
        "outputId": "a76ca9bb-a668-41fc-fe1f-eeab4e8e58ff"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "env: VIDEO_ID=652794b843e8c47e4eb47d8d\n"
          ]
        }
      ],
      "source": [
        "# Specify the unique identifier of an existing video ('NEW Heineken Commercial - verry funny')\n",
        "%env VIDEO_ID=652794b843e8c47e4eb47d8d"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 19,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "Hc1wY3A3Audj",
        "outputId": "eab8f3c8-dc05-464d-8ebb-2d1f8cce201c"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "652794b843e8c47e4eb47d8d\n"
          ]
        }
      ],
      "source": [
        "# Retrieve the unique identifier of the existing video\n",
        "VIDEO_ID = os.getenv(\"VIDEO_ID\")\n",
        "print (VIDEO_ID)\n",
        "assert VIDEO_ID"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "To demonstrate the Generate API, let's work with this video: [NEW Heineken Commercial - verry funny](https://youtu.be/S1ZZreXEqSY?si=oKfCYqoJ1t8BfkZZ)"
      ],
      "metadata": {
        "id": "SQqLSlqziO-S"
      }
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "8G_u7-emIseC"
      },
      "source": [
        "### 5.1 - Generate titles, topics, and hashtags\n",
        "Use the `/gist` endpoint if you require a swift breakdown of the essence of your videos. This endpoint operates exclusively on a set of predefined templates to generate the following concise and accurate textual representations:\n",
        "\n",
        "- **Title**: Distills the essence of a video into a brief, coherent phrase, facilitating quick understanding and categorization. For example, a title like \"From Consumerism to Minimalism: A Journey Toward Sustainable Living\" clearly indicates the video's narrative trajectory,  emphasizing themes related to consumption patterns and sustainable lifestyles.\n",
        "- **Topic**: Represents the central themes or subjects of a video and provides a high-level understanding based on the meaning conveyed by all modalities. Topics enable effective categorization and quick referencing. For example, \"Shopping Vlog Lifestyle\" denotes a video covering aspects related to shopping experiences, vlogging, and the associated lifestyle.\n",
        "- **Hashtag**: Concisely summarizes the themes, subjects, or sentiments expressed within a video. Hashtags improve categorization and searchability on social media platforms. For example, hashtags such as `#BlackFriday,` `#ShoppingMania,` and `#Consumerism` indicate key focal points in a video, potentially related to shopping events, consumer behaviors, or broader commentary on consumption patterns.\n",
        "\n",
        "Handling this set of predefined tasks offers a streamlined approach to obtaining concise textual representations, essential for rapid content understanding and categorization."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "M0aONOTLM4O2"
      },
      "source": [
        "The following example generates a title, topic, and hashtag for the specified video:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 20,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "2hXru2ujzFp5",
        "outputId": "e234e66c-d150-4cb9-9765-088d1b40236f"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'hashtags': ['women', 'dancing', 'singing', 'performance', 'fun', 'energetic'],\n",
            " 'id': '73a6c27c-0488-494b-95c4-a16173b3dbf9',\n",
            " 'title': 'Vibrant and Joyful Women Dancing and Singing in Various Locations',\n",
            " 'topics': ['Entertainment']}\n"
          ]
        }
      ],
      "source": [
        "# Define the /gist endpoint\n",
        "GIST_URL = f\"{API_URL}/gist\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "  \"video_id\": VIDEO_ID,\n",
        "  \"types\": [\"title\", \"topic\", \"hashtag\"]\n",
        "}\n",
        "\n",
        "# Make a gist request\n",
        "response = requests.post(GIST_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "fJ201R6-DezM"
      },
      "source": [
        "### 5.2 - Generate summaries, chapters, and highlights\n",
        "Use the `/summarize` endpoint if you want to utilize pre-defined templates for general summarization tasks and, optionally, provide a prompt to customize the output. This endpoint generates the following textual representations:\n",
        "\n",
        "- **Summaries**:  The platform returns a brief that encapsulates the key points of a video, presenting the most important information clearly and concisely. Depending on your prompt, a summary can take various forms, such as a single paragraph, a series of paragraphs, an email, or a structured list of bullet points. For example, a summary highlighting Black Friday events might include a description of a crowded mall, key commentary by a news reporter on consumer behavior, and individual perspectives on societal values associated with consumption.\n",
        "- **Chapters**: The platform returns a chronological list of all the segments in a video, providing a granular breakdown of its content. For each chapter, the platform returns its starting and end times, measured in seconds from the beginning of the video segment, a descriptive headline that offers a brief of the events or activities within that segment, and an accompanying summary that elaborates on the headline. For example, the first chapter of a stand-up comedy might describe the comedian's entrance and the first joke. The accompanying summary could delve into the content, detailing the comedian's humorous take on a specific subject, such as the cultural nuances of Tai Chi exercises.\n",
        "- **Highlights**: The platform returns a chronologically ordered list of the most important events within a video. Unlike chapters, highlights only capture the key moments, providing a snapshot of the video's main topics. For each highlight, the platform returns its starting and end times, measured in seconds from the beginning of the video, and a brief description that captures the essence of the segment. For example, a highlight might capture a significant event like a bank heist in a video with multiple scenes."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "AM1Qd39MPCAo"
      },
      "source": [
        "The following example code generates a summary for the specified video:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 21,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "Gn2RMdjuny_f",
        "outputId": "aa34601f-7756-4982-d821-3ef2d6784bdf"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'id': '93c404bb-14f8-488f-a89e-b979c677b1ed',\n",
            " 'summary': 'A vibrant and lively group of women is seen dancing, singing, and '\n",
            "            'walking in various locations, exuding an infectious energy that '\n",
            "            'is hard to resist. Their performance is filled with joy and '\n",
            "            'exuberance, captivating the audience with their fun-filled '\n",
            "            'routines. As they move gracefully and seamlessly, it is evident '\n",
            "            'that this group knows how to entertain and create a lively '\n",
            "            'atmosphere. They radiate enthusiasm and camaraderie, creating a '\n",
            "            'positive and infectious vibe wherever they go. Whether they are '\n",
            "            'dancing or simply strolling, their passion and zest for life '\n",
            "            'shine through, leaving a lasting impression on anyone fortunate '\n",
            "            'enough to witness their dynamic and energetic performance. The '\n",
            "            'video captures their carefree spirit and showcases the power of '\n",
            "            'unity and collaboration, reminding us all of the joy that comes '\n",
            "            'from coming together and embracing the present moment with '\n",
            "            'exuberance. It is impossible not to smile and feel uplifted when '\n",
            "            \"watching this group's captivating and spirited display. Prepare \"\n",
            "            'to be enchanted and energized as you join them on their journey '\n",
            "            'of fun and entertainment.'}\n"
          ]
        }
      ],
      "source": [
        "# Define the /summarize endpoint\n",
        "SUMMARIZE_URL = f\"{API_URL}/summarize\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "  \"video_id\": VIDEO_ID,\n",
        "  \"type\": \"summary\"\n",
        "}\n",
        "\n",
        "# Make a summarization request\n",
        "response = requests.post(SUMMARIZE_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "7CYf7KKBPWSi"
      },
      "source": [
        "Optionally, you can use the `prompt` field to provide context for the summarization task. The following example specifies the purpose and the desired length:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 22,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "r_go51_bPbLY",
        "outputId": "ba0e7a98-cfc5-475b-deb9-46462edf7a7d"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'id': '2c3572b5-12ff-40c6-bf4f-a97c0320d187',\n",
            " 'summary': 'A lively and energetic group of women are showcased in different '\n",
            "            'locations, dancing, singing, and having a great time. The video '\n",
            "            'captures their fun-filled performance and the enjoyment of the '\n",
            "            'people around them. Heineken beer is also featured, promoting a '\n",
            "            'lively house party atmosphere with singing, dancing, and the '\n",
            "            'Heineken logo. Join the excitement and fun with Heineken!'}\n"
          ]
        }
      ],
      "source": [
        "# Define the /summarize endpoint\n",
        "SUMMARIZE_URL = f\"{API_URL}/summarize\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "  \"video_id\": VIDEO_ID,\n",
        "  \"type\": \"summary\",\n",
        "  \"prompt\": \"Generate a summary of this video for a live TV report, up to three sentences.\"\n",
        "}\n",
        "\n",
        "# Make a summarization request\n",
        "response = requests.post(SUMMARIZE_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "NVvS8QrsPnPU"
      },
      "source": [
        "The following example generates a list of chapters for the specified video:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 23,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "KS3KRyXDPpHK",
        "outputId": "9a62dd15-1c83-4eee-c26e-7486653fb5f7"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'chapters': [{'chapter_number': 0,\n",
            "               'chapter_summary': 'A group of women walking, dancing, and '\n",
            "                                  'singing in various locations, showcasing '\n",
            "                                  'their fun and energetic performance.',\n",
            "               'chapter_title': 'A group of women making moves',\n",
            "               'end': 15,\n",
            "               'start': 0},\n",
            "              {'chapter_number': 1,\n",
            "               'chapter_summary': 'The video captures a group of people '\n",
            "                                  'enjoying themselves, dancing, and having a '\n",
            "                                  \"good time, promoting Heineken's lively \"\n",
            "                                  'house party.',\n",
            "               'chapter_title': 'Partying with Heineken',\n",
            "               'end': 30,\n",
            "               'start': 15}],\n",
            " 'id': '52bc7417-dc6d-4e9d-b928-597335518e82'}\n"
          ]
        }
      ],
      "source": [
        "# Define the /summarize endpoint\n",
        "SUMMARIZE_URL = f\"{API_URL}/summarize\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "  \"video_id\": VIDEO_ID,\n",
        "  \"type\": \"chapter\"\n",
        "}\n",
        "\n",
        "# Make a summarization request\n",
        "response = requests.post(SUMMARIZE_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "uJsEMtxQPxqS"
      },
      "source": [
        "Optionally, you can use the `prompt` parameter to indicate that the tone of voice should be very educational and instructional:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 24,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "IEpeMHGaPzUE",
        "outputId": "72fc0475-2d59-4dc9-92c5-03a4b5635589"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'chapters': [{'chapter_number': 0,\n",
            "               'chapter_summary': 'A group of women walking, dancing, and '\n",
            "                                  'singing in various locations, showcasing '\n",
            "                                  'their fun and energetic performance.',\n",
            "               'chapter_title': 'Group of women dancing and singing in various '\n",
            "                                'locations',\n",
            "               'end': 15,\n",
            "               'start': 0},\n",
            "              {'chapter_number': 1,\n",
            "               'chapter_summary': 'The video captures a group of people '\n",
            "                                  'enjoying themselves, dancing, and having a '\n",
            "                                  'good time.',\n",
            "               'chapter_title': 'People enjoying themselves in a lively '\n",
            "                                'atmosphere',\n",
            "               'end': 30,\n",
            "               'start': 15},\n",
            "              {'chapter_number': 2,\n",
            "               'chapter_summary': \"The video showcases Heineken's promotion of \"\n",
            "                                  'a lively house party, filled with singing, '\n",
            "                                  \"dancing, and the company's logo. Join the \"\n",
            "                                  'fun and excitement with Heineken beer!',\n",
            "               'chapter_title': \"Heineken's promotion of a lively house party\",\n",
            "               'end': 45,\n",
            "               'start': 30}],\n",
            " 'id': 'd5f3b94a-9a94-4824-9a6a-23ebeb2f07b6'}\n"
          ]
        }
      ],
      "source": [
        "# Define the /summarize endpoint\n",
        "SUMMARIZE_URL = f\"{API_URL}/summarize\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "  \"video_id\": VIDEO_ID,\n",
        "  \"type\": \"chapter\",\n",
        "  \"prompt\": \"Generate chapters using educational and instructional language.\"\n",
        "}\n",
        "\n",
        "# Make a summarization request\n",
        "response = requests.post(SUMMARIZE_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "flUhM8kSP7CQ"
      },
      "source": [
        "The following example generates a list of the important events or activities within a video:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 25,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "3fRtWUmqP7db",
        "outputId": "c97a2186-e0a8-4bd6-e826-9ce3f208e257"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'highlights': [{'end': 15,\n",
            "                 'highlight': 'A vibrant and lively group of women is seen '\n",
            "                              'dancing, singing, and walking in various '\n",
            "                              'locations',\n",
            "                 'highlight_summary': 'A group of women walking, dancing, and '\n",
            "                                      'singing in various locations, '\n",
            "                                      'showcasing their fun and energetic '\n",
            "                                      'performance.',\n",
            "                 'start': 0}],\n",
            " 'id': 'b203d41b-67f2-4ea2-a30d-3ab0dc2293bf'}\n"
          ]
        }
      ],
      "source": [
        "# Define the /summarize endpoint\n",
        "SUMMARIZE_URL = f\"{API_URL}/summarize\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "  \"video_id\": VIDEO_ID,\n",
        "  \"type\": \"highlight\"\n",
        "}\n",
        "\n",
        "# Make a summarization request\n",
        "response = requests.post(SUMMARIZE_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "L9idbrj8QBwD"
      },
      "source": [
        "Optionally, you can use the `prompt` parameter to generate highlights for the same video, showcasing the most surprising parts:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 26,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "g4azaGnUQDr4",
        "outputId": "0fd09736-8c21-4cda-c8cc-6a05abc8703f"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'highlights': [{'end': 15,\n",
            "                 'highlight': 'A vibrant and lively group of women dancing and '\n",
            "                              'singing in various locations.',\n",
            "                 'highlight_summary': 'A group of women walking, dancing, and '\n",
            "                                      'singing in various locations, '\n",
            "                                      'showcasing their fun and energetic '\n",
            "                                      'performance.',\n",
            "                 'start': 0},\n",
            "                {'end': 30,\n",
            "                 'highlight': 'The video captures a group of people enjoying '\n",
            "                              'themselves and having a good time.',\n",
            "                 'highlight_summary': 'The video captures a group of people '\n",
            "                                      'enjoying themselves, dancing, and '\n",
            "                                      'having a good time.',\n",
            "                 'start': 15},\n",
            "                {'end': 45,\n",
            "                 'highlight': \"Heineken's promotion of a lively house party, \"\n",
            "                              \"filled with singing, dancing, and the company's \"\n",
            "                              'logo.',\n",
            "                 'highlight_summary': \"The video showcases Heineken's \"\n",
            "                                      'promotion of a lively house party, '\n",
            "                                      'filled with singing, dancing, and the '\n",
            "                                      \"company's logo. Join the fun and \"\n",
            "                                      'excitement with Heineken beer!',\n",
            "                 'start': 30}],\n",
            " 'id': 'a64800ba-68fb-47f4-ae5e-579aa42cdb1c'}\n"
          ]
        }
      ],
      "source": [
        "# Define the /summarize endpoint\n",
        "SUMMARIZE_URL = f\"{API_URL}/summarize\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "  \"video_id\": VIDEO_ID,\n",
        "  \"type\": \"highlight\",\n",
        "  \"prompt\": \"Generate highlights that showcase the most surprising parts of the video.\"\n",
        "}\n",
        "\n",
        "# Make a summarization request\n",
        "response = requests.post(SUMMARIZE_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "oUn2t1Oa4JI3"
      },
      "source": [
        "### 5.3 - Generate open-ended textual representations\n",
        "Use the `/generate` endpoint for open-ended textual representations that are more customizable and tailor-made than the templates offered by the `/gist` and `/summarize` endpoints. This endpoint can produce a diverse range of textual representations based on your prompt, including, but not limited to, tables of content, action items, memos, reports and comprehensive analyses.\n",
        "\n",
        "The following example generates brief summary with a specific format:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 27,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "YV4bfITL4Nke",
        "outputId": "8b2a0522-14bc-4a4d-e2bc-48ac08c1000d"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': 'Title: \"A Fun-filled House Party with Music, Dance, and Playful '\n",
            "         'Interactions\"\\n'\n",
            "         '\\n'\n",
            "         'Summary: This video captures the energetic and lively atmosphere of '\n",
            "         'a house party, where a group of women in black and white attire can '\n",
            "         'be seen dancing, singing, and interacting with each other in various '\n",
            "         'locations. From the living room to the bedroom, dressing room, and '\n",
            "         'even the shoe store, they continue their performance while holding '\n",
            "         'drinks in their hands. The video showcases their playful '\n",
            "         'interactions, with scenes featuring men dancing, individuals looking '\n",
            "         'into a refrigerator, women examining dresses in front of a mirror, '\n",
            "         'and men clapping while enjoying their drinks. It truly encapsulates '\n",
            "         'the vibrant essence of a house party with lots of fun and music.',\n",
            " 'id': '415e8626-167b-4de4-8bcb-91097723fcb1'}\n"
          ]
        }
      ],
      "source": [
        "# Define the /generate endpoint\n",
        "GENERATE_URL = f\"{API_URL}/generate\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "  \"video_id\": VIDEO_ID,\n",
        "  \"prompt\": \"I want to generate a description for my video with the following format: Title of the video, followed by a summary in 2-3 sentences, highlighting the main topic, key events, and concluding remarks.\"\n",
        "}\n",
        "\n",
        "# Make a generation request\n",
        "response = requests.post(GENERATE_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "kuMxEBx1Q4_k"
      },
      "source": [
        "The following example generates a rap song based on the provided template:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 29,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "2j9F1N6xQ7Ax",
        "outputId": "9cb2aeba-87c7-41ea-81db-96dd9dfd4eef"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Status code: 200\n",
            "{'data': 'In a world of black and white, we come to life,\\n'\n",
            "         'A group of women walking, dancing, causing a strife.\\n'\n",
            "         \"Singing our hearts out, in every room we're found,\\n\"\n",
            "         'Living room, hallway, bedroom, all around.\\n'\n",
            "         '\\n'\n",
            "         \"We're dressed to impress, in our stylish attire,\\n\"\n",
            "         'Having a blast, setting the dance floor on fire.\\n'\n",
            "         'Interacting playfully, with drinks in our hand,\\n'\n",
            "         'Spreading joy and laughter, all across the land.\\n'\n",
            "         '\\n'\n",
            "         'We take the party to unexpected places,\\n'\n",
            "         'From the dressing room to the shoe store spaces.\\n'\n",
            "         'Even in the bathroom, we keep the energy high,\\n'\n",
            "         'No location can stop us, as we reach for the sky.\\n'\n",
            "         '\\n'\n",
            "         'Men join the fun, dancing and singing along,\\n'\n",
            "         'Creating memories as we groove to the song.\\n'\n",
            "         'Peeking into the fridge, finding our delights,\\n'\n",
            "         \"We're unstoppable, like stars shining through the nights.\\n\"\n",
            "         '\\n'\n",
            "         'Mirror becomes our stage, as we try on new dresses,\\n'\n",
            "         'Feeling empowered, each woman possesses.\\n'\n",
            "         'Clapping and cheering, while sipping on beer,\\n'\n",
            "         'Unleashing our spirits, releasing any fear.\\n'\n",
            "         '\\n'\n",
            "         'This video captures the essence of our house party,\\n'\n",
            "         \"A vibrant celebration, where everyone's hearty.\\n\"\n",
            "         'In black and white, we sing, dance, and connect,\\n'\n",
            "         \"An unforgettable experience, we'll never forget.\",\n",
            " 'id': '1444b156-728f-4a2f-be4f-5986efec14f6'}\n"
          ]
        }
      ],
      "source": [
        "# Define the /generate endpoint\n",
        "GENERATE_URL = f\"{API_URL}/generate\"\n",
        "\n",
        "# Set the header of the request\n",
        "headers = {\n",
        "    \"x-api-key\": API_KEY\n",
        "}\n",
        "\n",
        "# Declare a dictionary named `data`\n",
        "data = {\n",
        "  \"video_id\": VIDEO_ID,\n",
        "  \"prompt\": \"Write a rap song based on this video.\"\n",
        "}\n",
        "\n",
        "# Make a generation request\n",
        "response = requests.post(GENERATE_URL, headers=headers, json=data)\n",
        "print(f\"Status code: {response.status_code}\")\n",
        "pprint(response.json())"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "Have fun playing around with the Twelve Labs API!🚀"
      ],
      "metadata": {
        "id": "nm6gKtRijeH3"
      }
    }
  ],
  "metadata": {
    "colab": {
      "toc_visible": true,
      "provenance": []
    },
    "kernelspec": {
      "display_name": "Python 3",
      "name": "python3"
    },
    "language_info": {
      "name": "python"
    }
  },
  "nbformat": 4,
  "nbformat_minor": 0
}