05-Generate-Major-TOM-Embeddings.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "528b1ebf-0af4-4eca-a9d9-6fe30e2baaed",
   "metadata": {},
   "source": [
    "# Generate Major TOM Embeddings\n",
    "\n",
    "This notebook demonstrates how to turn Major TOM data parquets from the Core datasets into embedding parquets.\n",
    "\n",
    "This involves the process of reading, fragmenting and normalizing the data and then passing through one of supported embedding models.\n",
    "\n",
    "## Data Acquisition\n",
    "You can quickly get a local copy of some example parquets from the Major TOM Core datasets directly in Python like this:\n",
    "```python\n",
    "from huggingface_hub import hf_hub_download\n",
    "\n",
    "# Sentinel-2 L2A\n",
    "hf_hub_download(repo_id=\"Major-TOM/Core-S2L2A\",\n",
    "                subfolder=\"images\",\n",
    "                filename=\"part_00001.parquet\",\n",
    "                repo_type=\"dataset\",\n",
    "                local_dir=\"data/Major-TOM/Core-S2L2A\"\n",
    "               )\n",
    "               \n",
    "# Sentinel-2 L1C\n",
    "hf_hub_download(repo_id=\"Major-TOM/Core-S2L1C\",\n",
    "                subfolder=\"images\",\n",
    "                filename=\"part_00001.parquet\",\n",
    "                repo_type=\"dataset\",\n",
    "                local_dir=\"data/Major-TOM/Core-S2L1C\"\n",
    "               )\n",
    "\n",
    "# Sentinel-1 RTC\n",
    "hf_hub_download(repo_id=\"Major-TOM/Core-S1RTC\",\n",
    "                subfolder=\"images\",\n",
    "                filename=\"part_00001.parquet\",\n",
    "                repo_type=\"dataset\",\n",
    "                local_dir=\"data/Major-TOM/Core-S1RTC\"\n",
    "               )\n",
    "```\n",
    "but you can also pull the data directly from HuggingFace during the processing, although that can be slower."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "e555c2cb-1b10-45c1-8d69-f03ef930840c",
   "metadata": {},
   "source": [
    "## Define a Model & Embedder\n",
    "The main tool for turning a row of Major TOM data .parquet into a Major TOM embedding parquet is `MajorTOM_Embedder`, which is what we need to initialize first.\n",
    "\n",
    "When initialized, we want to pass the embedding model (which takes care of normalization of raw values and application of the model). We currently support:\n",
    "* `SigLIP_S2RGB_Embedder()`\n",
    "* `DINOv2_S2RGB_Embedder()`\n",
    "* `SSL4EO_S2L1C_Embedder()`\n",
    "* `SSL4EO_S1RTC_Embedder()`\n",
    "\n",
    "> This list might have been expanded further - check https://github.com/ESA-PhiLab/Major-TOM/tree/main/src/embedder/models to see the latest options."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "id": "3312a9be-50fe-49ae-ae39-5bf5afcc7ab9",
   "metadata": {},
   "outputs": [],
   "source": [
    "from src import *"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "87cd70c4-c4b6-4d80-965a-79d8e2ef477f",
   "metadata": {},
   "source": [
    "## Model Selection"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "id": "ade90cfc-b0f6-4e9c-8f2d-6951af4ecbc3",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Set Up Metadata\n",
    "DATASET_NAME = 'Major-TOM/Core-S2L2A'\n",
    "model = DINOv2_S2RGB_Embedder()\n",
    "#model = SigLIP_S2RGB_Embedder() also works for S2\n",
    "\n",
    "# Sentinel-2 L1C\n",
    "# DATASET_NAME = 'Major-TOM/Core-S2L1C'\n",
    "#model = SSL4EO_S2L1C_Embedder()\n",
    "\n",
    "# Sentinel-1 RTC\n",
    "# DATASET_NAME = 'Major-TOM/Core-S1RTC'\n",
    "# model = SSL4EO_S1RTC_Embedder()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "id": "b3225067-978e-4bb0-a9bf-031e9c53c207",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "MajorTOM_Embedder(\n",
       "  (embedder): DINOv2_S2RGB_Embedder(\n",
       "    (model): Dinov2Model(\n",
       "      (embeddings): Dinov2Embeddings(\n",
       "        (patch_embeddings): Dinov2PatchEmbeddings(\n",
       "          (projection): Conv2d(3, 768, kernel_size=(14, 14), stride=(14, 14))\n",
       "        )\n",
       "        (dropout): Dropout(p=0.0, inplace=False)\n",
       "      )\n",
       "      (encoder): Dinov2Encoder(\n",
       "        (layer): ModuleList(\n",
       "          (0-11): 12 x Dinov2Layer(\n",
       "            (norm1): LayerNorm((768,), eps=1e-06, elementwise_affine=True)\n",
       "            (attention): Dinov2Attention(\n",
       "              (attention): Dinov2SelfAttention(\n",
       "                (query): Linear(in_features=768, out_features=768, bias=True)\n",
       "                (key): Linear(in_features=768, out_features=768, bias=True)\n",
       "                (value): Linear(in_features=768, out_features=768, bias=True)\n",
       "                (dropout): Dropout(p=0.0, inplace=False)\n",
       "              )\n",
       "              (output): Dinov2SelfOutput(\n",
       "                (dense): Linear(in_features=768, out_features=768, bias=True)\n",
       "                (dropout): Dropout(p=0.0, inplace=False)\n",
       "              )\n",
       "            )\n",
       "            (layer_scale1): Dinov2LayerScale()\n",
       "            (drop_path): Identity()\n",
       "            (norm2): LayerNorm((768,), eps=1e-06, elementwise_affine=True)\n",
       "            (mlp): Dinov2MLP(\n",
       "              (fc1): Linear(in_features=768, out_features=3072, bias=True)\n",
       "              (activation): GELUActivation()\n",
       "              (fc2): Linear(in_features=3072, out_features=768, bias=True)\n",
       "            )\n",
       "            (layer_scale2): Dinov2LayerScale()\n",
       "          )\n",
       "        )\n",
       "      )\n",
       "      (layernorm): LayerNorm((768,), eps=1e-06, elementwise_affine=True)\n",
       "    )\n",
       "  )\n",
       ")"
      ]
     },
     "execution_count": 26,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "embedder = MajorTOM_Embedder(model)\n",
    "\n",
    "embedder.to('cuda')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "5fa5c43c-49ff-4961-b94a-51a745c4bc3c",
   "metadata": {},
   "source": [
    "## Assemble Data\n",
    "This notebook works directly with Major TOM parquets. So, we only need that **and** the metadata file for some additional context."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "id": "b2296eb7-e0ff-4d6c-b879-fdf800d0252f",
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/home/mczerkawski/mambaforge/envs/miko-torch/lib/python3.8/site-packages/fsspec/parquet.py:222: UserWarning: Not enough data was used to sample the parquet footer. Try setting footer_sample_size >= 1379925.\n",
      "  warnings.warn(\n"
     ]
    }
   ],
   "source": [
    "import pandas as pd\n",
    "import pyarrow as pa\n",
    "import pyarrow.parquet as pq\n",
    "from fsspec.parquet import open_parquet_file\n",
    "import rasterio as rio\n",
    "\n",
    "PARQUET_FILE = 'part_00001.parquet'\n",
    "\n",
    "meta_path = 'https://huggingface.co/datasets/{}/resolve/main/metadata.parquet'.format(DATASET_NAME)\n",
    "meta_df = pd.read_parquet(meta_path)\n",
    "\n",
    "# Set Up Data File\n",
    "\n",
    "# from HF directly\n",
    "parquet_file_path = 'https://huggingface.co/datasets/{}/resolve/main/images/{}'.format(DATASET_NAME, PARQUET_FILE)\n",
    "\n",
    "# local\n",
    "#parquet_file_path = f'./data/{DATASET_NAME}/images/part_00001.parquet'\n",
    "\n",
    "bands=embedder.bands()\n",
    "\n",
    "f = open_parquet_file(parquet_file_path, columns=[*bands,\n",
    "                                                  'product_id',\n",
    "                                                  'grid_cell',\n",
    "                                                  'timestamp',\n",
    "                                                 ])\n",
    "pf = pq.ParquetFile(f)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "93f6e35f-4204-48c9-a3a5-38ebb4848cd0",
   "metadata": {},
   "source": [
    "## Embed the rows\n",
    "The `MajorTOM_Embedder()` object can simply be called with `row, row_meta` fed in as arguments and it will return a `DataFrame` containing all standardized variables.\n",
    "\n",
    "In the process, it takes care of normalizing the data, and fragmenting it into smaller crops. The geometry of each crop is automatically generated."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "id": "9bf137ca-ed0d-4d5c-bfb1-e4138177296c",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "b56077552cd54c109d30d2785ed159fe",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "  0%|          | 0/500 [00:00<?, ?it/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "from tqdm.notebook import tqdm\n",
    "\n",
    "embed_df = None\n",
    "\n",
    "for row_idx in tqdm(range(pf.num_row_groups)):\n",
    "\n",
    "    # data & context\n",
    "    row= pf.read_row_group(row_idx, columns=[*bands, 'product_id','grid_cell','timestamp'])\n",
    "    row_meta = meta_df[(meta_df.grid_cell==row['grid_cell'][0].as_py()) & (meta_df.product_id==row['product_id'][0].as_py())].head(1)\n",
    "\n",
    "    # embedding functions\n",
    "    embed_dict = embedder(row, row_meta)\n",
    "\n",
    "    # store_df\n",
    "    if embed_df is None:\n",
    "        embed_df = embed_dict\n",
    "    else:\n",
    "        embed_df = pd.concat([embed_df, embed_dict])\n",
    "\n",
    "embed_df = embed_df.reset_index(drop=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "72658a03-59a9-4215-ba01-6584630d6b7d",
   "metadata": {},
   "source": [
    "## Save the embedding parquet\n",
    "Major TOM embeddings are delivered in the geoparquet format, so the file must be following this way:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "id": "486284c6-e511-4810-8b88-c22a2ad4ea8a",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>unique_id</th>\n",
       "      <th>embedding</th>\n",
       "      <th>timestamp</th>\n",
       "      <th>product_id</th>\n",
       "      <th>grid_cell</th>\n",
       "      <th>grid_row_u</th>\n",
       "      <th>grid_col_r</th>\n",
       "      <th>geometry</th>\n",
       "      <th>centre_lat</th>\n",
       "      <th>centre_lon</th>\n",
       "      <th>utm_footprint</th>\n",
       "      <th>utm_crs</th>\n",
       "      <th>pixel_bbox</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>8018b920fd8262ca6426d8d0c7bdb09905d19daf59d6f2...</td>\n",
       "      <td>[1.766272, -0.4046016, -0.21980742, -1.0928067...</td>\n",
       "      <td>20230119T161811</td>\n",
       "      <td>S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...</td>\n",
       "      <td>922D_249L</td>\n",
       "      <td>-922</td>\n",
       "      <td>-249</td>\n",
       "      <td>POLYGON ((-178.41163 -82.72221, -178.41551 -82...</td>\n",
       "      <td>-82.731987</td>\n",
       "      <td>-178.492844</td>\n",
       "      <td>POLYGON ((480037.35680356843 814306.7102547885...</td>\n",
       "      <td>EPSG:32701</td>\n",
       "      <td>[0, 0, 224, 224]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>7f74df14d868694602ff4980a2176470dcb25c570de459...</td>\n",
       "      <td>[1.766272, -0.4046016, -0.21980742, -1.0928067...</td>\n",
       "      <td>20230119T161811</td>\n",
       "      <td>S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...</td>\n",
       "      <td>922D_249L</td>\n",
       "      <td>-922</td>\n",
       "      <td>-249</td>\n",
       "      <td>POLYGON ((-178.41528 -82.74111, -178.41918 -82...</td>\n",
       "      <td>-82.750885</td>\n",
       "      <td>-178.496704</td>\n",
       "      <td>POLYGON ((480037.35680356843 812196.7102547885...</td>\n",
       "      <td>EPSG:32701</td>\n",
       "      <td>[0, 211, 224, 435]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>304046a18855a98a0d5aa22ccded49286ac580145106a2...</td>\n",
       "      <td>[1.766272, -0.4046016, -0.21980742, -1.0928067...</td>\n",
       "      <td>20230119T161811</td>\n",
       "      <td>S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...</td>\n",
       "      <td>922D_249L</td>\n",
       "      <td>-922</td>\n",
       "      <td>-249</td>\n",
       "      <td>POLYGON ((-178.41896 -82.76001, -178.42288 -82...</td>\n",
       "      <td>-82.769783</td>\n",
       "      <td>-178.500595</td>\n",
       "      <td>POLYGON ((480037.35680356843 810086.7102547885...</td>\n",
       "      <td>EPSG:32701</td>\n",
       "      <td>[0, 422, 224, 646]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>f80b07f5c7ddefe1fa8aa536a911e1a9a587b453dc5084...</td>\n",
       "      <td>[1.766272, -0.4046016, -0.21980742, -1.0928067...</td>\n",
       "      <td>20230119T161811</td>\n",
       "      <td>S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...</td>\n",
       "      <td>922D_249L</td>\n",
       "      <td>-922</td>\n",
       "      <td>-249</td>\n",
       "      <td>POLYGON ((-178.42265 -82.77890, -178.42659 -82...</td>\n",
       "      <td>-82.788673</td>\n",
       "      <td>-178.504517</td>\n",
       "      <td>POLYGON ((480037.35680356843 807976.7102547885...</td>\n",
       "      <td>EPSG:32701</td>\n",
       "      <td>[0, 633, 224, 857]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>55aad9b5df58ea9fd14cdbd9e4b2ffbe3a8954ac5d9f52...</td>\n",
       "      <td>[1.766272, -0.4046016, -0.21980742, -1.0928067...</td>\n",
       "      <td>20230119T161811</td>\n",
       "      <td>S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...</td>\n",
       "      <td>922D_249L</td>\n",
       "      <td>-922</td>\n",
       "      <td>-249</td>\n",
       "      <td>POLYGON ((-178.42636 -82.79780, -178.43033 -82...</td>\n",
       "      <td>-82.807571</td>\n",
       "      <td>-178.508438</td>\n",
       "      <td>POLYGON ((480037.35680356843 805866.7102547885...</td>\n",
       "      <td>EPSG:32701</td>\n",
       "      <td>[0, 844, 224, 1068]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12495</th>\n",
       "      <td>9ea04479469d5955f64a2e767528a286aef8fae3f093ba...</td>\n",
       "      <td>[1.8706962, -0.36548963, -0.16844065, -1.15036...</td>\n",
       "      <td>20231023T083029</td>\n",
       "      <td>S2B_MSIL2A_20231023T083029_N0509_R135_T22CEP_2...</td>\n",
       "      <td>918D_75L</td>\n",
       "      <td>-918</td>\n",
       "      <td>-75</td>\n",
       "      <td>POLYGON ((-50.53373 -82.36227, -50.53251 -82.3...</td>\n",
       "      <td>-82.372375</td>\n",
       "      <td>-50.608696</td>\n",
       "      <td>POLYGON ((506918.63283075346 854703.0551686661...</td>\n",
       "      <td>EPSG:32722</td>\n",
       "      <td>[844, 0, 1068, 224]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12496</th>\n",
       "      <td>9c09db25fe30b6fc8d7f24dacd71c6a6dc3048a7d1865f...</td>\n",
       "      <td>[1.6086377, 0.3244056, 0.69208705, -1.4272233,...</td>\n",
       "      <td>20231023T083029</td>\n",
       "      <td>S2B_MSIL2A_20231023T083029_N0509_R135_T22CEP_2...</td>\n",
       "      <td>918D_75L</td>\n",
       "      <td>-918</td>\n",
       "      <td>-75</td>\n",
       "      <td>POLYGON ((-50.53258 -82.38118, -50.53135 -82.4...</td>\n",
       "      <td>-82.391281</td>\n",
       "      <td>-50.607727</td>\n",
       "      <td>POLYGON ((506918.63283075346 852593.0551686661...</td>\n",
       "      <td>EPSG:32722</td>\n",
       "      <td>[844, 211, 1068, 435]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12497</th>\n",
       "      <td>054f382885a34a9086701caa5d63596fed2b539afc4109...</td>\n",
       "      <td>[1.1596069, -0.452088, -0.72552645, -0.7785724...</td>\n",
       "      <td>20231023T083029</td>\n",
       "      <td>S2B_MSIL2A_20231023T083029_N0509_R135_T22CEP_2...</td>\n",
       "      <td>918D_75L</td>\n",
       "      <td>-918</td>\n",
       "      <td>-75</td>\n",
       "      <td>POLYGON ((-50.53142 -82.40008, -50.53019 -82.4...</td>\n",
       "      <td>-82.410179</td>\n",
       "      <td>-50.606758</td>\n",
       "      <td>POLYGON ((506918.63283075346 850483.0551686661...</td>\n",
       "      <td>EPSG:32722</td>\n",
       "      <td>[844, 422, 1068, 646]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12498</th>\n",
       "      <td>75bcaa8a658a9eb5cf7d2874c0da45e1c77a2555e0ce7b...</td>\n",
       "      <td>[1.7653571, -0.40404075, -0.2192422, -1.091481...</td>\n",
       "      <td>20231023T083029</td>\n",
       "      <td>S2B_MSIL2A_20231023T083029_N0509_R135_T22CEP_2...</td>\n",
       "      <td>918D_75L</td>\n",
       "      <td>-918</td>\n",
       "      <td>-75</td>\n",
       "      <td>POLYGON ((-50.53026 -82.41898, -50.52902 -82.4...</td>\n",
       "      <td>-82.429085</td>\n",
       "      <td>-50.605782</td>\n",
       "      <td>POLYGON ((506918.63283075346 848373.0551686661...</td>\n",
       "      <td>EPSG:32722</td>\n",
       "      <td>[844, 633, 1068, 857]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12499</th>\n",
       "      <td>2c9e0c3acda0528a54f53cb44003b31d7171b9b645ef40...</td>\n",
       "      <td>[1.5279864, -0.4177594, -0.16634168, -1.019465...</td>\n",
       "      <td>20231023T083029</td>\n",
       "      <td>S2B_MSIL2A_20231023T083029_N0509_R135_T22CEP_2...</td>\n",
       "      <td>918D_75L</td>\n",
       "      <td>-918</td>\n",
       "      <td>-75</td>\n",
       "      <td>POLYGON ((-50.52909 -82.43788, -50.52785 -82.4...</td>\n",
       "      <td>-82.447983</td>\n",
       "      <td>-50.604801</td>\n",
       "      <td>POLYGON ((506918.63283075346 846263.0551686661...</td>\n",
       "      <td>EPSG:32722</td>\n",
       "      <td>[844, 844, 1068, 1068]</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>12500 rows × 13 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                               unique_id  \\\n",
       "0      8018b920fd8262ca6426d8d0c7bdb09905d19daf59d6f2...   \n",
       "1      7f74df14d868694602ff4980a2176470dcb25c570de459...   \n",
       "2      304046a18855a98a0d5aa22ccded49286ac580145106a2...   \n",
       "3      f80b07f5c7ddefe1fa8aa536a911e1a9a587b453dc5084...   \n",
       "4      55aad9b5df58ea9fd14cdbd9e4b2ffbe3a8954ac5d9f52...   \n",
       "...                                                  ...   \n",
       "12495  9ea04479469d5955f64a2e767528a286aef8fae3f093ba...   \n",
       "12496  9c09db25fe30b6fc8d7f24dacd71c6a6dc3048a7d1865f...   \n",
       "12497  054f382885a34a9086701caa5d63596fed2b539afc4109...   \n",
       "12498  75bcaa8a658a9eb5cf7d2874c0da45e1c77a2555e0ce7b...   \n",
       "12499  2c9e0c3acda0528a54f53cb44003b31d7171b9b645ef40...   \n",
       "\n",
       "                                               embedding        timestamp  \\\n",
       "0      [1.766272, -0.4046016, -0.21980742, -1.0928067...  20230119T161811   \n",
       "1      [1.766272, -0.4046016, -0.21980742, -1.0928067...  20230119T161811   \n",
       "2      [1.766272, -0.4046016, -0.21980742, -1.0928067...  20230119T161811   \n",
       "3      [1.766272, -0.4046016, -0.21980742, -1.0928067...  20230119T161811   \n",
       "4      [1.766272, -0.4046016, -0.21980742, -1.0928067...  20230119T161811   \n",
       "...                                                  ...              ...   \n",
       "12495  [1.8706962, -0.36548963, -0.16844065, -1.15036...  20231023T083029   \n",
       "12496  [1.6086377, 0.3244056, 0.69208705, -1.4272233,...  20231023T083029   \n",
       "12497  [1.1596069, -0.452088, -0.72552645, -0.7785724...  20231023T083029   \n",
       "12498  [1.7653571, -0.40404075, -0.2192422, -1.091481...  20231023T083029   \n",
       "12499  [1.5279864, -0.4177594, -0.16634168, -1.019465...  20231023T083029   \n",
       "\n",
       "                                              product_id  grid_cell  \\\n",
       "0      S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...  922D_249L   \n",
       "1      S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...  922D_249L   \n",
       "2      S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...  922D_249L   \n",
       "3      S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...  922D_249L   \n",
       "4      S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...  922D_249L   \n",
       "...                                                  ...        ...   \n",
       "12495  S2B_MSIL2A_20231023T083029_N0509_R135_T22CEP_2...   918D_75L   \n",
       "12496  S2B_MSIL2A_20231023T083029_N0509_R135_T22CEP_2...   918D_75L   \n",
       "12497  S2B_MSIL2A_20231023T083029_N0509_R135_T22CEP_2...   918D_75L   \n",
       "12498  S2B_MSIL2A_20231023T083029_N0509_R135_T22CEP_2...   918D_75L   \n",
       "12499  S2B_MSIL2A_20231023T083029_N0509_R135_T22CEP_2...   918D_75L   \n",
       "\n",
       "       grid_row_u  grid_col_r  \\\n",
       "0            -922        -249   \n",
       "1            -922        -249   \n",
       "2            -922        -249   \n",
       "3            -922        -249   \n",
       "4            -922        -249   \n",
       "...           ...         ...   \n",
       "12495        -918         -75   \n",
       "12496        -918         -75   \n",
       "12497        -918         -75   \n",
       "12498        -918         -75   \n",
       "12499        -918         -75   \n",
       "\n",
       "                                                geometry  centre_lat  \\\n",
       "0      POLYGON ((-178.41163 -82.72221, -178.41551 -82...  -82.731987   \n",
       "1      POLYGON ((-178.41528 -82.74111, -178.41918 -82...  -82.750885   \n",
       "2      POLYGON ((-178.41896 -82.76001, -178.42288 -82...  -82.769783   \n",
       "3      POLYGON ((-178.42265 -82.77890, -178.42659 -82...  -82.788673   \n",
       "4      POLYGON ((-178.42636 -82.79780, -178.43033 -82...  -82.807571   \n",
       "...                                                  ...         ...   \n",
       "12495  POLYGON ((-50.53373 -82.36227, -50.53251 -82.3...  -82.372375   \n",
       "12496  POLYGON ((-50.53258 -82.38118, -50.53135 -82.4...  -82.391281   \n",
       "12497  POLYGON ((-50.53142 -82.40008, -50.53019 -82.4...  -82.410179   \n",
       "12498  POLYGON ((-50.53026 -82.41898, -50.52902 -82.4...  -82.429085   \n",
       "12499  POLYGON ((-50.52909 -82.43788, -50.52785 -82.4...  -82.447983   \n",
       "\n",
       "       centre_lon                                      utm_footprint  \\\n",
       "0     -178.492844  POLYGON ((480037.35680356843 814306.7102547885...   \n",
       "1     -178.496704  POLYGON ((480037.35680356843 812196.7102547885...   \n",
       "2     -178.500595  POLYGON ((480037.35680356843 810086.7102547885...   \n",
       "3     -178.504517  POLYGON ((480037.35680356843 807976.7102547885...   \n",
       "4     -178.508438  POLYGON ((480037.35680356843 805866.7102547885...   \n",
       "...           ...                                                ...   \n",
       "12495  -50.608696  POLYGON ((506918.63283075346 854703.0551686661...   \n",
       "12496  -50.607727  POLYGON ((506918.63283075346 852593.0551686661...   \n",
       "12497  -50.606758  POLYGON ((506918.63283075346 850483.0551686661...   \n",
       "12498  -50.605782  POLYGON ((506918.63283075346 848373.0551686661...   \n",
       "12499  -50.604801  POLYGON ((506918.63283075346 846263.0551686661...   \n",
       "\n",
       "          utm_crs              pixel_bbox  \n",
       "0      EPSG:32701        [0, 0, 224, 224]  \n",
       "1      EPSG:32701      [0, 211, 224, 435]  \n",
       "2      EPSG:32701      [0, 422, 224, 646]  \n",
       "3      EPSG:32701      [0, 633, 224, 857]  \n",
       "4      EPSG:32701     [0, 844, 224, 1068]  \n",
       "...           ...                     ...  \n",
       "12495  EPSG:32722     [844, 0, 1068, 224]  \n",
       "12496  EPSG:32722   [844, 211, 1068, 435]  \n",
       "12497  EPSG:32722   [844, 422, 1068, 646]  \n",
       "12498  EPSG:32722   [844, 633, 1068, 857]  \n",
       "12499  EPSG:32722  [844, 844, 1068, 1068]  \n",
       "\n",
       "[12500 rows x 13 columns]"
      ]
     },
     "execution_count": 32,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "embed_df"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "id": "e4f2fbe9-16ff-42b6-9d42-54120a11e379",
   "metadata": {},
   "outputs": [],
   "source": [
    "embed_df.to_parquet(f'embedded-{PARQUET_FILE}')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "2324db3e-8ac2-460d-a321-6ddc190a4da7",
   "metadata": {},
   "source": [
    "## Read the saved file"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "id": "18784fd7-41ab-4e56-9708-25ab3403782c",
   "metadata": {},
   "outputs": [],
   "source": [
    "sanity_check = gpd.read_parquet(f'embedded-{PARQUET_FILE}')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "id": "6002f6e2-a6ea-4ba6-8ab1-5590a9e410c3",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>unique_id</th>\n",
       "      <th>embedding</th>\n",
       "      <th>timestamp</th>\n",
       "      <th>product_id</th>\n",
       "      <th>grid_cell</th>\n",
       "      <th>grid_row_u</th>\n",
       "      <th>grid_col_r</th>\n",
       "      <th>geometry</th>\n",
       "      <th>centre_lat</th>\n",
       "      <th>centre_lon</th>\n",
       "      <th>utm_footprint</th>\n",
       "      <th>utm_crs</th>\n",
       "      <th>pixel_bbox</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>8018b920fd8262ca6426d8d0c7bdb09905d19daf59d6f2...</td>\n",
       "      <td>[1.766272, -0.4046016, -0.21980742, -1.0928067...</td>\n",
       "      <td>20230119T161811</td>\n",
       "      <td>S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...</td>\n",
       "      <td>922D_249L</td>\n",
       "      <td>-922</td>\n",
       "      <td>-249</td>\n",
       "      <td>POLYGON ((-178.41163 -82.72221, -178.41551 -82...</td>\n",
       "      <td>-82.731987</td>\n",
       "      <td>-178.492844</td>\n",
       "      <td>POLYGON ((480037.35680356843 814306.7102547885...</td>\n",
       "      <td>EPSG:32701</td>\n",
       "      <td>[0, 0, 224, 224]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>7f74df14d868694602ff4980a2176470dcb25c570de459...</td>\n",
       "      <td>[1.766272, -0.4046016, -0.21980742, -1.0928067...</td>\n",
       "      <td>20230119T161811</td>\n",
       "      <td>S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...</td>\n",
       "      <td>922D_249L</td>\n",
       "      <td>-922</td>\n",
       "      <td>-249</td>\n",
       "      <td>POLYGON ((-178.41528 -82.74111, -178.41918 -82...</td>\n",
       "      <td>-82.750885</td>\n",
       "      <td>-178.496704</td>\n",
       "      <td>POLYGON ((480037.35680356843 812196.7102547885...</td>\n",
       "      <td>EPSG:32701</td>\n",
       "      <td>[0, 211, 224, 435]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>304046a18855a98a0d5aa22ccded49286ac580145106a2...</td>\n",
       "      <td>[1.766272, -0.4046016, -0.21980742, -1.0928067...</td>\n",
       "      <td>20230119T161811</td>\n",
       "      <td>S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...</td>\n",
       "      <td>922D_249L</td>\n",
       "      <td>-922</td>\n",
       "      <td>-249</td>\n",
       "      <td>POLYGON ((-178.41896 -82.76001, -178.42288 -82...</td>\n",
       "      <td>-82.769783</td>\n",
       "      <td>-178.500595</td>\n",
       "      <td>POLYGON ((480037.35680356843 810086.7102547885...</td>\n",
       "      <td>EPSG:32701</td>\n",
       "      <td>[0, 422, 224, 646]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>f80b07f5c7ddefe1fa8aa536a911e1a9a587b453dc5084...</td>\n",
       "      <td>[1.766272, -0.4046016, -0.21980742, -1.0928067...</td>\n",
       "      <td>20230119T161811</td>\n",
       "      <td>S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...</td>\n",
       "      <td>922D_249L</td>\n",
       "      <td>-922</td>\n",
       "      <td>-249</td>\n",
       "      <td>POLYGON ((-178.42265 -82.77890, -178.42659 -82...</td>\n",
       "      <td>-82.788673</td>\n",
       "      <td>-178.504517</td>\n",
       "      <td>POLYGON ((480037.35680356843 807976.7102547885...</td>\n",
       "      <td>EPSG:32701</td>\n",
       "      <td>[0, 633, 224, 857]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>55aad9b5df58ea9fd14cdbd9e4b2ffbe3a8954ac5d9f52...</td>\n",
       "      <td>[1.766272, -0.4046016, -0.21980742, -1.0928067...</td>\n",
       "      <td>20230119T161811</td>\n",
       "      <td>S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...</td>\n",
       "      <td>922D_249L</td>\n",
       "      <td>-922</td>\n",
       "      <td>-249</td>\n",
       "      <td>POLYGON ((-178.42636 -82.79780, -178.43033 -82...</td>\n",
       "      <td>-82.807571</td>\n",
       "      <td>-178.508438</td>\n",
       "      <td>POLYGON ((480037.35680356843 805866.7102547885...</td>\n",
       "      <td>EPSG:32701</td>\n",
       "      <td>[0, 844, 224, 1068]</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                           unique_id  \\\n",
       "0  8018b920fd8262ca6426d8d0c7bdb09905d19daf59d6f2...   \n",
       "1  7f74df14d868694602ff4980a2176470dcb25c570de459...   \n",
       "2  304046a18855a98a0d5aa22ccded49286ac580145106a2...   \n",
       "3  f80b07f5c7ddefe1fa8aa536a911e1a9a587b453dc5084...   \n",
       "4  55aad9b5df58ea9fd14cdbd9e4b2ffbe3a8954ac5d9f52...   \n",
       "\n",
       "                                           embedding        timestamp  \\\n",
       "0  [1.766272, -0.4046016, -0.21980742, -1.0928067...  20230119T161811   \n",
       "1  [1.766272, -0.4046016, -0.21980742, -1.0928067...  20230119T161811   \n",
       "2  [1.766272, -0.4046016, -0.21980742, -1.0928067...  20230119T161811   \n",
       "3  [1.766272, -0.4046016, -0.21980742, -1.0928067...  20230119T161811   \n",
       "4  [1.766272, -0.4046016, -0.21980742, -1.0928067...  20230119T161811   \n",
       "\n",
       "                                          product_id  grid_cell  grid_row_u  \\\n",
       "0  S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...  922D_249L        -922   \n",
       "1  S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...  922D_249L        -922   \n",
       "2  S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...  922D_249L        -922   \n",
       "3  S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...  922D_249L        -922   \n",
       "4  S2A_MSIL2A_20230119T161811_N0509_R111_T01CDJ_2...  922D_249L        -922   \n",
       "\n",
       "   grid_col_r                                           geometry  centre_lat  \\\n",
       "0        -249  POLYGON ((-178.41163 -82.72221, -178.41551 -82...  -82.731987   \n",
       "1        -249  POLYGON ((-178.41528 -82.74111, -178.41918 -82...  -82.750885   \n",
       "2        -249  POLYGON ((-178.41896 -82.76001, -178.42288 -82...  -82.769783   \n",
       "3        -249  POLYGON ((-178.42265 -82.77890, -178.42659 -82...  -82.788673   \n",
       "4        -249  POLYGON ((-178.42636 -82.79780, -178.43033 -82...  -82.807571   \n",
       "\n",
       "   centre_lon                                      utm_footprint     utm_crs  \\\n",
       "0 -178.492844  POLYGON ((480037.35680356843 814306.7102547885...  EPSG:32701   \n",
       "1 -178.496704  POLYGON ((480037.35680356843 812196.7102547885...  EPSG:32701   \n",
       "2 -178.500595  POLYGON ((480037.35680356843 810086.7102547885...  EPSG:32701   \n",
       "3 -178.504517  POLYGON ((480037.35680356843 807976.7102547885...  EPSG:32701   \n",
       "4 -178.508438  POLYGON ((480037.35680356843 805866.7102547885...  EPSG:32701   \n",
       "\n",
       "            pixel_bbox  \n",
       "0     [0, 0, 224, 224]  \n",
       "1   [0, 211, 224, 435]  \n",
       "2   [0, 422, 224, 646]  \n",
       "3   [0, 633, 224, 857]  \n",
       "4  [0, 844, 224, 1068]  "
      ]
     },
     "execution_count": 35,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "sanity_check.head()"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python [conda env:miko-torch] *",
   "language": "python",
   "name": "conda-env-miko-torch-py"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.17"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}