notebooks/Existing and new generators.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Group existing generators within regions and create new resources\n",
    "\n",
    "This notebook shows how to use the PowerGenome API to cluster existing resources and create new-build resource options by model region. You'll need a settings file, such as the `test_settings.yml` provided in the `example_system` folder, with the following parameters.\n",
    "\n",
    "For both existing and new resource:\n",
    "- model_regions\n",
    "- region_aggregations\n",
    "- model_year\n",
    "- target_usd_year\n",
    "- atb_usd_year\n",
    "- startup_fuel_use\n",
    "- startup_vom_costs_mw\n",
    "- startup_vom_costs_usd_year\n",
    "- startup_costs_type\n",
    "- startup_costs_per_cold_start_mw\n",
    "- startup_costs_per_cold_start_usd_year\n",
    "- existing_startup_costs_tech_map\n",
    "- new_build_startup_costs\n",
    "\n",
    "Specific to existing resource:\n",
    "- num_clusters\n",
    "- retirement_ages\n",
    "- atb_existing_year\n",
    "- existing_om_muiltiplier\n",
    "- eia_atb_tech_map\n",
    "- proposed_status_included\n",
    "- proposed_gen_heat_rates\n",
    "- proposed_min_load\n",
    "\n",
    "Specific to new-build resources:\n",
    "- atb_cost_case\n",
    "- atb_financial_case\n",
    "- atb_cap_recovery_years\n",
    "- atb_new_gen\n",
    "- renewables_clusters\n",
    "- cost_multiplier_region_map\n",
    "- cost_multiplier_technology_map\n",
    "- transmission_investment_cost (if spur-lines are needed for non-renewable resources)\n",
    "\n",
    "To calculate fuel costs for each resource:\n",
    "- aeo_fuel_region_map\n",
    "- eia_series_region_names\n",
    "- eia_series_fuel_names\n",
    "- eia_aeo_year\n",
    "- eia_series_scenario_names\n",
    "- aeo_fuel_scenarios\n",
    "- aeo_fuel_usd_year\n",
    "- tech_fuel_map\n",
    "- fuel_emission_factors\n",
    "- carbon_tax (optional)\n",
    "\n",
    "And if CCS resources are included:\n",
    "- ccs_fuel_map\n",
    "- ccs_capture_rate\n",
    "- ccs_disposal_cost"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "%load_ext autoreload\n",
    "%autoreload 2"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "from pathlib import Path\n",
    "\n",
    "import geopandas as gpd\n",
    "import numpy as np\n",
    "import pandas as pd\n",
    "from powergenome.generators import GeneratorClusters\n",
    "from powergenome.GenX import reduce_time_domain\n",
    "from powergenome.load_profiles import make_final_load_curves\n",
    "from powergenome.params import DATA_PATHS\n",
    "from powergenome.util import (\n",
    "    build_scenario_settings,\n",
    "    init_pudl_connection,\n",
    "    load_settings,\n",
    "    check_settings\n",
    ")\n",
    "from powergenome.external_data import (\n",
    "    make_demand_response_profiles,\n",
    "    make_generator_variability,\n",
    ")\n",
    "\n",
    "pd.options.display.max_columns = 200"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Import settings and create database connections\n",
    "This assumes that the settings file is set up for multiple scenarios/planning periods. If you are using a settings file with only a single scenario/planning period, remove or comment out the line with `build_scenario_settings`.\n",
    "\n",
    "Once the settings file is loaded, use the `data_years` to limit the amount of data processed in `pudl_out`. Limiting the data years will reduce run time. \n",
    "\n",
    "Finally, check the settings for some common user errors. These currently include:\n",
    "- Are all aggregated regions in `region_aggregations` valid IPM regions?\n",
    "- Are all model regions included in the parameters `cost_multiplier_region_map` and `aeo_fuel_region_map`?\n",
    "- Are any column names included more than once in `generator_columns`?\n",
    "- The AEO reference scenario names for fuel cost and demand growth are of the form `REF<AEO year>`. Does the AEO year match the parameter `eia_aeo_year`?\n",
    "- Are the technologies in `atb_new_gen` all valid names?\n",
    "\n",
    "Most of these catch simple mistakes like misspelled region/technology names. If you would like any additional checks included, [submit an issue](https://github.com/PowerGenome/PowerGenome/issues) or make the changes yourself and submit a pull request."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "cwd = Path.cwd()\n",
    "\n",
    "settings_path = (\n",
    "    cwd.parent / \"example_systems\" / \"CA_AZ\" / \"test_settings.yml\"\n",
    ")\n",
    "settings = load_settings(settings_path)\n",
    "settings[\"input_folder\"] = settings_path.parent / settings[\"input_folder\"]\n",
    "scenario_definitions = pd.read_csv(\n",
    "    settings[\"input_folder\"] / settings[\"scenario_definitions_fn\"]\n",
    ")\n",
    "scenario_settings = build_scenario_settings(settings, scenario_definitions)\n",
    "\n",
    "pudl_engine, pudl_out, pg_engine = init_pudl_connection(\n",
    "    freq=\"AS\",\n",
    "    start_year=min(settings.get(\"data_years\")),\n",
    "    end_year=max(settings.get(\"data_years\")),\n",
    ")\n",
    "\n",
    "check_settings(settings, pg_engine)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Initialize a `GeneratorClusters` object\n",
    "\n",
    "`GeneratorClusters` is how existing generators are clustered, and it provides a convinience method for creating new-build resources (`GeneratorClusters.create_new_generators`)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "794.1999999999999  MW without lat/lon\n"
     ]
    }
   ],
   "source": [
    "gc = GeneratorClusters(pudl_engine, pudl_out, pg_engine, scenario_settings[2045][\"p1\"])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "tags": []
   },
   "source": [
    "### Existing generators\n",
    "\n",
    "Lets look at how existing generators have been clustered in the different regions. The raw output from `create_region_technology_clusters` has lots of extra columns that might not be needed. Some of them include:\n",
    "\n",
    "- `resource` is a snake case version of `technology`.\n",
    "- `unmodified_cap_size` is the average size of generating units. `Cap_size` is `unmodified_cap_size` multiplied by the capacity factor for technologies that are derated by their CF.\n",
    "- `Existing_Cap_MW` is `Cap_size` multiplied by `num_units`.\n",
    "- `heat_rate_mmbtu_mwh_iqr` and `heat_rate_mmbtu_mwh_std` are measurements of how widely the heate rate varies within a cluster. If these values are large compared to `Heat_rate_MMBTU_per_MWh` then you might consider increasing the number of clusters for that technology/region.\n",
    "- `Fuel` is a combination of the region (assigned by the settings parameter `fuel_region_map`), the AEO scenario (assigned by the settings parameter `aeo_fuel_scenarios`), and the fuel type for that generator resource (assigned by the settings parameters `tech_fuel_map` and `ccs_fuel_map`). Only fuels in AEO are included, which means that biomass/hydrogen/RNG, etc are not options.\n",
    "\n",
    "The various \"model tags\" that are included in the settings file are unique to GenX. If you find them useful, they can be used to assign various values of any data type to generators in a column name of your choosing. If you don't want to use them, they can be ignored or removed via `settings.pop(<name>)`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Technology Conventional Hydroelectric changed capacity from 12699.700000000008 to 12704.200000000008\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Creating gdf\n",
      "['Solar Photovoltaic', 'Onshore Wind Turbine', 'Batteries', 'Biomass', 'Conventional Hydroelectric', 'Natural Gas Fired Combined Cycle', 'Other_peaker', 'All Other', 'Natural Gas Fired Combustion Turbine', 'Other Natural Gas']\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "No model tag values found for MinCapTag_2 ('MinCapTag_2')\n",
      "No model tag values found for Reg_Max ('Reg_Max')\n",
      "No model tag values found for Rsv_Max ('Rsv_Max')\n"
     ]
    }
   ],
   "source": [
    "existing_gen = gc.create_region_technology_clusters()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>region</th>\n",
       "      <th>technology</th>\n",
       "      <th>cluster</th>\n",
       "      <th>index</th>\n",
       "      <th>Cap_size</th>\n",
       "      <th>minimum_load_mw</th>\n",
       "      <th>Heat_Rate_MMBTU_per_MWh</th>\n",
       "      <th>Fixed_OM_Cost_per_MWyr</th>\n",
       "      <th>Var_OM_Cost_per_MWh</th>\n",
       "      <th>heat_rate_mmbtu_mwh_iqr</th>\n",
       "      <th>heat_rate_mmbtu_mwh_std</th>\n",
       "      <th>fixed_o_m_mw_std</th>\n",
       "      <th>Min_Power</th>\n",
       "      <th>num_units</th>\n",
       "      <th>plant_id_eia</th>\n",
       "      <th>unit_id_pudl</th>\n",
       "      <th>capacity_factor</th>\n",
       "      <th>unmodified_cap_size</th>\n",
       "      <th>Existing_Cap_MW</th>\n",
       "      <th>unmodified_existing_cap_mw</th>\n",
       "      <th>Start_fuel_MMBTU_per_MW</th>\n",
       "      <th>Fuel</th>\n",
       "      <th>Start_Cost_per_MW</th>\n",
       "      <th>THERM</th>\n",
       "      <th>VRE</th>\n",
       "      <th>Num_VRE_Bins</th>\n",
       "      <th>MUST_RUN</th>\n",
       "      <th>STOR</th>\n",
       "      <th>FLEX</th>\n",
       "      <th>HYDRO</th>\n",
       "      <th>Commit</th>\n",
       "      <th>ESR_1</th>\n",
       "      <th>ESR_2</th>\n",
       "      <th>New_Build</th>\n",
       "      <th>Hydro_level</th>\n",
       "      <th>CapRes_1</th>\n",
       "      <th>CapRes_2</th>\n",
       "      <th>Hydro_Energy_to_Power_Ratio</th>\n",
       "      <th>MinCapTag_1</th>\n",
       "      <th>MinCapTag_2</th>\n",
       "      <th>Reg_Max</th>\n",
       "      <th>Rsv_Max</th>\n",
       "      <th>Resource</th>\n",
       "      <th>profile</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>Biomass</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1.094</td>\n",
       "      <td>1.064</td>\n",
       "      <td>16.157</td>\n",
       "      <td>122976.000</td>\n",
       "      <td>5.655</td>\n",
       "      <td>1.483</td>\n",
       "      <td>4.067</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.354</td>\n",
       "      <td>56</td>\n",
       "      <td>[10748, 10748, 10748, 50112, 54517, 56080, 560...</td>\n",
       "      <td>[10748_U1C06, 10748_U3J16, 10748_U4J16, 50112_...</td>\n",
       "      <td>0.364</td>\n",
       "      <td>3.007</td>\n",
       "      <td>61.264</td>\n",
       "      <td>168.392</td>\n",
       "      <td>0.0</td>\n",
       "      <td>None</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>biomass</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>Conventional Hydroelectric</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>62.171</td>\n",
       "      <td>3.740</td>\n",
       "      <td>9.104</td>\n",
       "      <td>44560.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.010</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.060</td>\n",
       "      <td>117</td>\n",
       "      <td>[217, 218, 218, 219, 220, 220, 221, 222, 222, ...</td>\n",
       "      <td>[217_1, 218_2, 218_3, 219_1, 220_H1, 220_H2, 2...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>62.171</td>\n",
       "      <td>7274.007</td>\n",
       "      <td>7274.007</td>\n",
       "      <td>0.0</td>\n",
       "      <td>None</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.5</td>\n",
       "      <td>0.80</td>\n",
       "      <td>0.80</td>\n",
       "      <td>158.730159</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>conventional_hydroelectric</td>\n",
       "      <td>[0.21514035275363813, 0.2148970782125778, 0.21...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>Geothermal</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>27.477</td>\n",
       "      <td>14.878</td>\n",
       "      <td>9.104</td>\n",
       "      <td>198040.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.389</td>\n",
       "      <td>23</td>\n",
       "      <td>[286, 286, 286, 286, 286, 286, 286, 286, 286, ...</td>\n",
       "      <td>[286_U11, 286_U12, 286_U13, 286_U14, 286_U16, ...</td>\n",
       "      <td>0.718</td>\n",
       "      <td>38.278</td>\n",
       "      <td>631.971</td>\n",
       "      <td>880.394</td>\n",
       "      <td>0.0</td>\n",
       "      <td>None</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>geothermal</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>Hydroelectric Pumped Storage</td>\n",
       "      <td>1</td>\n",
       "      <td>3</td>\n",
       "      <td>89.550</td>\n",
       "      <td>23.850</td>\n",
       "      <td>0.000</td>\n",
       "      <td>38460.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.266</td>\n",
       "      <td>20</td>\n",
       "      <td>[104, 437, 437, 437, 446, 446, 446, 446, 446, ...</td>\n",
       "      <td>[104_1, 437_2, 437_4, 437_6, 446_1, 446_2, 446...</td>\n",
       "      <td>-0.022</td>\n",
       "      <td>89.550</td>\n",
       "      <td>1791.000</td>\n",
       "      <td>1791.000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>None</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.95</td>\n",
       "      <td>0.95</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>hydroelectric_pumped_storage</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>Natural Gas Fired Combined Cycle</td>\n",
       "      <td>1</td>\n",
       "      <td>4</td>\n",
       "      <td>274.485</td>\n",
       "      <td>138.315</td>\n",
       "      <td>7.361</td>\n",
       "      <td>11243.353</td>\n",
       "      <td>3.697</td>\n",
       "      <td>1.149</td>\n",
       "      <td>2.850</td>\n",
       "      <td>3050.441</td>\n",
       "      <td>0.504</td>\n",
       "      <td>13</td>\n",
       "      <td>[7307, 55748, 55933, 55970, 56078, 56298, 5629...</td>\n",
       "      <td>[1.0, 1.0, 1.0, 1.0, 1.0, 56298_0001, 56298_00...</td>\n",
       "      <td>0.396</td>\n",
       "      <td>274.485</td>\n",
       "      <td>3568.305</td>\n",
       "      <td>3568.305</td>\n",
       "      <td>0.0</td>\n",
       "      <td>pacific_reference_naturalgas</td>\n",
       "      <td>87.209891</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>natural_gas_fired_combined_cycle</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>Natural Gas Fired Combustion Turbine</td>\n",
       "      <td>1</td>\n",
       "      <td>5</td>\n",
       "      <td>86.648</td>\n",
       "      <td>43.714</td>\n",
       "      <td>10.865</td>\n",
       "      <td>9960.122</td>\n",
       "      <td>4.409</td>\n",
       "      <td>0.879</td>\n",
       "      <td>1.449</td>\n",
       "      <td>1220.348</td>\n",
       "      <td>0.505</td>\n",
       "      <td>21</td>\n",
       "      <td>[7315, 7315, 7315, 50064, 56135, 56135, 56639,...</td>\n",
       "      <td>[7315_2, 7315_3, 7315_4, 50064_003, 56135_1, 5...</td>\n",
       "      <td>0.144</td>\n",
       "      <td>86.648</td>\n",
       "      <td>1819.608</td>\n",
       "      <td>1819.608</td>\n",
       "      <td>0.0</td>\n",
       "      <td>pacific_reference_naturalgas</td>\n",
       "      <td>113.079725</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>natural_gas_fired_combustion_turbine</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>Onshore Wind Turbine</td>\n",
       "      <td>1</td>\n",
       "      <td>6</td>\n",
       "      <td>2.500</td>\n",
       "      <td>0.033</td>\n",
       "      <td>9.183</td>\n",
       "      <td>43205.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.053</td>\n",
       "      <td>0.061</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.013</td>\n",
       "      <td>3</td>\n",
       "      <td>[61067, 62654, 62654]</td>\n",
       "      <td>[61067_WTG1, 62654_WTG1, 62654_WTG2]</td>\n",
       "      <td>0.289</td>\n",
       "      <td>2.500</td>\n",
       "      <td>1327.600</td>\n",
       "      <td>7.500</td>\n",
       "      <td>0.0</td>\n",
       "      <td>None</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.80</td>\n",
       "      <td>0.80</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>onshore_wind_turbine</td>\n",
       "      <td>[0.0152, 0.0066, 0.0403, 0.1088, 0.059, 0.0401...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>Small Hydroelectric</td>\n",
       "      <td>1</td>\n",
       "      <td>7</td>\n",
       "      <td>1.769</td>\n",
       "      <td>0.468</td>\n",
       "      <td>9.104</td>\n",
       "      <td>44560.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.003</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.085</td>\n",
       "      <td>133</td>\n",
       "      <td>[34, 161, 161, 161, 162, 162, 180, 214, 215, 2...</td>\n",
       "      <td>[34_1P, 161_1, 161_2, 161_3, 162_1, 162_2, 180...</td>\n",
       "      <td>0.323</td>\n",
       "      <td>5.484</td>\n",
       "      <td>235.277</td>\n",
       "      <td>729.372</td>\n",
       "      <td>0.0</td>\n",
       "      <td>None</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.80</td>\n",
       "      <td>0.80</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>small_hydroelectric</td>\n",
       "      <td>[0.21514035275363813, 0.2148970782125778, 0.21...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>Solar Photovoltaic</td>\n",
       "      <td>1</td>\n",
       "      <td>8</td>\n",
       "      <td>17.275</td>\n",
       "      <td>0.000</td>\n",
       "      <td>9.122</td>\n",
       "      <td>18760.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.025</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>190</td>\n",
       "      <td>[56768, 56813, 56813, 56875, 56909, 56909, 569...</td>\n",
       "      <td>[56768_CR1, 56813_1, 56813_2, 56875_TBD, 56909...</td>\n",
       "      <td>0.236</td>\n",
       "      <td>17.275</td>\n",
       "      <td>2787.100</td>\n",
       "      <td>3282.250</td>\n",
       "      <td>0.0</td>\n",
       "      <td>None</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.80</td>\n",
       "      <td>0.80</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>solar_photovoltaic</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>Biomass</td>\n",
       "      <td>1</td>\n",
       "      <td>9</td>\n",
       "      <td>1.457</td>\n",
       "      <td>1.535</td>\n",
       "      <td>11.354</td>\n",
       "      <td>122976.000</td>\n",
       "      <td>3.974</td>\n",
       "      <td>1.859</td>\n",
       "      <td>2.554</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.510</td>\n",
       "      <td>46</td>\n",
       "      <td>[10387, 10387, 52204, 52204, 56898, 56898, 571...</td>\n",
       "      <td>[10387_1A, 10387_2A, 52204_OTA5, 52204_OTA6, 5...</td>\n",
       "      <td>0.484</td>\n",
       "      <td>3.011</td>\n",
       "      <td>67.022</td>\n",
       "      <td>138.506</td>\n",
       "      <td>0.0</td>\n",
       "      <td>None</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>biomass</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>Conventional Hydroelectric</td>\n",
       "      <td>1</td>\n",
       "      <td>10</td>\n",
       "      <td>34.905</td>\n",
       "      <td>4.042</td>\n",
       "      <td>9.104</td>\n",
       "      <td>44560.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.116</td>\n",
       "      <td>40</td>\n",
       "      <td>[317, 317, 317, 317, 318, 318, 318, 318, 319, ...</td>\n",
       "      <td>[317_1, 317_2, 317_3, 317_4, 318_3, 318_4, 318...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>34.905</td>\n",
       "      <td>1396.200</td>\n",
       "      <td>1396.200</td>\n",
       "      <td>0.0</td>\n",
       "      <td>None</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.5</td>\n",
       "      <td>0.80</td>\n",
       "      <td>0.80</td>\n",
       "      <td>158.730159</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>conventional_hydroelectric</td>\n",
       "      <td>[0.10489073385379703, 0.104836928317956, 0.104...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>Geothermal</td>\n",
       "      <td>1</td>\n",
       "      <td>11</td>\n",
       "      <td>10.306</td>\n",
       "      <td>5.493</td>\n",
       "      <td>9.104</td>\n",
       "      <td>198040.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.350</td>\n",
       "      <td>60</td>\n",
       "      <td>[10479, 10479, 10479, 10480, 10480, 10481, 104...</td>\n",
       "      <td>[10479_T101, 10479_T102, 10479_T103, 10480_GEN...</td>\n",
       "      <td>0.657</td>\n",
       "      <td>15.692</td>\n",
       "      <td>618.360</td>\n",
       "      <td>941.520</td>\n",
       "      <td>0.0</td>\n",
       "      <td>None</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>geothermal</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>Hydroelectric Pumped Storage</td>\n",
       "      <td>1</td>\n",
       "      <td>12</td>\n",
       "      <td>208.125</td>\n",
       "      <td>7.500</td>\n",
       "      <td>0.000</td>\n",
       "      <td>38460.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.036</td>\n",
       "      <td>8</td>\n",
       "      <td>[392, 392, 392, 392, 392, 392, 57729, 57729]</td>\n",
       "      <td>[392_1, 392_2, 392_3, 392_4, 392_5, 392_6, 577...</td>\n",
       "      <td>0.024</td>\n",
       "      <td>208.125</td>\n",
       "      <td>1665.000</td>\n",
       "      <td>1665.000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>None</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.95</td>\n",
       "      <td>0.95</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>hydroelectric_pumped_storage</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>Natural Gas Fired Combined Cycle</td>\n",
       "      <td>1</td>\n",
       "      <td>13</td>\n",
       "      <td>238.625</td>\n",
       "      <td>91.306</td>\n",
       "      <td>7.391</td>\n",
       "      <td>10597.345</td>\n",
       "      <td>3.554</td>\n",
       "      <td>2.062</td>\n",
       "      <td>2.006</td>\n",
       "      <td>2994.317</td>\n",
       "      <td>0.383</td>\n",
       "      <td>16</td>\n",
       "      <td>[358, 389, 404, 422, 10213, 55345, 55985, 5712...</td>\n",
       "      <td>[2.0, 4.0, 4.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, ...</td>\n",
       "      <td>0.419</td>\n",
       "      <td>238.625</td>\n",
       "      <td>3818.000</td>\n",
       "      <td>3818.000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>pacific_reference_naturalgas</td>\n",
       "      <td>87.209891</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>natural_gas_fired_combined_cycle</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>Natural Gas Fired Combustion Turbine</td>\n",
       "      <td>1</td>\n",
       "      <td>14</td>\n",
       "      <td>64.800</td>\n",
       "      <td>28.804</td>\n",
       "      <td>10.147</td>\n",
       "      <td>10573.364</td>\n",
       "      <td>4.409</td>\n",
       "      <td>1.157</td>\n",
       "      <td>1.906</td>\n",
       "      <td>1843.878</td>\n",
       "      <td>0.445</td>\n",
       "      <td>56</td>\n",
       "      <td>[400, 400, 400, 400, 400, 400, 404, 404, 10427...</td>\n",
       "      <td>[400_11, 400_12, 400_13, 400_14, 400_15, 400_1...</td>\n",
       "      <td>0.159</td>\n",
       "      <td>64.800</td>\n",
       "      <td>3628.800</td>\n",
       "      <td>3628.800</td>\n",
       "      <td>0.0</td>\n",
       "      <td>pacific_reference_naturalgas</td>\n",
       "      <td>113.079725</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>natural_gas_fired_combustion_turbine</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>Onshore Wind Turbine</td>\n",
       "      <td>1</td>\n",
       "      <td>15</td>\n",
       "      <td>82.360</td>\n",
       "      <td>0.800</td>\n",
       "      <td>9.138</td>\n",
       "      <td>43205.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.001</td>\n",
       "      <td>0.024</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.010</td>\n",
       "      <td>5</td>\n",
       "      <td>[57566, 57913, 58114, 60594, 61066]</td>\n",
       "      <td>[57566_2.8P3, 57913_1, 58114_WTG3, 60594_VYGR1...</td>\n",
       "      <td>0.253</td>\n",
       "      <td>82.360</td>\n",
       "      <td>4735.600</td>\n",
       "      <td>411.800</td>\n",
       "      <td>0.0</td>\n",
       "      <td>None</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.80</td>\n",
       "      <td>0.80</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>onshore_wind_turbine</td>\n",
       "      <td>[0.4317036785201452, 0.571841057099417, 0.5306...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>Small Hydroelectric</td>\n",
       "      <td>1</td>\n",
       "      <td>16</td>\n",
       "      <td>1.263</td>\n",
       "      <td>0.687</td>\n",
       "      <td>8.644</td>\n",
       "      <td>44560.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>2.124</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.184</td>\n",
       "      <td>123</td>\n",
       "      <td>[72, 289, 289, 314, 314, 316, 323, 323, 323, 3...</td>\n",
       "      <td>[72_1, 289_1, 289_2, 314_1, 314_2, 316_1, 323_...</td>\n",
       "      <td>0.339</td>\n",
       "      <td>3.730</td>\n",
       "      <td>155.349</td>\n",
       "      <td>458.790</td>\n",
       "      <td>0.0</td>\n",
       "      <td>None</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.80</td>\n",
       "      <td>0.80</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>small_hydroelectric</td>\n",
       "      <td>[0.10489073385379703, 0.104836928317956, 0.104...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>Solar Photovoltaic</td>\n",
       "      <td>1</td>\n",
       "      <td>17</td>\n",
       "      <td>14.749</td>\n",
       "      <td>0.000</td>\n",
       "      <td>9.120</td>\n",
       "      <td>18760.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.019</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>520</td>\n",
       "      <td>[10437, 10438, 56814, 56814, 56862, 56862, 568...</td>\n",
       "      <td>[10437_SUN2, 10438_SUN3, 56814_PV1, 56814_PV2,...</td>\n",
       "      <td>0.240</td>\n",
       "      <td>14.749</td>\n",
       "      <td>9520.000</td>\n",
       "      <td>7669.480</td>\n",
       "      <td>0.0</td>\n",
       "      <td>None</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.80</td>\n",
       "      <td>0.80</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>solar_photovoltaic</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>WECC_AZ</td>\n",
       "      <td>Biomass</td>\n",
       "      <td>1</td>\n",
       "      <td>18</td>\n",
       "      <td>1.894</td>\n",
       "      <td>1.480</td>\n",
       "      <td>15.832</td>\n",
       "      <td>122976.000</td>\n",
       "      <td>5.541</td>\n",
       "      <td>1.579</td>\n",
       "      <td>2.035</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.262</td>\n",
       "      <td>5</td>\n",
       "      <td>[56616, 57403, 57403, 57829, 57829]</td>\n",
       "      <td>[1.0, 57403_GEN1, 57403_GEN2, 57829_GLEN1, 578...</td>\n",
       "      <td>0.336</td>\n",
       "      <td>5.640</td>\n",
       "      <td>9.470</td>\n",
       "      <td>28.200</td>\n",
       "      <td>0.0</td>\n",
       "      <td>None</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>biomass</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>WECC_AZ</td>\n",
       "      <td>Conventional Hydroelectric</td>\n",
       "      <td>1</td>\n",
       "      <td>19</td>\n",
       "      <td>76.700</td>\n",
       "      <td>0.816</td>\n",
       "      <td>9.104</td>\n",
       "      <td>44560.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.007</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.011</td>\n",
       "      <td>37</td>\n",
       "      <td>[100, 145, 145, 145, 148, 149, 150, 152, 152, ...</td>\n",
       "      <td>[100_SC1, 145_HM1, 145_HM2, 145_HM3, 148_MF1, ...</td>\n",
       "      <td>0.293</td>\n",
       "      <td>76.700</td>\n",
       "      <td>2837.900</td>\n",
       "      <td>2837.900</td>\n",
       "      <td>0.0</td>\n",
       "      <td>None</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>-1</td>\n",
       "      <td>0.5</td>\n",
       "      <td>0.80</td>\n",
       "      <td>0.80</td>\n",
       "      <td>158.730159</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>conventional_hydroelectric</td>\n",
       "      <td>[0.2601, 0.2603, 0.2606, 0.2608, 0.261, 0.2612...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>WECC_AZ</td>\n",
       "      <td>Conventional Steam Coal</td>\n",
       "      <td>1</td>\n",
       "      <td>20</td>\n",
       "      <td>412.667</td>\n",
       "      <td>248.333</td>\n",
       "      <td>10.196</td>\n",
       "      <td>56178.431</td>\n",
       "      <td>1.780</td>\n",
       "      <td>0.164</td>\n",
       "      <td>0.171</td>\n",
       "      <td>1287.010</td>\n",
       "      <td>0.602</td>\n",
       "      <td>3</td>\n",
       "      <td>[8223, 8223, 8223]</td>\n",
       "      <td>[2.0, 3.0, 4.0]</td>\n",
       "      <td>0.279</td>\n",
       "      <td>412.667</td>\n",
       "      <td>1238.001</td>\n",
       "      <td>1238.001</td>\n",
       "      <td>0.0</td>\n",
       "      <td>mountain_reference_coal</td>\n",
       "      <td>117.351408</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>conventional_steam_coal</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>WECC_AZ</td>\n",
       "      <td>Hydroelectric Pumped Storage</td>\n",
       "      <td>1</td>\n",
       "      <td>21</td>\n",
       "      <td>36.050</td>\n",
       "      <td>21.667</td>\n",
       "      <td>0.000</td>\n",
       "      <td>38460.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.601</td>\n",
       "      <td>6</td>\n",
       "      <td>[145, 148, 7164, 7164, 7164, 7164]</td>\n",
       "      <td>[145_HM4, 148_MF2, 7164_PG3, 7164_PG6, 7164_PG...</td>\n",
       "      <td>0.026</td>\n",
       "      <td>36.050</td>\n",
       "      <td>216.300</td>\n",
       "      <td>216.300</td>\n",
       "      <td>0.0</td>\n",
       "      <td>None</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.95</td>\n",
       "      <td>0.95</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>hydroelectric_pumped_storage</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>WECC_AZ</td>\n",
       "      <td>Natural Gas Fired Combined Cycle</td>\n",
       "      <td>1</td>\n",
       "      <td>22</td>\n",
       "      <td>301.000</td>\n",
       "      <td>135.000</td>\n",
       "      <td>7.431</td>\n",
       "      <td>11680.000</td>\n",
       "      <td>3.370</td>\n",
       "      <td>0.000</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.449</td>\n",
       "      <td>1</td>\n",
       "      <td>[8068]</td>\n",
       "      <td>[2.0]</td>\n",
       "      <td>0.315</td>\n",
       "      <td>301.000</td>\n",
       "      <td>301.000</td>\n",
       "      <td>301.000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>mountain_reference_naturalgas</td>\n",
       "      <td>87.209891</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>natural_gas_fired_combined_cycle</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>WECC_AZ</td>\n",
       "      <td>Natural Gas Fired Combustion Turbine</td>\n",
       "      <td>1</td>\n",
       "      <td>23</td>\n",
       "      <td>58.709</td>\n",
       "      <td>14.955</td>\n",
       "      <td>14.649</td>\n",
       "      <td>9867.812</td>\n",
       "      <td>4.409</td>\n",
       "      <td>2.189</td>\n",
       "      <td>4.457</td>\n",
       "      <td>1435.585</td>\n",
       "      <td>0.255</td>\n",
       "      <td>22</td>\n",
       "      <td>[116, 116, 116, 116, 116, 120, 120, 6515, 5648...</td>\n",
       "      <td>[116_GT3, 116_GT4, 116_GT5, 116_GT6, 116_GT7, ...</td>\n",
       "      <td>0.194</td>\n",
       "      <td>58.709</td>\n",
       "      <td>1291.598</td>\n",
       "      <td>1291.598</td>\n",
       "      <td>0.0</td>\n",
       "      <td>mountain_reference_naturalgas</td>\n",
       "      <td>113.079725</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>natural_gas_fired_combustion_turbine</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>WECC_AZ</td>\n",
       "      <td>Nuclear</td>\n",
       "      <td>1</td>\n",
       "      <td>24</td>\n",
       "      <td>1334.333</td>\n",
       "      <td>110.000</td>\n",
       "      <td>10.458</td>\n",
       "      <td>183050.000</td>\n",
       "      <td>2.318</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.082</td>\n",
       "      <td>3</td>\n",
       "      <td>[6008, 6008, 6008]</td>\n",
       "      <td>[6008_1, 6008_2, 6008_3]</td>\n",
       "      <td>0.922</td>\n",
       "      <td>1334.333</td>\n",
       "      <td>4002.999</td>\n",
       "      <td>4002.999</td>\n",
       "      <td>0.0</td>\n",
       "      <td>mountain_reference_uranium</td>\n",
       "      <td>234.724610</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.90</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>nuclear</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>WECC_AZ</td>\n",
       "      <td>Solar Photovoltaic</td>\n",
       "      <td>1</td>\n",
       "      <td>25</td>\n",
       "      <td>17.798</td>\n",
       "      <td>0.000</td>\n",
       "      <td>9.113</td>\n",
       "      <td>18760.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.015</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.000</td>\n",
       "      <td>103</td>\n",
       "      <td>[8223, 8223, 57318, 57373, 57373, 57373, 57392...</td>\n",
       "      <td>[8223_SGSS1, 8223_WMS, 57318_1, 57373_AGU1, 57...</td>\n",
       "      <td>0.851</td>\n",
       "      <td>17.798</td>\n",
       "      <td>2017.800</td>\n",
       "      <td>1833.194</td>\n",
       "      <td>0.0</td>\n",
       "      <td>None</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.80</td>\n",
       "      <td>0.80</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>solar_photovoltaic</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "     region                            technology  cluster  index  Cap_size  \\\n",
       "0      CA_N                               Biomass        1      0     1.094   \n",
       "1      CA_N            Conventional Hydroelectric        1      1    62.171   \n",
       "2      CA_N                            Geothermal        1      2    27.477   \n",
       "3      CA_N          Hydroelectric Pumped Storage        1      3    89.550   \n",
       "4      CA_N      Natural Gas Fired Combined Cycle        1      4   274.485   \n",
       "5      CA_N  Natural Gas Fired Combustion Turbine        1      5    86.648   \n",
       "6      CA_N                  Onshore Wind Turbine        1      6     2.500   \n",
       "7      CA_N                   Small Hydroelectric        1      7     1.769   \n",
       "8      CA_N                    Solar Photovoltaic        1      8    17.275   \n",
       "9      CA_S                               Biomass        1      9     1.457   \n",
       "10     CA_S            Conventional Hydroelectric        1     10    34.905   \n",
       "11     CA_S                            Geothermal        1     11    10.306   \n",
       "12     CA_S          Hydroelectric Pumped Storage        1     12   208.125   \n",
       "13     CA_S      Natural Gas Fired Combined Cycle        1     13   238.625   \n",
       "14     CA_S  Natural Gas Fired Combustion Turbine        1     14    64.800   \n",
       "15     CA_S                  Onshore Wind Turbine        1     15    82.360   \n",
       "16     CA_S                   Small Hydroelectric        1     16     1.263   \n",
       "17     CA_S                    Solar Photovoltaic        1     17    14.749   \n",
       "18  WECC_AZ                               Biomass        1     18     1.894   \n",
       "19  WECC_AZ            Conventional Hydroelectric        1     19    76.700   \n",
       "20  WECC_AZ               Conventional Steam Coal        1     20   412.667   \n",
       "21  WECC_AZ          Hydroelectric Pumped Storage        1     21    36.050   \n",
       "22  WECC_AZ      Natural Gas Fired Combined Cycle        1     22   301.000   \n",
       "23  WECC_AZ  Natural Gas Fired Combustion Turbine        1     23    58.709   \n",
       "24  WECC_AZ                               Nuclear        1     24  1334.333   \n",
       "25  WECC_AZ                    Solar Photovoltaic        1     25    17.798   \n",
       "\n",
       "    minimum_load_mw  Heat_Rate_MMBTU_per_MWh  Fixed_OM_Cost_per_MWyr  \\\n",
       "0             1.064                   16.157              122976.000   \n",
       "1             3.740                    9.104               44560.000   \n",
       "2            14.878                    9.104              198040.000   \n",
       "3            23.850                    0.000               38460.000   \n",
       "4           138.315                    7.361               11243.353   \n",
       "5            43.714                   10.865                9960.122   \n",
       "6             0.033                    9.183               43205.000   \n",
       "7             0.468                    9.104               44560.000   \n",
       "8             0.000                    9.122               18760.000   \n",
       "9             1.535                   11.354              122976.000   \n",
       "10            4.042                    9.104               44560.000   \n",
       "11            5.493                    9.104              198040.000   \n",
       "12            7.500                    0.000               38460.000   \n",
       "13           91.306                    7.391               10597.345   \n",
       "14           28.804                   10.147               10573.364   \n",
       "15            0.800                    9.138               43205.000   \n",
       "16            0.687                    8.644               44560.000   \n",
       "17            0.000                    9.120               18760.000   \n",
       "18            1.480                   15.832              122976.000   \n",
       "19            0.816                    9.104               44560.000   \n",
       "20          248.333                   10.196               56178.431   \n",
       "21           21.667                    0.000               38460.000   \n",
       "22          135.000                    7.431               11680.000   \n",
       "23           14.955                   14.649                9867.812   \n",
       "24          110.000                   10.458              183050.000   \n",
       "25            0.000                    9.113               18760.000   \n",
       "\n",
       "    Var_OM_Cost_per_MWh  heat_rate_mmbtu_mwh_iqr  heat_rate_mmbtu_mwh_std  \\\n",
       "0                 5.655                    1.483                    4.067   \n",
       "1                 0.000                    0.000                    0.010   \n",
       "2                 0.000                    0.000                    0.000   \n",
       "3                 0.000                    0.000                    0.000   \n",
       "4                 3.697                    1.149                    2.850   \n",
       "5                 4.409                    0.879                    1.449   \n",
       "6                 0.000                    0.053                    0.061   \n",
       "7                 0.000                    0.000                    0.003   \n",
       "8                 0.000                    0.000                    0.025   \n",
       "9                 3.974                    1.859                    2.554   \n",
       "10                0.000                    0.000                    0.000   \n",
       "11                0.000                    0.000                    0.000   \n",
       "12                0.000                    0.000                    0.000   \n",
       "13                3.554                    2.062                    2.006   \n",
       "14                4.409                    1.157                    1.906   \n",
       "15                0.000                    0.001                    0.024   \n",
       "16                0.000                    0.000                    2.124   \n",
       "17                0.000                    0.000                    0.019   \n",
       "18                5.541                    1.579                    2.035   \n",
       "19                0.000                    0.000                    0.007   \n",
       "20                1.780                    0.164                    0.171   \n",
       "21                0.000                    0.000                    0.000   \n",
       "22                3.370                    0.000                      NaN   \n",
       "23                4.409                    2.189                    4.457   \n",
       "24                2.318                    0.000                    0.000   \n",
       "25                0.000                    0.000                    0.015   \n",
       "\n",
       "    fixed_o_m_mw_std  Min_Power  num_units  \\\n",
       "0              0.000      0.354         56   \n",
       "1              0.000      0.060        117   \n",
       "2              0.000      0.389         23   \n",
       "3              0.000      0.266         20   \n",
       "4           3050.441      0.504         13   \n",
       "5           1220.348      0.505         21   \n",
       "6              0.000      0.013          3   \n",
       "7              0.000      0.085        133   \n",
       "8              0.000      0.000        190   \n",
       "9              0.000      0.510         46   \n",
       "10             0.000      0.116         40   \n",
       "11             0.000      0.350         60   \n",
       "12             0.000      0.036          8   \n",
       "13          2994.317      0.383         16   \n",
       "14          1843.878      0.445         56   \n",
       "15             0.000      0.010          5   \n",
       "16             0.000      0.184        123   \n",
       "17             0.000      0.000        520   \n",
       "18             0.000      0.262          5   \n",
       "19             0.000      0.011         37   \n",
       "20          1287.010      0.602          3   \n",
       "21             0.000      0.601          6   \n",
       "22               NaN      0.449          1   \n",
       "23          1435.585      0.255         22   \n",
       "24             0.000      0.082          3   \n",
       "25             0.000      0.000        103   \n",
       "\n",
       "                                         plant_id_eia  \\\n",
       "0   [10748, 10748, 10748, 50112, 54517, 56080, 560...   \n",
       "1   [217, 218, 218, 219, 220, 220, 221, 222, 222, ...   \n",
       "2   [286, 286, 286, 286, 286, 286, 286, 286, 286, ...   \n",
       "3   [104, 437, 437, 437, 446, 446, 446, 446, 446, ...   \n",
       "4   [7307, 55748, 55933, 55970, 56078, 56298, 5629...   \n",
       "5   [7315, 7315, 7315, 50064, 56135, 56135, 56639,...   \n",
       "6                               [61067, 62654, 62654]   \n",
       "7   [34, 161, 161, 161, 162, 162, 180, 214, 215, 2...   \n",
       "8   [56768, 56813, 56813, 56875, 56909, 56909, 569...   \n",
       "9   [10387, 10387, 52204, 52204, 56898, 56898, 571...   \n",
       "10  [317, 317, 317, 317, 318, 318, 318, 318, 319, ...   \n",
       "11  [10479, 10479, 10479, 10480, 10480, 10481, 104...   \n",
       "12       [392, 392, 392, 392, 392, 392, 57729, 57729]   \n",
       "13  [358, 389, 404, 422, 10213, 55345, 55985, 5712...   \n",
       "14  [400, 400, 400, 400, 400, 400, 404, 404, 10427...   \n",
       "15                [57566, 57913, 58114, 60594, 61066]   \n",
       "16  [72, 289, 289, 314, 314, 316, 323, 323, 323, 3...   \n",
       "17  [10437, 10438, 56814, 56814, 56862, 56862, 568...   \n",
       "18                [56616, 57403, 57403, 57829, 57829]   \n",
       "19  [100, 145, 145, 145, 148, 149, 150, 152, 152, ...   \n",
       "20                                 [8223, 8223, 8223]   \n",
       "21                 [145, 148, 7164, 7164, 7164, 7164]   \n",
       "22                                             [8068]   \n",
       "23  [116, 116, 116, 116, 116, 120, 120, 6515, 5648...   \n",
       "24                                 [6008, 6008, 6008]   \n",
       "25  [8223, 8223, 57318, 57373, 57373, 57373, 57392...   \n",
       "\n",
       "                                         unit_id_pudl  capacity_factor  \\\n",
       "0   [10748_U1C06, 10748_U3J16, 10748_U4J16, 50112_...            0.364   \n",
       "1   [217_1, 218_2, 218_3, 219_1, 220_H1, 220_H2, 2...              NaN   \n",
       "2   [286_U11, 286_U12, 286_U13, 286_U14, 286_U16, ...            0.718   \n",
       "3   [104_1, 437_2, 437_4, 437_6, 446_1, 446_2, 446...           -0.022   \n",
       "4   [1.0, 1.0, 1.0, 1.0, 1.0, 56298_0001, 56298_00...            0.396   \n",
       "5   [7315_2, 7315_3, 7315_4, 50064_003, 56135_1, 5...            0.144   \n",
       "6                [61067_WTG1, 62654_WTG1, 62654_WTG2]            0.289   \n",
       "7   [34_1P, 161_1, 161_2, 161_3, 162_1, 162_2, 180...            0.323   \n",
       "8   [56768_CR1, 56813_1, 56813_2, 56875_TBD, 56909...            0.236   \n",
       "9   [10387_1A, 10387_2A, 52204_OTA5, 52204_OTA6, 5...            0.484   \n",
       "10  [317_1, 317_2, 317_3, 317_4, 318_3, 318_4, 318...              NaN   \n",
       "11  [10479_T101, 10479_T102, 10479_T103, 10480_GEN...            0.657   \n",
       "12  [392_1, 392_2, 392_3, 392_4, 392_5, 392_6, 577...            0.024   \n",
       "13  [2.0, 4.0, 4.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, ...            0.419   \n",
       "14  [400_11, 400_12, 400_13, 400_14, 400_15, 400_1...            0.159   \n",
       "15  [57566_2.8P3, 57913_1, 58114_WTG3, 60594_VYGR1...            0.253   \n",
       "16  [72_1, 289_1, 289_2, 314_1, 314_2, 316_1, 323_...            0.339   \n",
       "17  [10437_SUN2, 10438_SUN3, 56814_PV1, 56814_PV2,...            0.240   \n",
       "18  [1.0, 57403_GEN1, 57403_GEN2, 57829_GLEN1, 578...            0.336   \n",
       "19  [100_SC1, 145_HM1, 145_HM2, 145_HM3, 148_MF1, ...            0.293   \n",
       "20                                    [2.0, 3.0, 4.0]            0.279   \n",
       "21  [145_HM4, 148_MF2, 7164_PG3, 7164_PG6, 7164_PG...            0.026   \n",
       "22                                              [2.0]            0.315   \n",
       "23  [116_GT3, 116_GT4, 116_GT5, 116_GT6, 116_GT7, ...            0.194   \n",
       "24                           [6008_1, 6008_2, 6008_3]            0.922   \n",
       "25  [8223_SGSS1, 8223_WMS, 57318_1, 57373_AGU1, 57...            0.851   \n",
       "\n",
       "    unmodified_cap_size  Existing_Cap_MW  unmodified_existing_cap_mw  \\\n",
       "0                 3.007           61.264                     168.392   \n",
       "1                62.171         7274.007                    7274.007   \n",
       "2                38.278          631.971                     880.394   \n",
       "3                89.550         1791.000                    1791.000   \n",
       "4               274.485         3568.305                    3568.305   \n",
       "5                86.648         1819.608                    1819.608   \n",
       "6                 2.500         1327.600                       7.500   \n",
       "7                 5.484          235.277                     729.372   \n",
       "8                17.275         2787.100                    3282.250   \n",
       "9                 3.011           67.022                     138.506   \n",
       "10               34.905         1396.200                    1396.200   \n",
       "11               15.692          618.360                     941.520   \n",
       "12              208.125         1665.000                    1665.000   \n",
       "13              238.625         3818.000                    3818.000   \n",
       "14               64.800         3628.800                    3628.800   \n",
       "15               82.360         4735.600                     411.800   \n",
       "16                3.730          155.349                     458.790   \n",
       "17               14.749         9520.000                    7669.480   \n",
       "18                5.640            9.470                      28.200   \n",
       "19               76.700         2837.900                    2837.900   \n",
       "20              412.667         1238.001                    1238.001   \n",
       "21               36.050          216.300                     216.300   \n",
       "22              301.000          301.000                     301.000   \n",
       "23               58.709         1291.598                    1291.598   \n",
       "24             1334.333         4002.999                    4002.999   \n",
       "25               17.798         2017.800                    1833.194   \n",
       "\n",
       "    Start_fuel_MMBTU_per_MW                           Fuel  Start_Cost_per_MW  \\\n",
       "0                       0.0                           None           0.000000   \n",
       "1                       0.0                           None           0.000000   \n",
       "2                       0.0                           None           0.000000   \n",
       "3                       0.0                           None           0.000000   \n",
       "4                       0.0   pacific_reference_naturalgas          87.209891   \n",
       "5                       0.0   pacific_reference_naturalgas         113.079725   \n",
       "6                       0.0                           None           0.000000   \n",
       "7                       0.0                           None           0.000000   \n",
       "8                       0.0                           None           0.000000   \n",
       "9                       0.0                           None           0.000000   \n",
       "10                      0.0                           None           0.000000   \n",
       "11                      0.0                           None           0.000000   \n",
       "12                      0.0                           None           0.000000   \n",
       "13                      0.0   pacific_reference_naturalgas          87.209891   \n",
       "14                      0.0   pacific_reference_naturalgas         113.079725   \n",
       "15                      0.0                           None           0.000000   \n",
       "16                      0.0                           None           0.000000   \n",
       "17                      0.0                           None           0.000000   \n",
       "18                      0.0                           None           0.000000   \n",
       "19                      0.0                           None           0.000000   \n",
       "20                      0.0        mountain_reference_coal         117.351408   \n",
       "21                      0.0                           None           0.000000   \n",
       "22                      0.0  mountain_reference_naturalgas          87.209891   \n",
       "23                      0.0  mountain_reference_naturalgas         113.079725   \n",
       "24                      0.0     mountain_reference_uranium         234.724610   \n",
       "25                      0.0                           None           0.000000   \n",
       "\n",
       "    THERM  VRE  Num_VRE_Bins  MUST_RUN  STOR  FLEX  HYDRO  Commit  ESR_1  \\\n",
       "0       0    0             0         1     0     0      0       1      1   \n",
       "1       0    0             0         0     0     0      1       0      0   \n",
       "2       0    0             0         1     0     0      0       0      1   \n",
       "3       0    0             0         0     1     0      0       0      0   \n",
       "4       1    0             0         0     0     0      0       1      0   \n",
       "5       1    0             0         0     0     0      0       1      0   \n",
       "6       0    1             1         0     0     0      0       0      1   \n",
       "7       0    0             0         1     0     0      0       0      1   \n",
       "8       0    1             1         0     0     0      0       0      1   \n",
       "9       0    0             0         1     0     0      0       1      1   \n",
       "10      0    0             0         0     0     0      1       0      0   \n",
       "11      0    0             0         1     0     0      0       0      1   \n",
       "12      0    0             0         0     1     0      0       0      0   \n",
       "13      1    0             0         0     0     0      0       1      0   \n",
       "14      1    0             0         0     0     0      0       1      0   \n",
       "15      0    1             1         0     0     0      0       0      1   \n",
       "16      0    0             0         1     0     0      0       0      1   \n",
       "17      0    1             1         0     0     0      0       0      1   \n",
       "18      0    0             0         1     0     0      0       1      1   \n",
       "19      0    0             0         0     0     0      1       0      0   \n",
       "20      1    0             0         0     0     0      0       1      0   \n",
       "21      0    0             0         0     1     0      0       0      0   \n",
       "22      1    0             0         0     0     0      0       1      0   \n",
       "23      1    0             0         0     0     0      0       1      0   \n",
       "24      1    0             0         0     0     0      0       1      0   \n",
       "25      0    1             1         0     0     0      0       0      1   \n",
       "\n",
       "    ESR_2  New_Build  Hydro_level  CapRes_1  CapRes_2  \\\n",
       "0       1         -1          0.0      0.90      0.90   \n",
       "1       1         -1          0.5      0.80      0.80   \n",
       "2       1         -1          0.0      0.90      0.90   \n",
       "3       0          0          0.0      0.95      0.95   \n",
       "4       0          1          0.0      0.90      0.90   \n",
       "5       0          1          0.0      0.90      0.90   \n",
       "6       1          0          0.0      0.80      0.80   \n",
       "7       1         -1          0.0      0.80      0.80   \n",
       "8       1          0          0.0      0.80      0.80   \n",
       "9       1         -1          0.0      0.90      0.90   \n",
       "10      1         -1          0.5      0.80      0.80   \n",
       "11      1         -1          0.0      0.90      0.90   \n",
       "12      0          1          0.0      0.95      0.95   \n",
       "13      0          1          0.0      0.90      0.90   \n",
       "14      0          1          0.0      0.90      0.90   \n",
       "15      1          0          0.0      0.80      0.80   \n",
       "16      1         -1          0.0      0.80      0.80   \n",
       "17      1          0          0.0      0.80      0.80   \n",
       "18      1         -1          0.0      0.90      0.90   \n",
       "19      1         -1          0.5      0.80      0.80   \n",
       "20      0          0          0.0      0.90      0.90   \n",
       "21      0          0          0.0      0.95      0.95   \n",
       "22      0          1          0.0      0.90      0.90   \n",
       "23      0          1          0.0      0.90      0.90   \n",
       "24      1          1          0.0      0.90      0.90   \n",
       "25      1          0          0.0      0.80      0.80   \n",
       "\n",
       "    Hydro_Energy_to_Power_Ratio  MinCapTag_1  MinCapTag_2  Reg_Max  Rsv_Max  \\\n",
       "0                      0.000000            0            0        0        0   \n",
       "1                    158.730159            0            0        0        0   \n",
       "2                      0.000000            0            0        0        0   \n",
       "3                      0.000000            0            0        0        0   \n",
       "4                      0.000000            0            0        0        0   \n",
       "5                      0.000000            0            0        0        0   \n",
       "6                      0.000000            0            0        0        0   \n",
       "7                      0.000000            0            0        0        0   \n",
       "8                      0.000000            0            0        0        0   \n",
       "9                      0.000000            0            0        0        0   \n",
       "10                   158.730159            0            0        0        0   \n",
       "11                     0.000000            0            0        0        0   \n",
       "12                     0.000000            0            0        0        0   \n",
       "13                     0.000000            0            0        0        0   \n",
       "14                     0.000000            0            0        0        0   \n",
       "15                     0.000000            0            0        0        0   \n",
       "16                     0.000000            0            0        0        0   \n",
       "17                     0.000000            0            0        0        0   \n",
       "18                     0.000000            0            0        0        0   \n",
       "19                   158.730159            0            0        0        0   \n",
       "20                     0.000000            0            0        0        0   \n",
       "21                     0.000000            0            0        0        0   \n",
       "22                     0.000000            0            0        0        0   \n",
       "23                     0.000000            0            0        0        0   \n",
       "24                     0.000000            0            0        0        0   \n",
       "25                     0.000000            0            0        0        0   \n",
       "\n",
       "                                Resource  \\\n",
       "0                                biomass   \n",
       "1             conventional_hydroelectric   \n",
       "2                             geothermal   \n",
       "3           hydroelectric_pumped_storage   \n",
       "4       natural_gas_fired_combined_cycle   \n",
       "5   natural_gas_fired_combustion_turbine   \n",
       "6                   onshore_wind_turbine   \n",
       "7                    small_hydroelectric   \n",
       "8                     solar_photovoltaic   \n",
       "9                                biomass   \n",
       "10            conventional_hydroelectric   \n",
       "11                            geothermal   \n",
       "12          hydroelectric_pumped_storage   \n",
       "13      natural_gas_fired_combined_cycle   \n",
       "14  natural_gas_fired_combustion_turbine   \n",
       "15                  onshore_wind_turbine   \n",
       "16                   small_hydroelectric   \n",
       "17                    solar_photovoltaic   \n",
       "18                               biomass   \n",
       "19            conventional_hydroelectric   \n",
       "20               conventional_steam_coal   \n",
       "21          hydroelectric_pumped_storage   \n",
       "22      natural_gas_fired_combined_cycle   \n",
       "23  natural_gas_fired_combustion_turbine   \n",
       "24                               nuclear   \n",
       "25                    solar_photovoltaic   \n",
       "\n",
       "                                              profile  \n",
       "0                                                None  \n",
       "1   [0.21514035275363813, 0.2148970782125778, 0.21...  \n",
       "2                                                None  \n",
       "3                                                None  \n",
       "4                                                None  \n",
       "5                                                None  \n",
       "6   [0.0152, 0.0066, 0.0403, 0.1088, 0.059, 0.0401...  \n",
       "7   [0.21514035275363813, 0.2148970782125778, 0.21...  \n",
       "8   [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...  \n",
       "9                                                None  \n",
       "10  [0.10489073385379703, 0.104836928317956, 0.104...  \n",
       "11                                               None  \n",
       "12                                               None  \n",
       "13                                               None  \n",
       "14                                               None  \n",
       "15  [0.4317036785201452, 0.571841057099417, 0.5306...  \n",
       "16  [0.10489073385379703, 0.104836928317956, 0.104...  \n",
       "17  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...  \n",
       "18                                               None  \n",
       "19  [0.2601, 0.2603, 0.2606, 0.2608, 0.261, 0.2612...  \n",
       "20                                               None  \n",
       "21                                               None  \n",
       "22                                               None  \n",
       "23                                               None  \n",
       "24                                               None  \n",
       "25  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...  "
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "existing_gen"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### New generators\n",
    "\n",
    "New generators are based on data from NREL's Annual Technology Baseline (ATB). ATB uses a format of `\\<technology>_<tech_detail>` to describe resources, such as `NaturalGas_CTAvgCF`. There are additional parameters including the cost case and financial case that are needed to specify the capex for a specific generator type. Note that many of the `tech_detail` values have identical capex and O&M values, so it doesn't matter which one is used. Examples include the capacity factor of combustion resources (`CTAvgCF` vs `CTHighCF`) and UtilityPV (`Chicago`, `KansasCity`, and `LosAngeles` have different capacity factors that we don't use in PowerGenome).\n",
    "\n",
    "The raw output from `create_new_generators` has many more columns than existing generators. Several of these - such as `basis_year`, `capex`, `capex_mwh`, `cap_recovery_years`, `waccnomtech`, `regional_cost_multiplier`, and `interconnect_annuity` - are used to calculate the final `Inv_cost_per_MWyr` and `Inv_cost_per_MWhyr`. `lcoe` is pre-calculated using 2030 mid-range ATB costs, and is not specific to the model year for each run. The underlying data are retained here so they can be easily reviewed, but only keep the columns that you want/need.\n",
    "\n",
    "The column `variability` has array values with the annual generation profiles for a resource. If these profiles represent 2012 they have 8784 hourly values.\n",
    "\n",
    "The column `Max_Cap_MW` has a value of -1 if there is no limit on the capacity. \n",
    "\n",
    "If the user has included demand response profiles as an external file (using the `demand_response_fn` parameter in settings and the associated `demand_response` and `demand_response_resources` parameters), demand response resources will be included.\n",
    "\n",
    "### Modified and custom new generators\n",
    "\n",
    "By default, new generators are created using data from NREL ATB. But it is possible to modify an existing ATB generator type or create a modified copy of an ATB generator. To understand \n",
    "\n",
    "Modified ATB generators are included in the `atb_modifiers` parameter. In ATB 2019, NREL used a blend of combustion turbine and combined cycle types that we felt was unrealistic. Therefore we have included, by default, the following modifications. The modifying values are provided as `[<op>, <value>]`, where `op` is an operator of type `add`, `mul`, `sub`, and `truediv`. Again, this parameter modifies an existing technology in-place.\n",
    "\n",
    "```\n",
    "atb_modifiers:\n",
    "  ngct:\n",
    "    technology: NaturalGas\n",
    "    tech_detail: CTAvgCF\n",
    "    capex: [mul, 0.76]\n",
    "    Var_OM_cost_per_MWh: [mul, 1.51]\n",
    "    Fixed_OM_cost_per_MWyr: [mul, 0.56]\n",
    "    Heat_rate_MMBTU_per_MWh: [mul, 0.97]\n",
    "  ngcc:\n",
    "    technology: NaturalGas\n",
    "    tech_detail: CCAvgCF\n",
    "    capex: [mul, 0.89]\n",
    "    Var_OM_cost_per_MWh: [mul, 0.73]\n",
    "    Fixed_OM_cost_per_MWyr: [mul, 0.95]\n",
    "    Heat_rate_MMBTU_per_MWh: [mul, 0.98]\n",
    "```\n",
    "\n",
    "New generators based on modifications of an existing ATB generator are included in the parameter `modified_atb_new_gen`. The example below creates a NGCC resource called `NaturalGas_CCS100_Mid` with 100% CO₂ capture. Any new resources need to be added to the parameters `cost_multiplier_technology_map`, `new_build_startup_costs`, and `model_tag_values` (optional). Names are linked using string matching, so the full name doesn't need to be included in these parameters (but it should be long enough to be unique).\n",
    "\n",
    "```\n",
    "modified_atb_new_gen:\n",
    "  NGCCS100:\n",
    "    new_technology: NaturalGas\n",
    "    new_tech_detail: CCS100\n",
    "    new_cost_case: Mid\n",
    "    atb_technology: NaturalGas\n",
    "    atb_tech_detail: CCCCSAvgCF\n",
    "    atb_cost_case: Mid\n",
    "    size_mw: 500\n",
    "    capex: [add, 116000]\n",
    "    heat_rate: [add, 0.365]\n",
    "    o_m_fixed_mw: [add, 9670]\n",
    "    o_m_variable_mwh: [mul, 1.076]\n",
    "```\n",
    "\n",
    "### New wind/solar resources\n",
    "\n",
    "In the settings, uses can specify the type of resource, maximum capacity, number of clusters, and maximum LCOE (optional) in a model region. With these parameters, PowerGenome combines pre-clustered groups of resources, calculating the total capacity and a weighted generation profile for each resource. Utility PV capacity in these clusters is calculated at 45 MW/km^2, and we recommend that users deflate this value (`cap_multiplier`). For offshore wind, specify fixed/floating (`turbine_type`) and if the sites are part of BOEM lease areas (`pref_site`).\n",
    "\n",
    "```\n",
    "renewables_clusters:\n",
    "  - region: CA_N\n",
    "    technology: landbasedwind\n",
    "    max_clusters: 2\n",
    "    max_lcoe: 110\n",
    "    min_capacity: 25000\n",
    "  - region: CA_N\n",
    "    technology: offshorewind\n",
    "    turbine_type: floating\n",
    "    pref_site: 1\n",
    "    max_clusters: 3\n",
    "    min_capacity: 40000\n",
    "  - region: CA_S\n",
    "    technology: landbasedwind\n",
    "    max_clusters: 4\n",
    "    max_lcoe: 100\n",
    "    min_capacity: 45000\n",
    "  - region: CA_S\n",
    "    technology: utilitypv\n",
    "    max_clusters: 5\n",
    "    max_lcoe: 75\n",
    "    min_capacity: 100000\n",
    "    cap_multiplier: 0.2\n",
    "  - region: WECC_AZ\n",
    "    technology: utilitypv\n",
    "    max_clusters: 3\n",
    "    min_capacity: 100000\n",
    "    cap_multiplier: 0.2\n",
    "```\n",
    "\n",
    "**NOTE:** Wind/solar resources have a value in the `LCOE` column. This is a pre-computed LCOE that assumes 2030 mid-range capex values from ATB 2019, and is not specific to settings file you are using. This LCOE is used to cluster project areas using a hierarchical clustering method. \n",
    "\n",
    "### Interconnection costs\n",
    "Wind and solar resources have pre-calculated interconnection costs, so the user doesn't need to supply any additional data. But if a spur line is needed for thermal resources, these distances should be included under the column `spur_miles` in the file specified by `capacity_limit_spur_fn`. This spur line distance is then multiplied by costs for each model region listed in the `transmission_investment_cost` parameter. Spur line capex in the example settings file is from ReEDS documentation. You can look at [a mapping of IPM regions to ReEDS regions](https://github.com/gschivley/pg_misc/blob/master/create_clusters/site_interconnection_costs.py#L32-L155) and the associated transmission costs that I have compiled."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Selected technology landbasedwind capacity in region CA_N less than minimum (8424.4314 < 25000 MW)\n",
      "Selected technology landbasedwind capacity in region CA_S less than minimum (23639.682500000003 < 45000 MW)\n",
      "No model tag values found for MinCapTag_2 ('MinCapTag_2')\n",
      "No model tag values found for Reg_Max ('Reg_Max')\n",
      "No model tag values found for Rsv_Max ('Rsv_Max')\n",
      "Transmission investment costs are missing or zero for some resources and will not be included in the total investment costs.\n"
     ]
    }
   ],
   "source": [
    "new_gen = gc.create_new_generators()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Index(['technology', 'basis_year', 'Fixed_OM_Cost_per_MWyr',\n",
       "       'Fixed_OM_Cost_per_MWhyr', 'Var_OM_Cost_per_MWh', 'capex_mw',\n",
       "       'capex_mwh', 'Inv_Cost_per_MWyr', 'Inv_Cost_per_MWhyr',\n",
       "       'Heat_Rate_MMBTU_per_MWh',\n",
       "       ...\n",
       "       'Flexible_Demand_Energy_Eff', 'Ramp_Up_Percentage',\n",
       "       'Ramp_Dn_Percentage', 'Up_Time', 'Down_Time', 'NACC_Eff',\n",
       "       'NACC_Peak_to_Base', 'Reg_Cost', 'Rsv_Cost', 'Resource'],\n",
       "      dtype='object', length=106)"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "new_gen.columns"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Spur line/interconnection distances and capacity limits\n",
    "Interconnection distances and the maximum available capacity for UtilityPV, LandbasedWind, and OffshoreWind are all included in the data used to select and combine clusters. Spur line distances for other resources must be provided by the user in a CSV file and included in the settings file as `capacity_limit_spur_fn`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>region</th>\n",
       "      <th>technology</th>\n",
       "      <th>cluster</th>\n",
       "      <th>Max_Cap_MW</th>\n",
       "      <th>lcoe</th>\n",
       "      <th>capex_mw</th>\n",
       "      <th>regional_cost_multiplier</th>\n",
       "      <th>Inv_Cost_per_MWyr</th>\n",
       "      <th>plant_inv_cost_mwyr</th>\n",
       "      <th>Start_Cost_per_MW</th>\n",
       "      <th>interconnect_annuity</th>\n",
       "      <th>spur_inv_mwyr</th>\n",
       "      <th>spur_miles</th>\n",
       "      <th>offshore_spur_inv_mwyr</th>\n",
       "      <th>tx_inv_mwyr</th>\n",
       "      <th>profile</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>NaturalGas_CCCCSAvgCF_Mid</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.00000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>2.145350e+06</td>\n",
       "      <td>1.090697</td>\n",
       "      <td>175864.910407</td>\n",
       "      <td>163125.0</td>\n",
       "      <td>95.033926</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>12739.910407</td>\n",
       "      <td>20.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>NaturalGas_CCAvgCF_Mid</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.00000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>8.301737e+05</td>\n",
       "      <td>1.339623</td>\n",
       "      <td>95861.000000</td>\n",
       "      <td>95861.0</td>\n",
       "      <td>95.033926</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>NaturalGas_CTAvgCF_Mid</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.00000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>6.469530e+05</td>\n",
       "      <td>1.211268</td>\n",
       "      <td>67546.000000</td>\n",
       "      <td>67546.0</td>\n",
       "      <td>123.224672</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>Battery_*_Mid</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.00000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.283422e+05</td>\n",
       "      <td>1.041215</td>\n",
       "      <td>10876.000000</td>\n",
       "      <td>10876.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>Nuclear_mid__</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.00000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>4.815000e+06</td>\n",
       "      <td>1.249179</td>\n",
       "      <td>504976.776018</td>\n",
       "      <td>473127.0</td>\n",
       "      <td>255.782928</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>31849.776018</td>\n",
       "      <td>50.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>NaturalGas_CCS100_Mid</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.00000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>2.261350e+06</td>\n",
       "      <td>1.090697</td>\n",
       "      <td>184684.910407</td>\n",
       "      <td>171945.0</td>\n",
       "      <td>95.033926</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>12739.910407</td>\n",
       "      <td>20.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>LandbasedWind_LTRG1_Mid_110</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1259.55000</td>\n",
       "      <td>109.317400</td>\n",
       "      <td>1.161777e+06</td>\n",
       "      <td>2.109174</td>\n",
       "      <td>202819.493100</td>\n",
       "      <td>164722.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>38097.493100</td>\n",
       "      <td>7928.683242</td>\n",
       "      <td>12.447000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>[0.33980817, 0.43698293, 0.46549338, 0.6501417...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>LandbasedWind_LTRG1_Mid_110</td>\n",
       "      <td>2.0</td>\n",
       "      <td>7164.88140</td>\n",
       "      <td>101.403571</td>\n",
       "      <td>1.161777e+06</td>\n",
       "      <td>2.109174</td>\n",
       "      <td>201407.661403</td>\n",
       "      <td>164722.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>36685.661403</td>\n",
       "      <td>19510.610728</td>\n",
       "      <td>30.629118</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>[0.06773967, 0.07600677, 0.095823325, 0.154638...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>OffShoreWind_OTRG10_Mid_floating_1</td>\n",
       "      <td>1.0</td>\n",
       "      <td>18920.54330</td>\n",
       "      <td>161.759154</td>\n",
       "      <td>2.448976e+06</td>\n",
       "      <td>1.308483</td>\n",
       "      <td>683766.255090</td>\n",
       "      <td>220590.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>463176.255090</td>\n",
       "      <td>138210.374951</td>\n",
       "      <td>216.972287</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>[0.02386371, 0.051461402, 0.079115495, 0.18678...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>OffShoreWind_OTRG10_Mid_floating_1</td>\n",
       "      <td>2.0</td>\n",
       "      <td>15748.00000</td>\n",
       "      <td>172.627669</td>\n",
       "      <td>2.448976e+06</td>\n",
       "      <td>1.308483</td>\n",
       "      <td>600024.037885</td>\n",
       "      <td>220590.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>379434.037885</td>\n",
       "      <td>45103.736382</td>\n",
       "      <td>70.806991</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>[0.5650235, 0.5299122, 0.2336824, 0.15720288, ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>OffShoreWind_OTRG10_Mid_floating_1</td>\n",
       "      <td>3.0</td>\n",
       "      <td>6561.06760</td>\n",
       "      <td>173.466020</td>\n",
       "      <td>2.448976e+06</td>\n",
       "      <td>1.308483</td>\n",
       "      <td>723884.872537</td>\n",
       "      <td>220590.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>503294.872537</td>\n",
       "      <td>142757.662790</td>\n",
       "      <td>224.110937</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>[0.0110218255, 0.03133665, 0.053202473, 0.1274...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>NaturalGas_CCCCSAvgCF_Mid</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.00000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>2.145350e+06</td>\n",
       "      <td>1.054107</td>\n",
       "      <td>170392.910407</td>\n",
       "      <td>157653.0</td>\n",
       "      <td>95.033926</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>12739.910407</td>\n",
       "      <td>20.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>NaturalGas_CCAvgCF_Mid</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.00000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>8.301737e+05</td>\n",
       "      <td>1.259958</td>\n",
       "      <td>90160.000000</td>\n",
       "      <td>90160.0</td>\n",
       "      <td>95.033926</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>NaturalGas_CTAvgCF_Mid</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.00000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>6.469530e+05</td>\n",
       "      <td>1.138028</td>\n",
       "      <td>63462.000000</td>\n",
       "      <td>63462.0</td>\n",
       "      <td>123.224672</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>Battery_*_Mid</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.00000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.283422e+05</td>\n",
       "      <td>1.041938</td>\n",
       "      <td>10884.000000</td>\n",
       "      <td>10884.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>Nuclear_mid__</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.00000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>4.815000e+06</td>\n",
       "      <td>1.189997</td>\n",
       "      <td>482561.776018</td>\n",
       "      <td>450712.0</td>\n",
       "      <td>255.782928</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>31849.776018</td>\n",
       "      <td>50.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>NaturalGas_CCS100_Mid</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.00000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>2.261350e+06</td>\n",
       "      <td>1.054107</td>\n",
       "      <td>178916.910407</td>\n",
       "      <td>166177.0</td>\n",
       "      <td>95.033926</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>12739.910407</td>\n",
       "      <td>20.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>LandbasedWind_LTRG1_Mid_100</td>\n",
       "      <td>1.0</td>\n",
       "      <td>9931.27500</td>\n",
       "      <td>75.967682</td>\n",
       "      <td>1.161777e+06</td>\n",
       "      <td>1.656558</td>\n",
       "      <td>149562.276918</td>\n",
       "      <td>129374.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>20188.276918</td>\n",
       "      <td>9753.594828</td>\n",
       "      <td>15.311873</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>[0.4300822, 0.49667943, 0.48646483, 0.45415416...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>LandbasedWind_LTRG1_Mid_100</td>\n",
       "      <td>2.0</td>\n",
       "      <td>1792.39900</td>\n",
       "      <td>81.182943</td>\n",
       "      <td>1.161777e+06</td>\n",
       "      <td>1.656558</td>\n",
       "      <td>147024.793071</td>\n",
       "      <td>129374.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>17650.793071</td>\n",
       "      <td>12555.774762</td>\n",
       "      <td>19.710931</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>[0.28603476, 0.23711866, 0.16580495, 0.1540958...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>LandbasedWind_LTRG1_Mid_100</td>\n",
       "      <td>3.0</td>\n",
       "      <td>5017.27500</td>\n",
       "      <td>91.737814</td>\n",
       "      <td>1.161777e+06</td>\n",
       "      <td>1.656558</td>\n",
       "      <td>144487.497568</td>\n",
       "      <td>129374.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>15113.497568</td>\n",
       "      <td>7444.838679</td>\n",
       "      <td>11.687427</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>[0.23962742, 0.29240245, 0.37647685, 0.4292098...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>LandbasedWind_LTRG1_Mid_100</td>\n",
       "      <td>4.0</td>\n",
       "      <td>6898.73350</td>\n",
       "      <td>88.165385</td>\n",
       "      <td>1.161777e+06</td>\n",
       "      <td>1.656558</td>\n",
       "      <td>147848.841675</td>\n",
       "      <td>129374.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>18474.841675</td>\n",
       "      <td>8916.323502</td>\n",
       "      <td>13.997467</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>[0.4906217, 0.4736377, 0.45323086, 0.44213623,...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>UtilityPV_LosAngeles_Mid_75_0.2</td>\n",
       "      <td>1.0</td>\n",
       "      <td>12514.50000</td>\n",
       "      <td>64.663129</td>\n",
       "      <td>7.584220e+05</td>\n",
       "      <td>1.058603</td>\n",
       "      <td>67380.283929</td>\n",
       "      <td>52014.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>15366.283929</td>\n",
       "      <td>5314.804730</td>\n",
       "      <td>8.343551</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>UtilityPV_LosAngeles_Mid_75_0.2</td>\n",
       "      <td>2.0</td>\n",
       "      <td>12960.48604</td>\n",
       "      <td>66.262823</td>\n",
       "      <td>7.584220e+05</td>\n",
       "      <td>1.058603</td>\n",
       "      <td>68620.331422</td>\n",
       "      <td>52014.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>16606.331422</td>\n",
       "      <td>8750.148282</td>\n",
       "      <td>13.736593</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>UtilityPV_LosAngeles_Mid_75_0.2</td>\n",
       "      <td>3.0</td>\n",
       "      <td>35817.75002</td>\n",
       "      <td>64.870502</td>\n",
       "      <td>7.584220e+05</td>\n",
       "      <td>1.058603</td>\n",
       "      <td>65174.287693</td>\n",
       "      <td>52014.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>13160.287693</td>\n",
       "      <td>5269.684681</td>\n",
       "      <td>8.272719</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>UtilityPV_LosAngeles_Mid_75_0.2</td>\n",
       "      <td>4.0</td>\n",
       "      <td>16345.66820</td>\n",
       "      <td>65.700319</td>\n",
       "      <td>7.584220e+05</td>\n",
       "      <td>1.058603</td>\n",
       "      <td>64797.671543</td>\n",
       "      <td>52014.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>12783.671543</td>\n",
       "      <td>8425.381981</td>\n",
       "      <td>13.226752</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>UtilityPV_LosAngeles_Mid_75_0.2</td>\n",
       "      <td>5.0</td>\n",
       "      <td>24683.72508</td>\n",
       "      <td>65.146554</td>\n",
       "      <td>7.584220e+05</td>\n",
       "      <td>1.058603</td>\n",
       "      <td>62499.830878</td>\n",
       "      <td>52014.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>10485.830878</td>\n",
       "      <td>4399.059321</td>\n",
       "      <td>6.905950</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>WECC_AZ</td>\n",
       "      <td>NaturalGas_CCCCSAvgCF_Mid</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.00000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>2.145350e+06</td>\n",
       "      <td>0.860646</td>\n",
       "      <td>128719.000000</td>\n",
       "      <td>128719.0</td>\n",
       "      <td>95.033926</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>WECC_AZ</td>\n",
       "      <td>NaturalGas_CCAvgCF_Mid</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.00000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>8.301737e+05</td>\n",
       "      <td>0.879455</td>\n",
       "      <td>62932.000000</td>\n",
       "      <td>62932.0</td>\n",
       "      <td>95.033926</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>WECC_AZ</td>\n",
       "      <td>NaturalGas_CTAvgCF_Mid</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.00000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>6.469530e+05</td>\n",
       "      <td>0.836620</td>\n",
       "      <td>46654.000000</td>\n",
       "      <td>46654.0</td>\n",
       "      <td>123.224672</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>WECC_AZ</td>\n",
       "      <td>Battery_*_Mid</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.00000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.283422e+05</td>\n",
       "      <td>1.012292</td>\n",
       "      <td>10574.000000</td>\n",
       "      <td>10574.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>30</th>\n",
       "      <td>WECC_AZ</td>\n",
       "      <td>Nuclear_mid__</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.00000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>4.815000e+06</td>\n",
       "      <td>1.003958</td>\n",
       "      <td>380250.000000</td>\n",
       "      <td>380250.0</td>\n",
       "      <td>255.782928</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31</th>\n",
       "      <td>WECC_AZ</td>\n",
       "      <td>NaturalGas_CCS100_Mid</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.00000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>2.261350e+06</td>\n",
       "      <td>0.860646</td>\n",
       "      <td>135678.000000</td>\n",
       "      <td>135678.0</td>\n",
       "      <td>95.033926</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32</th>\n",
       "      <td>WECC_AZ</td>\n",
       "      <td>UtilityPV_LosAngeles_Mid_0.2</td>\n",
       "      <td>1.0</td>\n",
       "      <td>15448.50002</td>\n",
       "      <td>37.123553</td>\n",
       "      <td>7.584220e+05</td>\n",
       "      <td>0.965440</td>\n",
       "      <td>51085.353730</td>\n",
       "      <td>47436.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>3649.353730</td>\n",
       "      <td>3240.985181</td>\n",
       "      <td>11.447830</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>33</th>\n",
       "      <td>WECC_AZ</td>\n",
       "      <td>UtilityPV_LosAngeles_Mid_0.2</td>\n",
       "      <td>2.0</td>\n",
       "      <td>29574.00002</td>\n",
       "      <td>38.753860</td>\n",
       "      <td>7.584220e+05</td>\n",
       "      <td>0.965440</td>\n",
       "      <td>54568.344943</td>\n",
       "      <td>47436.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>7132.344943</td>\n",
       "      <td>4625.806260</td>\n",
       "      <td>16.339305</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>34</th>\n",
       "      <td>WECC_AZ</td>\n",
       "      <td>UtilityPV_LosAngeles_Mid_0.2</td>\n",
       "      <td>3.0</td>\n",
       "      <td>71655.75006</td>\n",
       "      <td>38.384122</td>\n",
       "      <td>7.584220e+05</td>\n",
       "      <td>0.965440</td>\n",
       "      <td>53914.790914</td>\n",
       "      <td>47436.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>6478.790914</td>\n",
       "      <td>2493.745120</td>\n",
       "      <td>8.808424</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>CA_N</th>\n",
       "      <td>CA_N</td>\n",
       "      <td>ev_load_shifting</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.00000</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.000000e+00</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>[0.08928939237899074, 0.08341915550978372, 0.0...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>CA_S</th>\n",
       "      <td>CA_S</td>\n",
       "      <td>ev_load_shifting</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.00000</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.000000e+00</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>[0.08923150663045215, 0.08339990413804123, 0.0...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "       region                          technology  cluster   Max_Cap_MW  \\\n",
       "0        CA_N           NaturalGas_CCCCSAvgCF_Mid      0.0     -1.00000   \n",
       "1        CA_N              NaturalGas_CCAvgCF_Mid      0.0     -1.00000   \n",
       "2        CA_N              NaturalGas_CTAvgCF_Mid      0.0     -1.00000   \n",
       "3        CA_N                       Battery_*_Mid      0.0     -1.00000   \n",
       "4        CA_N                       Nuclear_mid__      0.0     -1.00000   \n",
       "5        CA_N               NaturalGas_CCS100_Mid      0.0     -1.00000   \n",
       "6        CA_N         LandbasedWind_LTRG1_Mid_110      1.0   1259.55000   \n",
       "7        CA_N         LandbasedWind_LTRG1_Mid_110      2.0   7164.88140   \n",
       "8        CA_N  OffShoreWind_OTRG10_Mid_floating_1      1.0  18920.54330   \n",
       "9        CA_N  OffShoreWind_OTRG10_Mid_floating_1      2.0  15748.00000   \n",
       "10       CA_N  OffShoreWind_OTRG10_Mid_floating_1      3.0   6561.06760   \n",
       "11       CA_S           NaturalGas_CCCCSAvgCF_Mid      0.0     -1.00000   \n",
       "12       CA_S              NaturalGas_CCAvgCF_Mid      0.0     -1.00000   \n",
       "13       CA_S              NaturalGas_CTAvgCF_Mid      0.0     -1.00000   \n",
       "14       CA_S                       Battery_*_Mid      0.0     -1.00000   \n",
       "15       CA_S                       Nuclear_mid__      0.0     -1.00000   \n",
       "16       CA_S               NaturalGas_CCS100_Mid      0.0     -1.00000   \n",
       "17       CA_S         LandbasedWind_LTRG1_Mid_100      1.0   9931.27500   \n",
       "18       CA_S         LandbasedWind_LTRG1_Mid_100      2.0   1792.39900   \n",
       "19       CA_S         LandbasedWind_LTRG1_Mid_100      3.0   5017.27500   \n",
       "20       CA_S         LandbasedWind_LTRG1_Mid_100      4.0   6898.73350   \n",
       "21       CA_S     UtilityPV_LosAngeles_Mid_75_0.2      1.0  12514.50000   \n",
       "22       CA_S     UtilityPV_LosAngeles_Mid_75_0.2      2.0  12960.48604   \n",
       "23       CA_S     UtilityPV_LosAngeles_Mid_75_0.2      3.0  35817.75002   \n",
       "24       CA_S     UtilityPV_LosAngeles_Mid_75_0.2      4.0  16345.66820   \n",
       "25       CA_S     UtilityPV_LosAngeles_Mid_75_0.2      5.0  24683.72508   \n",
       "26    WECC_AZ           NaturalGas_CCCCSAvgCF_Mid      0.0     -1.00000   \n",
       "27    WECC_AZ              NaturalGas_CCAvgCF_Mid      0.0     -1.00000   \n",
       "28    WECC_AZ              NaturalGas_CTAvgCF_Mid      0.0     -1.00000   \n",
       "29    WECC_AZ                       Battery_*_Mid      0.0     -1.00000   \n",
       "30    WECC_AZ                       Nuclear_mid__      0.0     -1.00000   \n",
       "31    WECC_AZ               NaturalGas_CCS100_Mid      0.0     -1.00000   \n",
       "32    WECC_AZ        UtilityPV_LosAngeles_Mid_0.2      1.0  15448.50002   \n",
       "33    WECC_AZ        UtilityPV_LosAngeles_Mid_0.2      2.0  29574.00002   \n",
       "34    WECC_AZ        UtilityPV_LosAngeles_Mid_0.2      3.0  71655.75006   \n",
       "CA_N     CA_N                    ev_load_shifting      1.0      0.00000   \n",
       "CA_S     CA_S                    ev_load_shifting      1.0      0.00000   \n",
       "\n",
       "            lcoe      capex_mw  regional_cost_multiplier  Inv_Cost_per_MWyr  \\\n",
       "0       0.000000  2.145350e+06                  1.090697      175864.910407   \n",
       "1       0.000000  8.301737e+05                  1.339623       95861.000000   \n",
       "2       0.000000  6.469530e+05                  1.211268       67546.000000   \n",
       "3       0.000000  1.283422e+05                  1.041215       10876.000000   \n",
       "4       0.000000  4.815000e+06                  1.249179      504976.776018   \n",
       "5       0.000000  2.261350e+06                  1.090697      184684.910407   \n",
       "6     109.317400  1.161777e+06                  2.109174      202819.493100   \n",
       "7     101.403571  1.161777e+06                  2.109174      201407.661403   \n",
       "8     161.759154  2.448976e+06                  1.308483      683766.255090   \n",
       "9     172.627669  2.448976e+06                  1.308483      600024.037885   \n",
       "10    173.466020  2.448976e+06                  1.308483      723884.872537   \n",
       "11      0.000000  2.145350e+06                  1.054107      170392.910407   \n",
       "12      0.000000  8.301737e+05                  1.259958       90160.000000   \n",
       "13      0.000000  6.469530e+05                  1.138028       63462.000000   \n",
       "14      0.000000  1.283422e+05                  1.041938       10884.000000   \n",
       "15      0.000000  4.815000e+06                  1.189997      482561.776018   \n",
       "16      0.000000  2.261350e+06                  1.054107      178916.910407   \n",
       "17     75.967682  1.161777e+06                  1.656558      149562.276918   \n",
       "18     81.182943  1.161777e+06                  1.656558      147024.793071   \n",
       "19     91.737814  1.161777e+06                  1.656558      144487.497568   \n",
       "20     88.165385  1.161777e+06                  1.656558      147848.841675   \n",
       "21     64.663129  7.584220e+05                  1.058603       67380.283929   \n",
       "22     66.262823  7.584220e+05                  1.058603       68620.331422   \n",
       "23     64.870502  7.584220e+05                  1.058603       65174.287693   \n",
       "24     65.700319  7.584220e+05                  1.058603       64797.671543   \n",
       "25     65.146554  7.584220e+05                  1.058603       62499.830878   \n",
       "26      0.000000  2.145350e+06                  0.860646      128719.000000   \n",
       "27      0.000000  8.301737e+05                  0.879455       62932.000000   \n",
       "28      0.000000  6.469530e+05                  0.836620       46654.000000   \n",
       "29      0.000000  1.283422e+05                  1.012292       10574.000000   \n",
       "30      0.000000  4.815000e+06                  1.003958      380250.000000   \n",
       "31      0.000000  2.261350e+06                  0.860646      135678.000000   \n",
       "32     37.123553  7.584220e+05                  0.965440       51085.353730   \n",
       "33     38.753860  7.584220e+05                  0.965440       54568.344943   \n",
       "34     38.384122  7.584220e+05                  0.965440       53914.790914   \n",
       "CA_N         NaN  0.000000e+00                       NaN           0.000000   \n",
       "CA_S         NaN  0.000000e+00                       NaN           0.000000   \n",
       "\n",
       "      plant_inv_cost_mwyr  Start_Cost_per_MW  interconnect_annuity  \\\n",
       "0                163125.0          95.033926              0.000000   \n",
       "1                 95861.0          95.033926              0.000000   \n",
       "2                 67546.0         123.224672              0.000000   \n",
       "3                 10876.0           0.000000              0.000000   \n",
       "4                473127.0         255.782928              0.000000   \n",
       "5                171945.0          95.033926              0.000000   \n",
       "6                164722.0           0.000000          38097.493100   \n",
       "7                164722.0           0.000000          36685.661403   \n",
       "8                220590.0           0.000000         463176.255090   \n",
       "9                220590.0           0.000000         379434.037885   \n",
       "10               220590.0           0.000000         503294.872537   \n",
       "11               157653.0          95.033926              0.000000   \n",
       "12                90160.0          95.033926              0.000000   \n",
       "13                63462.0         123.224672              0.000000   \n",
       "14                10884.0           0.000000              0.000000   \n",
       "15               450712.0         255.782928              0.000000   \n",
       "16               166177.0          95.033926              0.000000   \n",
       "17               129374.0           0.000000          20188.276918   \n",
       "18               129374.0           0.000000          17650.793071   \n",
       "19               129374.0           0.000000          15113.497568   \n",
       "20               129374.0           0.000000          18474.841675   \n",
       "21                52014.0           0.000000          15366.283929   \n",
       "22                52014.0           0.000000          16606.331422   \n",
       "23                52014.0           0.000000          13160.287693   \n",
       "24                52014.0           0.000000          12783.671543   \n",
       "25                52014.0           0.000000          10485.830878   \n",
       "26               128719.0          95.033926              0.000000   \n",
       "27                62932.0          95.033926              0.000000   \n",
       "28                46654.0         123.224672              0.000000   \n",
       "29                10574.0           0.000000              0.000000   \n",
       "30               380250.0         255.782928              0.000000   \n",
       "31               135678.0          95.033926              0.000000   \n",
       "32                47436.0           0.000000           3649.353730   \n",
       "33                47436.0           0.000000           7132.344943   \n",
       "34                47436.0           0.000000           6478.790914   \n",
       "CA_N                  NaN           0.000000              0.000000   \n",
       "CA_S                  NaN           0.000000              0.000000   \n",
       "\n",
       "      spur_inv_mwyr  spur_miles  offshore_spur_inv_mwyr  tx_inv_mwyr  \\\n",
       "0      12739.910407   20.000000                     0.0          0.0   \n",
       "1          0.000000    0.000000                     0.0          0.0   \n",
       "2          0.000000    0.000000                     0.0          0.0   \n",
       "3          0.000000    0.000000                     0.0          0.0   \n",
       "4      31849.776018   50.000000                     0.0          0.0   \n",
       "5      12739.910407   20.000000                     0.0          0.0   \n",
       "6       7928.683242   12.447000                     0.0          0.0   \n",
       "7      19510.610728   30.629118                     0.0          0.0   \n",
       "8     138210.374951  216.972287                     0.0          0.0   \n",
       "9      45103.736382   70.806991                     0.0          0.0   \n",
       "10    142757.662790  224.110937                     0.0          0.0   \n",
       "11     12739.910407   20.000000                     0.0          0.0   \n",
       "12         0.000000    0.000000                     0.0          0.0   \n",
       "13         0.000000    0.000000                     0.0          0.0   \n",
       "14         0.000000    0.000000                     0.0          0.0   \n",
       "15     31849.776018   50.000000                     0.0          0.0   \n",
       "16     12739.910407   20.000000                     0.0          0.0   \n",
       "17      9753.594828   15.311873                     0.0          0.0   \n",
       "18     12555.774762   19.710931                     0.0          0.0   \n",
       "19      7444.838679   11.687427                     0.0          0.0   \n",
       "20      8916.323502   13.997467                     0.0          0.0   \n",
       "21      5314.804730    8.343551                     0.0          0.0   \n",
       "22      8750.148282   13.736593                     0.0          0.0   \n",
       "23      5269.684681    8.272719                     0.0          0.0   \n",
       "24      8425.381981   13.226752                     0.0          0.0   \n",
       "25      4399.059321    6.905950                     0.0          0.0   \n",
       "26         0.000000    0.000000                     0.0          0.0   \n",
       "27         0.000000    0.000000                     0.0          0.0   \n",
       "28         0.000000    0.000000                     0.0          0.0   \n",
       "29         0.000000    0.000000                     0.0          0.0   \n",
       "30         0.000000    0.000000                     0.0          0.0   \n",
       "31         0.000000    0.000000                     0.0          0.0   \n",
       "32      3240.985181   11.447830                     0.0          0.0   \n",
       "33      4625.806260   16.339305                     0.0          0.0   \n",
       "34      2493.745120    8.808424                     0.0          0.0   \n",
       "CA_N            NaN    0.000000                     NaN          NaN   \n",
       "CA_S            NaN    0.000000                     NaN          NaN   \n",
       "\n",
       "                                                profile  \n",
       "0                                                     0  \n",
       "1                                                     0  \n",
       "2                                                     0  \n",
       "3                                                     0  \n",
       "4                                                     0  \n",
       "5                                                     0  \n",
       "6     [0.33980817, 0.43698293, 0.46549338, 0.6501417...  \n",
       "7     [0.06773967, 0.07600677, 0.095823325, 0.154638...  \n",
       "8     [0.02386371, 0.051461402, 0.079115495, 0.18678...  \n",
       "9     [0.5650235, 0.5299122, 0.2336824, 0.15720288, ...  \n",
       "10    [0.0110218255, 0.03133665, 0.053202473, 0.1274...  \n",
       "11                                                    0  \n",
       "12                                                    0  \n",
       "13                                                    0  \n",
       "14                                                    0  \n",
       "15                                                    0  \n",
       "16                                                    0  \n",
       "17    [0.4300822, 0.49667943, 0.48646483, 0.45415416...  \n",
       "18    [0.28603476, 0.23711866, 0.16580495, 0.1540958...  \n",
       "19    [0.23962742, 0.29240245, 0.37647685, 0.4292098...  \n",
       "20    [0.4906217, 0.4736377, 0.45323086, 0.44213623,...  \n",
       "21    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...  \n",
       "22    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...  \n",
       "23    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...  \n",
       "24    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...  \n",
       "25    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...  \n",
       "26                                                    0  \n",
       "27                                                    0  \n",
       "28                                                    0  \n",
       "29                                                    0  \n",
       "30                                                    0  \n",
       "31                                                    0  \n",
       "32    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...  \n",
       "33    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...  \n",
       "34    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...  \n",
       "CA_N  [0.08928939237899074, 0.08341915550978372, 0.0...  \n",
       "CA_S  [0.08923150663045215, 0.08339990413804123, 0.0...  "
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cols = [\n",
    "    \"region\",\n",
    "    \"technology\",\n",
    "    \"cluster\",\n",
    "    \"Max_Cap_MW\",\n",
    "    \"lcoe\",\n",
    "    \"capex_mw\",\n",
    "    \"regional_cost_multiplier\",\n",
    "    \"Inv_Cost_per_MWyr\",\n",
    "    \"plant_inv_cost_mwyr\",\n",
    "    \"Start_Cost_per_MW\",\n",
    "    \"interconnect_annuity\",\n",
    "    \"spur_inv_mwyr\",\n",
    "    \"spur_miles\",\n",
    "    \"offshore_spur_inv_mwyr\",\n",
    "    \"tx_inv_mwyr\",\n",
    "    \"profile\",\n",
    "]\n",
    "new_gen[cols]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Generation profiles\n",
    "\n",
    "Hourly generation profiles are saved in a `variability` column of the dataframe. These are then extracted using the function `make_generator_variability`. The variability (generation profile) dataframe is in the same (column) order as rows in the generator dataframe."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>3</th>\n",
       "      <th>4</th>\n",
       "      <th>5</th>\n",
       "      <th>6</th>\n",
       "      <th>7</th>\n",
       "      <th>8</th>\n",
       "      <th>9</th>\n",
       "      <th>10</th>\n",
       "      <th>11</th>\n",
       "      <th>12</th>\n",
       "      <th>13</th>\n",
       "      <th>14</th>\n",
       "      <th>15</th>\n",
       "      <th>16</th>\n",
       "      <th>17</th>\n",
       "      <th>18</th>\n",
       "      <th>19</th>\n",
       "      <th>20</th>\n",
       "      <th>21</th>\n",
       "      <th>22</th>\n",
       "      <th>23</th>\n",
       "      <th>24</th>\n",
       "      <th>25</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.215140</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0152</td>\n",
       "      <td>0.215140</td>\n",
       "      <td>0.0000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.104891</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.431704</td>\n",
       "      <td>0.104891</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2601</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.214897</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0066</td>\n",
       "      <td>0.214897</td>\n",
       "      <td>0.0000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.104837</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.571841</td>\n",
       "      <td>0.104837</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2603</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.214654</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0403</td>\n",
       "      <td>0.214654</td>\n",
       "      <td>0.0000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.104783</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.530605</td>\n",
       "      <td>0.104783</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2606</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.214411</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.1088</td>\n",
       "      <td>0.214411</td>\n",
       "      <td>0.0000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.104728</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.484157</td>\n",
       "      <td>0.104728</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2608</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.214167</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0590</td>\n",
       "      <td>0.214167</td>\n",
       "      <td>0.0000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.104620</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.589168</td>\n",
       "      <td>0.104620</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2610</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8755</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.215936</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0004</td>\n",
       "      <td>0.215936</td>\n",
       "      <td>0.2899</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.232444</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.009415</td>\n",
       "      <td>0.232444</td>\n",
       "      <td>0.278583</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2591</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2031</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8756</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.215179</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0293</td>\n",
       "      <td>0.215179</td>\n",
       "      <td>0.0000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.232256</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.022796</td>\n",
       "      <td>0.232256</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2593</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8757</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.214423</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0617</td>\n",
       "      <td>0.214423</td>\n",
       "      <td>0.0000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.232069</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.053236</td>\n",
       "      <td>0.232069</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2595</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8758</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.213666</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0811</td>\n",
       "      <td>0.213666</td>\n",
       "      <td>0.0000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.231880</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.196757</td>\n",
       "      <td>0.231880</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2597</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8759</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.212816</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0819</td>\n",
       "      <td>0.212816</td>\n",
       "      <td>0.0000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.231693</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.574610</td>\n",
       "      <td>0.231693</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2599</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>8760 rows × 26 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "        0         1    2    3    4    5       6         7       8    9  \\\n",
       "0     1.0  0.215140  1.0  1.0  1.0  1.0  0.0152  0.215140  0.0000  1.0   \n",
       "1     1.0  0.214897  1.0  1.0  1.0  1.0  0.0066  0.214897  0.0000  1.0   \n",
       "2     1.0  0.214654  1.0  1.0  1.0  1.0  0.0403  0.214654  0.0000  1.0   \n",
       "3     1.0  0.214411  1.0  1.0  1.0  1.0  0.1088  0.214411  0.0000  1.0   \n",
       "4     1.0  0.214167  1.0  1.0  1.0  1.0  0.0590  0.214167  0.0000  1.0   \n",
       "...   ...       ...  ...  ...  ...  ...     ...       ...     ...  ...   \n",
       "8755  1.0  0.215936  1.0  1.0  1.0  1.0  0.0004  0.215936  0.2899  1.0   \n",
       "8756  1.0  0.215179  1.0  1.0  1.0  1.0  0.0293  0.215179  0.0000  1.0   \n",
       "8757  1.0  0.214423  1.0  1.0  1.0  1.0  0.0617  0.214423  0.0000  1.0   \n",
       "8758  1.0  0.213666  1.0  1.0  1.0  1.0  0.0811  0.213666  0.0000  1.0   \n",
       "8759  1.0  0.212816  1.0  1.0  1.0  1.0  0.0819  0.212816  0.0000  1.0   \n",
       "\n",
       "            10   11   12   13   14        15        16        17   18      19  \\\n",
       "0     0.104891  1.0  1.0  1.0  1.0  0.431704  0.104891  0.000000  1.0  0.2601   \n",
       "1     0.104837  1.0  1.0  1.0  1.0  0.571841  0.104837  0.000000  1.0  0.2603   \n",
       "2     0.104783  1.0  1.0  1.0  1.0  0.530605  0.104783  0.000000  1.0  0.2606   \n",
       "3     0.104728  1.0  1.0  1.0  1.0  0.484157  0.104728  0.000000  1.0  0.2608   \n",
       "4     0.104620  1.0  1.0  1.0  1.0  0.589168  0.104620  0.000000  1.0  0.2610   \n",
       "...        ...  ...  ...  ...  ...       ...       ...       ...  ...     ...   \n",
       "8755  0.232444  1.0  1.0  1.0  1.0  0.009415  0.232444  0.278583  1.0  0.2591   \n",
       "8756  0.232256  1.0  1.0  1.0  1.0  0.022796  0.232256  0.000000  1.0  0.2593   \n",
       "8757  0.232069  1.0  1.0  1.0  1.0  0.053236  0.232069  0.000000  1.0  0.2595   \n",
       "8758  0.231880  1.0  1.0  1.0  1.0  0.196757  0.231880  0.000000  1.0  0.2597   \n",
       "8759  0.231693  1.0  1.0  1.0  1.0  0.574610  0.231693  0.000000  1.0  0.2599   \n",
       "\n",
       "       20   21   22   23   24      25  \n",
       "0     1.0  1.0  1.0  1.0  1.0  0.0000  \n",
       "1     1.0  1.0  1.0  1.0  1.0  0.0000  \n",
       "2     1.0  1.0  1.0  1.0  1.0  0.0000  \n",
       "3     1.0  1.0  1.0  1.0  1.0  0.0000  \n",
       "4     1.0  1.0  1.0  1.0  1.0  0.0000  \n",
       "...   ...  ...  ...  ...  ...     ...  \n",
       "8755  1.0  1.0  1.0  1.0  1.0  0.2031  \n",
       "8756  1.0  1.0  1.0  1.0  1.0  0.0000  \n",
       "8757  1.0  1.0  1.0  1.0  1.0  0.0000  \n",
       "8758  1.0  1.0  1.0  1.0  1.0  0.0000  \n",
       "8759  1.0  1.0  1.0  1.0  1.0  0.0000  \n",
       "\n",
       "[8760 rows x 26 columns]"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "existing_variability = make_generator_variability(existing_gen)\n",
    "existing_variability"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Since the variability column names are only integers, it can help to replace them with descriptive strings."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>CA_N_biomass_1</th>\n",
       "      <th>CA_N_conventional_hydroelectric_1</th>\n",
       "      <th>CA_N_geothermal_1</th>\n",
       "      <th>CA_N_hydroelectric_pumped_storage_1</th>\n",
       "      <th>CA_N_natural_gas_fired_combined_cycle_1</th>\n",
       "      <th>CA_N_natural_gas_fired_combustion_turbine_1</th>\n",
       "      <th>CA_N_onshore_wind_turbine_1</th>\n",
       "      <th>CA_N_small_hydroelectric_1</th>\n",
       "      <th>CA_N_solar_photovoltaic_1</th>\n",
       "      <th>CA_S_biomass_1</th>\n",
       "      <th>CA_S_conventional_hydroelectric_1</th>\n",
       "      <th>CA_S_geothermal_1</th>\n",
       "      <th>CA_S_hydroelectric_pumped_storage_1</th>\n",
       "      <th>CA_S_natural_gas_fired_combined_cycle_1</th>\n",
       "      <th>CA_S_natural_gas_fired_combustion_turbine_1</th>\n",
       "      <th>CA_S_onshore_wind_turbine_1</th>\n",
       "      <th>CA_S_small_hydroelectric_1</th>\n",
       "      <th>CA_S_solar_photovoltaic_1</th>\n",
       "      <th>WECC_AZ_biomass_1</th>\n",
       "      <th>WECC_AZ_conventional_hydroelectric_1</th>\n",
       "      <th>WECC_AZ_conventional_steam_coal_1</th>\n",
       "      <th>WECC_AZ_hydroelectric_pumped_storage_1</th>\n",
       "      <th>WECC_AZ_natural_gas_fired_combined_cycle_1</th>\n",
       "      <th>WECC_AZ_natural_gas_fired_combustion_turbine_1</th>\n",
       "      <th>WECC_AZ_nuclear_1</th>\n",
       "      <th>WECC_AZ_solar_photovoltaic_1</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.215140</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0152</td>\n",
       "      <td>0.215140</td>\n",
       "      <td>0.0000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.104891</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.431704</td>\n",
       "      <td>0.104891</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2601</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.214897</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0066</td>\n",
       "      <td>0.214897</td>\n",
       "      <td>0.0000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.104837</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.571841</td>\n",
       "      <td>0.104837</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2603</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.214654</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0403</td>\n",
       "      <td>0.214654</td>\n",
       "      <td>0.0000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.104783</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.530605</td>\n",
       "      <td>0.104783</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2606</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.214411</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.1088</td>\n",
       "      <td>0.214411</td>\n",
       "      <td>0.0000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.104728</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.484157</td>\n",
       "      <td>0.104728</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2608</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.214167</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0590</td>\n",
       "      <td>0.214167</td>\n",
       "      <td>0.0000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.104620</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.589168</td>\n",
       "      <td>0.104620</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2610</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8755</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.215936</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0004</td>\n",
       "      <td>0.215936</td>\n",
       "      <td>0.2899</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.232444</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.009415</td>\n",
       "      <td>0.232444</td>\n",
       "      <td>0.278583</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2591</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2031</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8756</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.215179</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0293</td>\n",
       "      <td>0.215179</td>\n",
       "      <td>0.0000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.232256</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.022796</td>\n",
       "      <td>0.232256</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2593</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8757</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.214423</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0617</td>\n",
       "      <td>0.214423</td>\n",
       "      <td>0.0000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.232069</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.053236</td>\n",
       "      <td>0.232069</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2595</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8758</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.213666</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0811</td>\n",
       "      <td>0.213666</td>\n",
       "      <td>0.0000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.231880</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.196757</td>\n",
       "      <td>0.231880</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2597</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8759</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.212816</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0819</td>\n",
       "      <td>0.212816</td>\n",
       "      <td>0.0000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.231693</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.574610</td>\n",
       "      <td>0.231693</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.2599</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>8760 rows × 26 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "      CA_N_biomass_1  CA_N_conventional_hydroelectric_1  CA_N_geothermal_1  \\\n",
       "0                1.0                           0.215140                1.0   \n",
       "1                1.0                           0.214897                1.0   \n",
       "2                1.0                           0.214654                1.0   \n",
       "3                1.0                           0.214411                1.0   \n",
       "4                1.0                           0.214167                1.0   \n",
       "...              ...                                ...                ...   \n",
       "8755             1.0                           0.215936                1.0   \n",
       "8756             1.0                           0.215179                1.0   \n",
       "8757             1.0                           0.214423                1.0   \n",
       "8758             1.0                           0.213666                1.0   \n",
       "8759             1.0                           0.212816                1.0   \n",
       "\n",
       "      CA_N_hydroelectric_pumped_storage_1  \\\n",
       "0                                     1.0   \n",
       "1                                     1.0   \n",
       "2                                     1.0   \n",
       "3                                     1.0   \n",
       "4                                     1.0   \n",
       "...                                   ...   \n",
       "8755                                  1.0   \n",
       "8756                                  1.0   \n",
       "8757                                  1.0   \n",
       "8758                                  1.0   \n",
       "8759                                  1.0   \n",
       "\n",
       "      CA_N_natural_gas_fired_combined_cycle_1  \\\n",
       "0                                         1.0   \n",
       "1                                         1.0   \n",
       "2                                         1.0   \n",
       "3                                         1.0   \n",
       "4                                         1.0   \n",
       "...                                       ...   \n",
       "8755                                      1.0   \n",
       "8756                                      1.0   \n",
       "8757                                      1.0   \n",
       "8758                                      1.0   \n",
       "8759                                      1.0   \n",
       "\n",
       "      CA_N_natural_gas_fired_combustion_turbine_1  \\\n",
       "0                                             1.0   \n",
       "1                                             1.0   \n",
       "2                                             1.0   \n",
       "3                                             1.0   \n",
       "4                                             1.0   \n",
       "...                                           ...   \n",
       "8755                                          1.0   \n",
       "8756                                          1.0   \n",
       "8757                                          1.0   \n",
       "8758                                          1.0   \n",
       "8759                                          1.0   \n",
       "\n",
       "      CA_N_onshore_wind_turbine_1  CA_N_small_hydroelectric_1  \\\n",
       "0                          0.0152                    0.215140   \n",
       "1                          0.0066                    0.214897   \n",
       "2                          0.0403                    0.214654   \n",
       "3                          0.1088                    0.214411   \n",
       "4                          0.0590                    0.214167   \n",
       "...                           ...                         ...   \n",
       "8755                       0.0004                    0.215936   \n",
       "8756                       0.0293                    0.215179   \n",
       "8757                       0.0617                    0.214423   \n",
       "8758                       0.0811                    0.213666   \n",
       "8759                       0.0819                    0.212816   \n",
       "\n",
       "      CA_N_solar_photovoltaic_1  CA_S_biomass_1  \\\n",
       "0                        0.0000             1.0   \n",
       "1                        0.0000             1.0   \n",
       "2                        0.0000             1.0   \n",
       "3                        0.0000             1.0   \n",
       "4                        0.0000             1.0   \n",
       "...                         ...             ...   \n",
       "8755                     0.2899             1.0   \n",
       "8756                     0.0000             1.0   \n",
       "8757                     0.0000             1.0   \n",
       "8758                     0.0000             1.0   \n",
       "8759                     0.0000             1.0   \n",
       "\n",
       "      CA_S_conventional_hydroelectric_1  CA_S_geothermal_1  \\\n",
       "0                              0.104891                1.0   \n",
       "1                              0.104837                1.0   \n",
       "2                              0.104783                1.0   \n",
       "3                              0.104728                1.0   \n",
       "4                              0.104620                1.0   \n",
       "...                                 ...                ...   \n",
       "8755                           0.232444                1.0   \n",
       "8756                           0.232256                1.0   \n",
       "8757                           0.232069                1.0   \n",
       "8758                           0.231880                1.0   \n",
       "8759                           0.231693                1.0   \n",
       "\n",
       "      CA_S_hydroelectric_pumped_storage_1  \\\n",
       "0                                     1.0   \n",
       "1                                     1.0   \n",
       "2                                     1.0   \n",
       "3                                     1.0   \n",
       "4                                     1.0   \n",
       "...                                   ...   \n",
       "8755                                  1.0   \n",
       "8756                                  1.0   \n",
       "8757                                  1.0   \n",
       "8758                                  1.0   \n",
       "8759                                  1.0   \n",
       "\n",
       "      CA_S_natural_gas_fired_combined_cycle_1  \\\n",
       "0                                         1.0   \n",
       "1                                         1.0   \n",
       "2                                         1.0   \n",
       "3                                         1.0   \n",
       "4                                         1.0   \n",
       "...                                       ...   \n",
       "8755                                      1.0   \n",
       "8756                                      1.0   \n",
       "8757                                      1.0   \n",
       "8758                                      1.0   \n",
       "8759                                      1.0   \n",
       "\n",
       "      CA_S_natural_gas_fired_combustion_turbine_1  \\\n",
       "0                                             1.0   \n",
       "1                                             1.0   \n",
       "2                                             1.0   \n",
       "3                                             1.0   \n",
       "4                                             1.0   \n",
       "...                                           ...   \n",
       "8755                                          1.0   \n",
       "8756                                          1.0   \n",
       "8757                                          1.0   \n",
       "8758                                          1.0   \n",
       "8759                                          1.0   \n",
       "\n",
       "      CA_S_onshore_wind_turbine_1  CA_S_small_hydroelectric_1  \\\n",
       "0                        0.431704                    0.104891   \n",
       "1                        0.571841                    0.104837   \n",
       "2                        0.530605                    0.104783   \n",
       "3                        0.484157                    0.104728   \n",
       "4                        0.589168                    0.104620   \n",
       "...                           ...                         ...   \n",
       "8755                     0.009415                    0.232444   \n",
       "8756                     0.022796                    0.232256   \n",
       "8757                     0.053236                    0.232069   \n",
       "8758                     0.196757                    0.231880   \n",
       "8759                     0.574610                    0.231693   \n",
       "\n",
       "      CA_S_solar_photovoltaic_1  WECC_AZ_biomass_1  \\\n",
       "0                      0.000000                1.0   \n",
       "1                      0.000000                1.0   \n",
       "2                      0.000000                1.0   \n",
       "3                      0.000000                1.0   \n",
       "4                      0.000000                1.0   \n",
       "...                         ...                ...   \n",
       "8755                   0.278583                1.0   \n",
       "8756                   0.000000                1.0   \n",
       "8757                   0.000000                1.0   \n",
       "8758                   0.000000                1.0   \n",
       "8759                   0.000000                1.0   \n",
       "\n",
       "      WECC_AZ_conventional_hydroelectric_1  WECC_AZ_conventional_steam_coal_1  \\\n",
       "0                                   0.2601                                1.0   \n",
       "1                                   0.2603                                1.0   \n",
       "2                                   0.2606                                1.0   \n",
       "3                                   0.2608                                1.0   \n",
       "4                                   0.2610                                1.0   \n",
       "...                                    ...                                ...   \n",
       "8755                                0.2591                                1.0   \n",
       "8756                                0.2593                                1.0   \n",
       "8757                                0.2595                                1.0   \n",
       "8758                                0.2597                                1.0   \n",
       "8759                                0.2599                                1.0   \n",
       "\n",
       "      WECC_AZ_hydroelectric_pumped_storage_1  \\\n",
       "0                                        1.0   \n",
       "1                                        1.0   \n",
       "2                                        1.0   \n",
       "3                                        1.0   \n",
       "4                                        1.0   \n",
       "...                                      ...   \n",
       "8755                                     1.0   \n",
       "8756                                     1.0   \n",
       "8757                                     1.0   \n",
       "8758                                     1.0   \n",
       "8759                                     1.0   \n",
       "\n",
       "      WECC_AZ_natural_gas_fired_combined_cycle_1  \\\n",
       "0                                            1.0   \n",
       "1                                            1.0   \n",
       "2                                            1.0   \n",
       "3                                            1.0   \n",
       "4                                            1.0   \n",
       "...                                          ...   \n",
       "8755                                         1.0   \n",
       "8756                                         1.0   \n",
       "8757                                         1.0   \n",
       "8758                                         1.0   \n",
       "8759                                         1.0   \n",
       "\n",
       "      WECC_AZ_natural_gas_fired_combustion_turbine_1  WECC_AZ_nuclear_1  \\\n",
       "0                                                1.0                1.0   \n",
       "1                                                1.0                1.0   \n",
       "2                                                1.0                1.0   \n",
       "3                                                1.0                1.0   \n",
       "4                                                1.0                1.0   \n",
       "...                                              ...                ...   \n",
       "8755                                             1.0                1.0   \n",
       "8756                                             1.0                1.0   \n",
       "8757                                             1.0                1.0   \n",
       "8758                                             1.0                1.0   \n",
       "8759                                             1.0                1.0   \n",
       "\n",
       "      WECC_AZ_solar_photovoltaic_1  \n",
       "0                           0.0000  \n",
       "1                           0.0000  \n",
       "2                           0.0000  \n",
       "3                           0.0000  \n",
       "4                           0.0000  \n",
       "...                            ...  \n",
       "8755                        0.2031  \n",
       "8756                        0.0000  \n",
       "8757                        0.0000  \n",
       "8758                        0.0000  \n",
       "8759                        0.0000  \n",
       "\n",
       "[8760 rows x 26 columns]"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "existing_variability.columns = (\n",
    "    existing_gen[\"region\"]\n",
    "    + \"_\"\n",
    "    + existing_gen[\"Resource\"]\n",
    "    + \"_\"\n",
    "    + existing_gen[\"cluster\"].astype(str)\n",
    ")\n",
    "existing_variability"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>3</th>\n",
       "      <th>4</th>\n",
       "      <th>5</th>\n",
       "      <th>6</th>\n",
       "      <th>7</th>\n",
       "      <th>8</th>\n",
       "      <th>9</th>\n",
       "      <th>10</th>\n",
       "      <th>11</th>\n",
       "      <th>12</th>\n",
       "      <th>13</th>\n",
       "      <th>14</th>\n",
       "      <th>15</th>\n",
       "      <th>16</th>\n",
       "      <th>17</th>\n",
       "      <th>18</th>\n",
       "      <th>19</th>\n",
       "      <th>20</th>\n",
       "      <th>21</th>\n",
       "      <th>22</th>\n",
       "      <th>23</th>\n",
       "      <th>24</th>\n",
       "      <th>25</th>\n",
       "      <th>26</th>\n",
       "      <th>27</th>\n",
       "      <th>28</th>\n",
       "      <th>29</th>\n",
       "      <th>30</th>\n",
       "      <th>31</th>\n",
       "      <th>32</th>\n",
       "      <th>33</th>\n",
       "      <th>34</th>\n",
       "      <th>35</th>\n",
       "      <th>36</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.339808</td>\n",
       "      <td>0.067740</td>\n",
       "      <td>0.023864</td>\n",
       "      <td>0.565023</td>\n",
       "      <td>0.011022</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.430082</td>\n",
       "      <td>0.286035</td>\n",
       "      <td>0.239627</td>\n",
       "      <td>0.490622</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.00000</td>\n",
       "      <td>0.089289</td>\n",
       "      <td>0.089232</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.436983</td>\n",
       "      <td>0.076007</td>\n",
       "      <td>0.051461</td>\n",
       "      <td>0.529912</td>\n",
       "      <td>0.031337</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.496679</td>\n",
       "      <td>0.237119</td>\n",
       "      <td>0.292402</td>\n",
       "      <td>0.473638</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.00000</td>\n",
       "      <td>0.083419</td>\n",
       "      <td>0.083400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.465493</td>\n",
       "      <td>0.095823</td>\n",
       "      <td>0.079115</td>\n",
       "      <td>0.233682</td>\n",
       "      <td>0.053202</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.486465</td>\n",
       "      <td>0.165805</td>\n",
       "      <td>0.376477</td>\n",
       "      <td>0.453231</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.00000</td>\n",
       "      <td>0.032132</td>\n",
       "      <td>0.032114</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.650142</td>\n",
       "      <td>0.154638</td>\n",
       "      <td>0.186783</td>\n",
       "      <td>0.157203</td>\n",
       "      <td>0.127425</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.454154</td>\n",
       "      <td>0.154096</td>\n",
       "      <td>0.429210</td>\n",
       "      <td>0.442136</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.00000</td>\n",
       "      <td>0.024408</td>\n",
       "      <td>0.024365</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.656204</td>\n",
       "      <td>0.154106</td>\n",
       "      <td>0.388197</td>\n",
       "      <td>0.082434</td>\n",
       "      <td>0.221323</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.481397</td>\n",
       "      <td>0.178022</td>\n",
       "      <td>0.480092</td>\n",
       "      <td>0.411889</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.00000</td>\n",
       "      <td>0.015448</td>\n",
       "      <td>0.015418</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8755</th>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.077191</td>\n",
       "      <td>0.021500</td>\n",
       "      <td>0.045171</td>\n",
       "      <td>0.030488</td>\n",
       "      <td>0.335281</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.035673</td>\n",
       "      <td>0.055388</td>\n",
       "      <td>0.052983</td>\n",
       "      <td>0.056044</td>\n",
       "      <td>0.383319</td>\n",
       "      <td>0.382493</td>\n",
       "      <td>0.371831</td>\n",
       "      <td>0.387646</td>\n",
       "      <td>0.397305</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.302154</td>\n",
       "      <td>0.293488</td>\n",
       "      <td>0.29772</td>\n",
       "      <td>0.621627</td>\n",
       "      <td>0.621585</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8756</th>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.062224</td>\n",
       "      <td>0.018055</td>\n",
       "      <td>0.019462</td>\n",
       "      <td>0.017133</td>\n",
       "      <td>0.428032</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.060415</td>\n",
       "      <td>0.136356</td>\n",
       "      <td>0.100320</td>\n",
       "      <td>0.111646</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.00000</td>\n",
       "      <td>0.604531</td>\n",
       "      <td>0.604569</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8757</th>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.031747</td>\n",
       "      <td>0.026687</td>\n",
       "      <td>0.098691</td>\n",
       "      <td>0.144561</td>\n",
       "      <td>0.378416</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.078338</td>\n",
       "      <td>0.272622</td>\n",
       "      <td>0.140229</td>\n",
       "      <td>0.158945</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.00000</td>\n",
       "      <td>0.511843</td>\n",
       "      <td>0.511823</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8758</th>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.071849</td>\n",
       "      <td>0.033144</td>\n",
       "      <td>0.077648</td>\n",
       "      <td>0.101721</td>\n",
       "      <td>0.351909</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.128073</td>\n",
       "      <td>0.348353</td>\n",
       "      <td>0.227002</td>\n",
       "      <td>0.284965</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.00000</td>\n",
       "      <td>0.089289</td>\n",
       "      <td>0.089232</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8759</th>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.130693</td>\n",
       "      <td>0.051877</td>\n",
       "      <td>0.020795</td>\n",
       "      <td>0.030842</td>\n",
       "      <td>0.320657</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.207165</td>\n",
       "      <td>0.422169</td>\n",
       "      <td>0.304816</td>\n",
       "      <td>0.366066</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.00000</td>\n",
       "      <td>0.089289</td>\n",
       "      <td>0.089232</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>8760 rows × 37 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "        0    1    2    3    4    5         6         7         8         9  \\\n",
       "0     1.0  1.0  1.0  1.0  1.0  1.0  0.339808  0.067740  0.023864  0.565023   \n",
       "1     1.0  1.0  1.0  1.0  1.0  1.0  0.436983  0.076007  0.051461  0.529912   \n",
       "2     1.0  1.0  1.0  1.0  1.0  1.0  0.465493  0.095823  0.079115  0.233682   \n",
       "3     1.0  1.0  1.0  1.0  1.0  1.0  0.650142  0.154638  0.186783  0.157203   \n",
       "4     1.0  1.0  1.0  1.0  1.0  1.0  0.656204  0.154106  0.388197  0.082434   \n",
       "...   ...  ...  ...  ...  ...  ...       ...       ...       ...       ...   \n",
       "8755  1.0  1.0  1.0  1.0  1.0  1.0  0.077191  0.021500  0.045171  0.030488   \n",
       "8756  1.0  1.0  1.0  1.0  1.0  1.0  0.062224  0.018055  0.019462  0.017133   \n",
       "8757  1.0  1.0  1.0  1.0  1.0  1.0  0.031747  0.026687  0.098691  0.144561   \n",
       "8758  1.0  1.0  1.0  1.0  1.0  1.0  0.071849  0.033144  0.077648  0.101721   \n",
       "8759  1.0  1.0  1.0  1.0  1.0  1.0  0.130693  0.051877  0.020795  0.030842   \n",
       "\n",
       "            10   11   12   13   14   15   16        17        18        19  \\\n",
       "0     0.011022  1.0  1.0  1.0  1.0  1.0  1.0  0.430082  0.286035  0.239627   \n",
       "1     0.031337  1.0  1.0  1.0  1.0  1.0  1.0  0.496679  0.237119  0.292402   \n",
       "2     0.053202  1.0  1.0  1.0  1.0  1.0  1.0  0.486465  0.165805  0.376477   \n",
       "3     0.127425  1.0  1.0  1.0  1.0  1.0  1.0  0.454154  0.154096  0.429210   \n",
       "4     0.221323  1.0  1.0  1.0  1.0  1.0  1.0  0.481397  0.178022  0.480092   \n",
       "...        ...  ...  ...  ...  ...  ...  ...       ...       ...       ...   \n",
       "8755  0.335281  1.0  1.0  1.0  1.0  1.0  1.0  0.035673  0.055388  0.052983   \n",
       "8756  0.428032  1.0  1.0  1.0  1.0  1.0  1.0  0.060415  0.136356  0.100320   \n",
       "8757  0.378416  1.0  1.0  1.0  1.0  1.0  1.0  0.078338  0.272622  0.140229   \n",
       "8758  0.351909  1.0  1.0  1.0  1.0  1.0  1.0  0.128073  0.348353  0.227002   \n",
       "8759  0.320657  1.0  1.0  1.0  1.0  1.0  1.0  0.207165  0.422169  0.304816   \n",
       "\n",
       "            20        21        22        23        24        25   26   27  \\\n",
       "0     0.490622  0.000000  0.000000  0.000000  0.000000  0.000000  1.0  1.0   \n",
       "1     0.473638  0.000000  0.000000  0.000000  0.000000  0.000000  1.0  1.0   \n",
       "2     0.453231  0.000000  0.000000  0.000000  0.000000  0.000000  1.0  1.0   \n",
       "3     0.442136  0.000000  0.000000  0.000000  0.000000  0.000000  1.0  1.0   \n",
       "4     0.411889  0.000000  0.000000  0.000000  0.000000  0.000000  1.0  1.0   \n",
       "...        ...       ...       ...       ...       ...       ...  ...  ...   \n",
       "8755  0.056044  0.383319  0.382493  0.371831  0.387646  0.397305  1.0  1.0   \n",
       "8756  0.111646  0.000000  0.000000  0.000000  0.000000  0.000000  1.0  1.0   \n",
       "8757  0.158945  0.000000  0.000000  0.000000  0.000000  0.000000  1.0  1.0   \n",
       "8758  0.284965  0.000000  0.000000  0.000000  0.000000  0.000000  1.0  1.0   \n",
       "8759  0.366066  0.000000  0.000000  0.000000  0.000000  0.000000  1.0  1.0   \n",
       "\n",
       "       28   29   30   31        32        33       34        35        36  \n",
       "0     1.0  1.0  1.0  1.0  0.000000  0.000000  0.00000  0.089289  0.089232  \n",
       "1     1.0  1.0  1.0  1.0  0.000000  0.000000  0.00000  0.083419  0.083400  \n",
       "2     1.0  1.0  1.0  1.0  0.000000  0.000000  0.00000  0.032132  0.032114  \n",
       "3     1.0  1.0  1.0  1.0  0.000000  0.000000  0.00000  0.024408  0.024365  \n",
       "4     1.0  1.0  1.0  1.0  0.000000  0.000000  0.00000  0.015448  0.015418  \n",
       "...   ...  ...  ...  ...       ...       ...      ...       ...       ...  \n",
       "8755  1.0  1.0  1.0  1.0  0.302154  0.293488  0.29772  0.621627  0.621585  \n",
       "8756  1.0  1.0  1.0  1.0  0.000000  0.000000  0.00000  0.604531  0.604569  \n",
       "8757  1.0  1.0  1.0  1.0  0.000000  0.000000  0.00000  0.511843  0.511823  \n",
       "8758  1.0  1.0  1.0  1.0  0.000000  0.000000  0.00000  0.089289  0.089232  \n",
       "8759  1.0  1.0  1.0  1.0  0.000000  0.000000  0.00000  0.089289  0.089232  \n",
       "\n",
       "[8760 rows x 37 columns]"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "make_generator_variability(new_gen)"
   ]
  }
 ],
 "metadata": {
  "interpreter": {
   "hash": "5b6bea18085849e8db31c187c2b2d31536470856f66e9490d10280ec6298feaa"
  },
  "kernelspec": {
   "display_name": "Python 3.9.7 64-bit ('powergenome': conda)",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.9.7"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}