Points_of_interest_overpass.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Fetching Point of Interest information from latitude, longitude data"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "airbnb data had latitude and longitudes of each of the listings. This two features can be used to get the information about surrounding POI's.This is important beacause listings near tourist spots or cafes and restaurants has generally high booking rates. Thus count of these POI's can be obtained in given radius range arround the coordinates in order to determine the attractiveness of the location of the listing. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import requests\n",
    "import json\n",
    "import pandas as pd\n",
    "import numpy as np\n",
    "import matplotlib.pyplot as plt\n",
    "l=pd.read_csv(\"train_latLong.csv\")\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>id</th>\n",
       "      <th>latitude</th>\n",
       "      <th>longitude</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>25.98676</td>\n",
       "      <td>-80.12252</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2</td>\n",
       "      <td>40.76198</td>\n",
       "      <td>-73.98718</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>3</td>\n",
       "      <td>34.00697</td>\n",
       "      <td>-118.45050</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>4</td>\n",
       "      <td>45.18900</td>\n",
       "      <td>-93.13541</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>5</td>\n",
       "      <td>33.76120</td>\n",
       "      <td>-118.13839</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>6</td>\n",
       "      <td>40.81575</td>\n",
       "      <td>-73.94913</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>7</td>\n",
       "      <td>40.70423</td>\n",
       "      <td>-73.81440</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>8</td>\n",
       "      <td>40.73624</td>\n",
       "      <td>-74.07250</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>9</td>\n",
       "      <td>41.48188</td>\n",
       "      <td>-71.42375</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>10</td>\n",
       "      <td>34.06883</td>\n",
       "      <td>-118.13334</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>11</td>\n",
       "      <td>42.28945</td>\n",
       "      <td>-71.12972</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>12</td>\n",
       "      <td>20.99196</td>\n",
       "      <td>-156.66824</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>13</td>\n",
       "      <td>40.75347</td>\n",
       "      <td>-73.99305</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>14</td>\n",
       "      <td>36.27240</td>\n",
       "      <td>-115.15985</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>15</td>\n",
       "      <td>29.94536</td>\n",
       "      <td>-90.07153</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>16</td>\n",
       "      <td>35.60232</td>\n",
       "      <td>-82.53220</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>17</td>\n",
       "      <td>20.76376</td>\n",
       "      <td>-156.45808</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>18</td>\n",
       "      <td>40.70249</td>\n",
       "      <td>-73.94880</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>19</td>\n",
       "      <td>32.73355</td>\n",
       "      <td>-117.16325</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>20</td>\n",
       "      <td>29.94739</td>\n",
       "      <td>-90.07418</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    id  latitude  longitude\n",
       "0    1  25.98676  -80.12252\n",
       "1    2  40.76198  -73.98718\n",
       "2    3  34.00697 -118.45050\n",
       "3    4  45.18900  -93.13541\n",
       "4    5  33.76120 -118.13839\n",
       "5    6  40.81575  -73.94913\n",
       "6    7  40.70423  -73.81440\n",
       "7    8  40.73624  -74.07250\n",
       "8    9  41.48188  -71.42375\n",
       "9   10  34.06883 -118.13334\n",
       "10  11  42.28945  -71.12972\n",
       "11  12  20.99196 -156.66824\n",
       "12  13  40.75347  -73.99305\n",
       "13  14  36.27240 -115.15985\n",
       "14  15  29.94536  -90.07153\n",
       "15  16  35.60232  -82.53220\n",
       "16  17  20.76376 -156.45808\n",
       "17  18  40.70249  -73.94880\n",
       "18  19  32.73355 -117.16325\n",
       "19  20  29.94739  -90.07418"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df=l.head(20)\n",
    "df"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "df is subset of larger aibnb data, with only two features of latitude and longitude from it. Goal is to create new features with count of tourist attraction, bars,cafes,pubs and restaurants. I have done it using two methods.\n",
    "First is free but time consuming ,using overpass api (https://wiki.openstreetmap.org/wiki/Overpass_API)\n",
    "\n",
    "second is faster but could be very expensive if api requests goes past free limits using Google api .(https://developers.google.com/places/web-service/search)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Finding attractiveness of location using overpass api\n",
    "\n",
    "Overpass api can be used to fetch information about wide range of POI's. I have used 5 which I though could affect the decision of airbnb customer while booking the lisiting. Other POI's which can be used similarly can be found here https://wiki.openstreetmap.org/wiki/Map_Features.\n",
    "\n",
    "Code will find tourist attractions, bars, cafes, pubs and restaurants in 500 meter radius around the coordinates. Radius can be changed by changing the parameter of around in the code below."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "1\n",
      "{'addr:housenumber': '4111', 'addr:postcode': '33019', 'addr:street': 'South Ocean Drive', 'amenity': 'restaurant', 'name': 'Terrazas at Hyde Hollywood', 'opening_hours': 'Su-Th 07:00-22:00; Fr-Sa 07:00-23:00', 'phone': '+1 754-707-5076', 'website': 'https://www.terrazasathyde.com/'}\n",
      "\n",
      "\n",
      "2\n",
      "{'amenity': 'cafe', 'name': 'Ben&jerry', 'note': 'Most Fabulous Cheesecake', 'website': 'https://www.juniorscheesecake.com/'}\n",
      "\n",
      "\n",
      "3\n",
      "4\n",
      "5\n",
      "{'amenity': 'cafe', 'cuisine': 'coffee_shop', 'name': \"Polly's Gourmet Coffee\"}\n",
      "\n",
      "\n",
      "6\n",
      "{'amenity': 'restaurant', 'name': 'Harlem Maison'}\n",
      "\n",
      "\n",
      "7\n",
      "{'addr:street': 'Sutphin Boulevard', 'amenity': 'cafe', 'name': 'Starbucks'}\n",
      "\n",
      "\n",
      "8\n",
      "{'amenity': 'cafe', 'name': 'Mod Cup'}\n",
      "\n",
      "\n",
      "9\n",
      "10\n",
      "{'addr:housenumber': '500', 'addr:postcode': '91745', 'addr:street': 'N Atlantic Boulevard', 'amenity': 'restaurant', 'cuisine': 'Taiwan,_Chinese', 'name': 'Tasty Garden 稻香中西美食坊', 'phone': '626-872-0900'}\n",
      "\n",
      "\n",
      "11\n",
      "12\n",
      "{'addr:housenumber': '5315', 'addr:postcode': '96761', 'addr:street': 'Lower Honoapi‘ilani Road', 'amenity': 'restaurant', 'cuisine': 'breakfast', 'name': 'Gazebo', 'opening_hours': 'Mo-Su 07:30-14:00', 'phone': '808-669-5621'}\n",
      "\n",
      "\n",
      "13\n",
      "{'addr:city': 'New York', 'addr:country': 'US', 'addr:housenumber': '331', 'addr:state': 'NY', 'addr:street': 'West 38th Street', 'amenity': 'restaurant', 'name': 'Carbone'}\n",
      "\n",
      "\n",
      "14\n",
      "15\n",
      "{'addr:housenumber': '1032', 'addr:street': 'Saint Charles Avenue', 'amenity': 'bar', 'name': 'Circle Bar', 'phone': '+1 504 5882616', 'website': 'http://www.circlebarnola.com'}\n",
      "\n",
      "\n",
      "16\n",
      "{'amenity': 'restaurant', 'brand': 'Cracker Barrel', 'brand:wikidata': 'Q4492609', 'brand:wikipedia': 'en:Cracker Barrel', 'building': 'yes', 'cuisine': 'american', 'name': 'Cracker Barrel', 'official_name': 'Cracker Barrel Old Country Store'}\n",
      "\n",
      "\n",
      "17\n",
      "18\n",
      "{'addr:city': 'Brooklyn', 'addr:housenumber': '715', 'addr:postcode': '11206', 'addr:state': 'NY', 'addr:street': 'Flushing Avenue', 'amenity': 'restaurant', 'cuisine': 'mexican', 'name': 'Habanero Cafe Mexican', 'takeaway': 'yes'}\n",
      "\n",
      "\n",
      "19\n",
      "{'addr:city': 'San Diego', 'addr:housenumber': '2550', 'addr:postcode': '92103', 'addr:state': 'CA', 'addr:street': '5th Avenue', 'addr:unit': '75', 'amenity': 'cafe', 'name': 'The West Bean Coffee Roasters', 'opening_hours': 'Mo-Su 07:00-19:00', 'phone': '+1-619-794-2052', 'website': 'https://thewestbean.com/'}\n",
      "\n",
      "\n",
      "20\n",
      "{'amenity': 'bar', 'name': \"Happy's\"}\n",
      "\n",
      "\n"
     ]
    }
   ],
   "source": [
    "p1=[]\n",
    "p15=[]\n",
    "p16=[]\n",
    "p17=[]\n",
    "p18=[]\n",
    "\n",
    "count=1\n",
    "for index, row in df.iterrows():\n",
    "    \n",
    "    latog=row.latitude\n",
    "    longog=row.longitude\n",
    "    #print(latog)\n",
    "    #print(lat,long)\n",
    "    \n",
    "    overpass_url = \"http://overpass-api.de/api/interpreter\"\n",
    "    headers = {\"User-Agent\": \"Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.119 Safari/537.36\"}\n",
    "# heades are required to unblock api request from above web browsers\n",
    "    overpass_query = f\"\"\"\n",
    "    [out:json];\n",
    "    (\n",
    "    node(around:500.0,{latog},{longog})[\"tourism\"=\"attraction\"];\n",
    "    way(around:500.0,{latog},{longog})[\"tourism\"=\"attraction\"];\n",
    "    relation(around:500.0,{latog},{longog})[\"tourism\"=\"attraction\"];\n",
    "\n",
    "    node(around:500.0,{latog},{longog})[\"amenity\"=\"bar\"];\n",
    "    way(around:500.0,{latog},{longog})[\"amenity\"=\"bar\"];\n",
    "    relation(around:500.0,{latog},{longog})[\"amenity\"=\"bar\"];\n",
    "\n",
    "    node(around:500.0,{latog},{longog})[\"amenity\"=\"cafe\"];\n",
    "    way(around:500.0,{latog},{longog})[\"amenity\"=\"cafe\"];\n",
    "    relation(around:500.0,{latog},{longog})[\"amenity\"=\"cafe\"];\n",
    "    \n",
    "\n",
    "    node(around:500.0,{latog},{longog})[\"amenity\"=\"pub\"];\n",
    "    way(around:500.0,{latog},{longog})[\"amenity\"=\"pub\"];\n",
    "    relation(around:500.0,{latog},{longog})[\"amenity\"=\"pub\"];\n",
    "\n",
    "    node(around:500.0,{latog},{longog})[\"amenity\"=\"restaurant\"];\n",
    "    way(around:500.0,{latog},{longog})[\"amenity\"=\"restaurant\"];\n",
    "    relation(around:500.0,{latog},{longog})[\"amenity\"=\"restaurant\"];\n",
    "    \n",
    "    \n",
    "        \n",
    "\n",
    "    \n",
    "    \n",
    "    );\n",
    "    out center;\n",
    "    \"\"\" \n",
    "    \n",
    "    try:\n",
    "        response = requests.get(overpass_url, \n",
    "                        params={'data': overpass_query},headers=headers)\n",
    "        data = response.json()\n",
    "        #print(data)\n",
    "        print(count)# count is used to keep track of progess\n",
    "        for el in data['elements']:\n",
    "            print(el['tags'])\n",
    "            print(\"\\n\")\n",
    "            break\n",
    "        #print(\"\\n\")\n",
    "    except json.decoder.JSONDecodeError:\n",
    "        p1.append('NA')\n",
    "        p15.append('NA')\n",
    "        p16.append('NA')\n",
    "        p17.append('NA')\n",
    "        p18.append('NA')\n",
    "\n",
    "        \n",
    "        count=count+1\n",
    "        continue\n",
    "    except ConnectionError as e:\n",
    "        p1.append('NA')\n",
    "        p15.append('NA')\n",
    "        p16.append('NA')\n",
    "        p17.append('NA')\n",
    "        p18.append('NA')\n",
    "\n",
    "        \n",
    "        count=count+1\n",
    "        continue\n",
    "    \n",
    "    p1c=[]\n",
    "    p15c=[]\n",
    "    p16c=[]\n",
    "    p17c=[]\n",
    "    p18c=[]\n",
    "    \n",
    "\n",
    "    for element in data['elements']:\n",
    "        if (element['type'] == 'node' and 'tourism' in element['tags']) or ('center' in element and 'tourism' in element['tags']) :\n",
    "            if (element['tags']['tourism']=='attraction'):\n",
    "                 for el in element:\n",
    "                        if el=='id':\n",
    "                            p1c.append(id)\n",
    "                                           \n",
    "\n",
    "                \n",
    "        elif (element['type'] == 'node' and 'amenity' in element['tags']) or ('center' in element and 'amenity' in element['tags']):\n",
    "            if (element['tags']['amenity']=='bar'):\n",
    "                for el in element:\n",
    "                        if el=='id':\n",
    "                            p15c.append(id)\n",
    "                \n",
    "            elif (element['tags']['amenity']=='cafe'):\n",
    "                for el in element:\n",
    "                        if el=='id':\n",
    "                            p16c.append(id)\n",
    "                \n",
    "        \n",
    "            elif (element['tags']['amenity']=='pub'):\n",
    "                for el in element:\n",
    "                        if el=='id':\n",
    "                            p17c.append(id)\n",
    "        \n",
    "            elif (element['tags']['amenity']=='restaurant'):\n",
    "                for el in element:\n",
    "                        if el=='id':\n",
    "                            p18c.append(id)\n",
    "                \n",
    "\n",
    "                            \n",
    "      \n",
    "    p1cd=np.array(p1c)\n",
    "    p15cd=np.array(p15c)\n",
    "    p16cd=np.array(p16c)\n",
    "    p17cd=np.array(p17c)\n",
    "    p18cd=np.array(p18c)\n",
    "\n",
    "        \n",
    "    p1.append(len(p1cd))\n",
    "    p15.append(len(p15cd))\n",
    "    p16.append(len(p16cd))\n",
    "    p17.append(len(p17cd))\n",
    "    p18.append(len(p18cd))\n",
    "    \n",
    "    count=count+1\n",
    "    \n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the above output I have displayed only first fetched point of interest along with its details for each coordinates.It can be seen that for few coordinates there are no POI's in 500 meter range (e.g. 3,4,9,11)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "C:\\Users\\sdk19\\anaconda3\\lib\\site-packages\\ipykernel_launcher.py:2: SettingWithCopyWarning: \n",
      "A value is trying to be set on a copy of a slice from a DataFrame.\n",
      "Try using .loc[row_indexer,col_indexer] = value instead\n",
      "\n",
      "See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy\n",
      "  \n",
      "C:\\Users\\sdk19\\anaconda3\\lib\\site-packages\\ipykernel_launcher.py:3: SettingWithCopyWarning: \n",
      "A value is trying to be set on a copy of a slice from a DataFrame.\n",
      "Try using .loc[row_indexer,col_indexer] = value instead\n",
      "\n",
      "See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy\n",
      "  This is separate from the ipykernel package so we can avoid doing imports until\n",
      "C:\\Users\\sdk19\\anaconda3\\lib\\site-packages\\ipykernel_launcher.py:4: SettingWithCopyWarning: \n",
      "A value is trying to be set on a copy of a slice from a DataFrame.\n",
      "Try using .loc[row_indexer,col_indexer] = value instead\n",
      "\n",
      "See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy\n",
      "  after removing the cwd from sys.path.\n",
      "C:\\Users\\sdk19\\anaconda3\\lib\\site-packages\\ipykernel_launcher.py:5: SettingWithCopyWarning: \n",
      "A value is trying to be set on a copy of a slice from a DataFrame.\n",
      "Try using .loc[row_indexer,col_indexer] = value instead\n",
      "\n",
      "See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy\n",
      "  \"\"\"\n",
      "C:\\Users\\sdk19\\anaconda3\\lib\\site-packages\\ipykernel_launcher.py:6: SettingWithCopyWarning: \n",
      "A value is trying to be set on a copy of a slice from a DataFrame.\n",
      "Try using .loc[row_indexer,col_indexer] = value instead\n",
      "\n",
      "See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy\n",
      "  \n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>id</th>\n",
       "      <th>latitude</th>\n",
       "      <th>longitude</th>\n",
       "      <th>attraction</th>\n",
       "      <th>bar</th>\n",
       "      <th>cafe</th>\n",
       "      <th>pub</th>\n",
       "      <th>restaurant</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>25.98676</td>\n",
       "      <td>-80.12252</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2</td>\n",
       "      <td>40.76198</td>\n",
       "      <td>-73.98718</td>\n",
       "      <td>5</td>\n",
       "      <td>28</td>\n",
       "      <td>24</td>\n",
       "      <td>10</td>\n",
       "      <td>145</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>3</td>\n",
       "      <td>34.00697</td>\n",
       "      <td>-118.45050</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>4</td>\n",
       "      <td>45.18900</td>\n",
       "      <td>-93.13541</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>5</td>\n",
       "      <td>33.76120</td>\n",
       "      <td>-118.13839</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>13</td>\n",
       "      <td>2</td>\n",
       "      <td>20</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>6</td>\n",
       "      <td>40.81575</td>\n",
       "      <td>-73.94913</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>9</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>7</td>\n",
       "      <td>40.70423</td>\n",
       "      <td>-73.81440</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>8</td>\n",
       "      <td>40.73624</td>\n",
       "      <td>-74.07250</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>9</td>\n",
       "      <td>41.48188</td>\n",
       "      <td>-71.42375</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>10</td>\n",
       "      <td>34.06883</td>\n",
       "      <td>-118.13334</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>11</td>\n",
       "      <td>42.28945</td>\n",
       "      <td>-71.12972</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>12</td>\n",
       "      <td>20.99196</td>\n",
       "      <td>-156.66824</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>13</td>\n",
       "      <td>40.75347</td>\n",
       "      <td>-73.99305</td>\n",
       "      <td>7</td>\n",
       "      <td>22</td>\n",
       "      <td>26</td>\n",
       "      <td>11</td>\n",
       "      <td>64</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>14</td>\n",
       "      <td>36.27240</td>\n",
       "      <td>-115.15985</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>15</td>\n",
       "      <td>29.94536</td>\n",
       "      <td>-90.07153</td>\n",
       "      <td>0</td>\n",
       "      <td>4</td>\n",
       "      <td>7</td>\n",
       "      <td>1</td>\n",
       "      <td>8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>16</td>\n",
       "      <td>35.60232</td>\n",
       "      <td>-82.53220</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>17</td>\n",
       "      <td>20.76376</td>\n",
       "      <td>-156.45808</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>18</td>\n",
       "      <td>40.70249</td>\n",
       "      <td>-73.94880</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>19</td>\n",
       "      <td>32.73355</td>\n",
       "      <td>-117.16325</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>20</td>\n",
       "      <td>29.94739</td>\n",
       "      <td>-90.07418</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>6</td>\n",
       "      <td>0</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    id  latitude  longitude  attraction  bar  cafe  pub  restaurant\n",
       "0    1  25.98676  -80.12252           0    0     0    0           1\n",
       "1    2  40.76198  -73.98718           5   28    24   10         145\n",
       "2    3  34.00697 -118.45050           0    0     0    0           0\n",
       "3    4  45.18900  -93.13541           0    0     0    0           0\n",
       "4    5  33.76120 -118.13839           0    0    13    2          20\n",
       "5    6  40.81575  -73.94913           0    1     1    0           9\n",
       "6    7  40.70423  -73.81440           0    1     1    0           2\n",
       "7    8  40.73624  -74.07250           0    0     1    0           0\n",
       "8    9  41.48188  -71.42375           0    0     0    0           0\n",
       "9   10  34.06883 -118.13334           0    0     0    0           5\n",
       "10  11  42.28945  -71.12972           0    0     0    0           0\n",
       "11  12  20.99196 -156.66824           0    0     0    0           2\n",
       "12  13  40.75347  -73.99305           7   22    26   11          64\n",
       "13  14  36.27240 -115.15985           0    0     0    0           0\n",
       "14  15  29.94536  -90.07153           0    4     7    1           8\n",
       "15  16  35.60232  -82.53220           0    0     0    0           1\n",
       "16  17  20.76376 -156.45808           0    0     0    0           0\n",
       "17  18  40.70249  -73.94880           0    0     1    0           2\n",
       "18  19  32.73355 -117.16325           0    1     2    0           3\n",
       "19  20  29.94739  -90.07418           1    1     6    0           5"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "\n",
    "df['attraction']=p1\n",
    "df['bar']=p15\n",
    "df['cafe']=p16\n",
    "df['pub']=p17\n",
    "df['restaurant']=p18\n",
    "\n",
    "\n",
    "df"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This is how the final dataframe looks like. This 5 new features can now be used in the model to improve its performance."
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.6"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}