api-examples/ambari-blueprints_field-notes.ipynb

{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": 483,
   "metadata": {
    "collapsed": true,
    "scrolled": true,
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [],
   "source": [
    "##### from collections import OrderedDict\n",
    "## Pandas\n",
    "import pandas as pd\n",
    "from IPython.display import display\n",
    "from IPython.display import HTML\n",
    "from pandas.io.json import json_normalize\n",
    "pd.set_option('max_colwidth',255)\n",
    "pd.set_option('max_columns',10)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 537,
   "metadata": {
    "collapsed": false,
    "scrolled": false,
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "········\n",
      "You are authenticated to Ambari!\n"
     ]
    }
   ],
   "source": [
    "#### Prep for the presentation\n",
    "\n",
    "### Authenticate to Ambari\n",
    "\n",
    "#### Python requirements\n",
    "import difflib\n",
    "import getpass\n",
    "import json\n",
    "import requests\n",
    "import sys\n",
    "import time\n",
    "\n",
    "#### Change these to fit your Ambari configuration\n",
    "ambari_protocol = 'http'\n",
    "ambari_server = 'sroberts-bp02.cloud.hortonworks.com'\n",
    "#ambari_server = 'pregion-shared01.cloud.hortonworks.com'\n",
    "ambari_port = 8080\n",
    "ambari_user = 'admin'\n",
    "#cluster = 'Sandbox'\n",
    "\n",
    "#### Above input gives us http://user:pass@hostname:port/api/v1/\n",
    "api_url = ambari_protocol + '://' + ambari_server + ':' + str(ambari_port)\n",
    "\n",
    "#### Prompt for password & build the HTTP session\n",
    "ambari_pass = getpass.getpass()\n",
    "s = requests.Session()\n",
    "s.auth = (ambari_user, ambari_pass)\n",
    "s.headers.update({'X-Requested-By':'seanorama'})\n",
    "\n",
    "#### Authenticate & verify authentication\n",
    "r = s.get(api_url + '/api/v1/clusters')\n",
    "assert r.status_code == 200\n",
    "print(\"You are authenticated to Ambari!\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "# Field Notes: Ambari Blueprints\n",
    "\n",
    "![Take This](http://nola.liberty.me/wp-content/uploads/sites/1472/2014/11/dangerousgif.gif)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true,
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Nerd Alert: Presenting from ipython\n",
    "\n",
    "* https://github.com/damianavila/RISE"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true,
    "slideshow": {
     "slide_type": "fragment"
    }
   },
   "source": [
    "#### Not Zeppelin"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## whoami\n",
    "\n",
    "Sean Roberts\n",
    "Partner Engineering, EMEA\n",
    "![Me](http://i.imgur.com/8uBbEpH.jpg)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Today\n",
    "\n",
    "* Requirements for Blueprints\n",
    "* Refresher on Ambari Stacks\n",
    "* Blueprint & Cluster Template\n",
    "* Deploying the Blueprint & Cluster\n",
    "* Field Notes *(sort of)*\n",
    "* Questions"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Not Today\n",
    "\n",
    "### Deploying with Ambari:\n",
    "\n",
    "- Infrastructure & Node Prep\n",
    "- Deploying Ambari Server & Agents\n",
    "- Ambari considerations (java, database, …)\n",
    "- Lessons learned from large scale deployments\n",
    "\n",
    "### Ongoing operations:\n",
    "\n",
    "- General overview of the API\n",
    "- Configuration Groups\n",
    "- Adding nodes to a config group"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## What You'll Need\n",
    "\n",
    "* Ambari Server & Agents Installed\n",
    "* Ambari Agents Registered to Ambari Server (/api/v1/hosts)\n",
    "* HDP prereqs(networking, OS repos, …)\n",
    "* If using separate or non-default SQL databases, configure them first.\n",
    "* Access & credentials to Ambari Server\n",
    "* Blueprint (JSON)\n",
    "* Cluster Description (JSON)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "notes"
    }
   },
   "source": [
    "  * https://wiki.hortonworks.com/display/SE/SE+Cloud\n",
    "  * http://github.com/seanorama/ambari-bootstrap\n",
    "  * CloudBreak\n",
    "    * Note: HA Blueprints not supported *(simple validation bug should be fixed soon)*"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 538,
   "metadata": {
    "collapsed": false,
    "scrolled": true,
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{\n",
      "  \"href\": \"http://sroberts-bp02.cloud.hortonworks.com:8080/api/v1/hosts\",\n",
      "  \"items\": [\n",
      "    {\n",
      "      \"href\": \"http://sroberts-bp02.cloud.hortonworks.com:8080/api/v1/hosts/sroberts-bp01.cloud.hortonworks.com\",\n",
      "      \"Hosts\": {\n",
      "        \"host_name\": \"sroberts-bp01.cloud.hortonworks.com\"\n",
      "      }\n",
      "    },\n",
      "    {\n",
      "      \"href\": \"http://sroberts-bp02.cloud.hortonworks.com:8080/api/v1/hosts/sroberts-bp02.cloud.hortonworks.com\",\n",
      "      \"Hosts\": {\n",
      "        \"host_name\": \"sroberts-bp02.cloud.hortonworks.com\"\n",
      "      }\n",
      "    },\n",
      "    {\n",
      "      \"href\": \"http://sroberts-bp02.cloud.hortonworks.com:8080/api/v1/hosts/sroberts-bp03.cloud.hortonworks.com\",\n",
      "      \"Hosts\": {\n",
      "        \"host_name\": \"sroberts-bp03.cloud.hortonworks.com\"\n",
      "      }\n",
      "    },\n",
      "    {\n",
      "      \"href\": \"http://sroberts-bp02.cloud.hortonworks.com:8080/api/v1/hosts/sroberts-bp04.cloud.hortonworks.com\",\n",
      "      \"Hosts\": {\n",
      "        \"host_name\": \"sroberts-bp04.cloud.hortonworks.com\"\n",
      "      }\n",
      "    },\n",
      "    {\n",
      "      \"href\": \"http://sroberts-bp02.cloud.hortonworks.com:8080/api/v1/hosts/sroberts-bp05.cloud.hortonworks.com\",\n",
      "      \"Hosts\": {\n",
      "        \"host_name\": \"sroberts-bp05.cloud.hortonworks.com\"\n",
      "      }\n",
      "    },\n",
      "    {\n",
      "      \"href\": \"http://sroberts-bp02.cloud.hortonworks.com:8080/api/v1/hosts/sroberts-bp06.cloud.hortonworks.com\",\n",
      "      \"Hosts\": {\n",
      "        \"host_name\": \"sroberts-bp06.cloud.hortonworks.com\"\n",
      "      }\n",
      "    },\n",
      "    {\n",
      "      \"href\": \"http://sroberts-bp02.cloud.hortonworks.com:8080/api/v1/hosts/sroberts-bp07.cloud.hortonworks.com\",\n",
      "      \"Hosts\": {\n",
      "        \"host_name\": \"sroberts-bp07.cloud.hortonworks.com\"\n",
      "      }\n",
      "    },\n",
      "    {\n",
      "      \"href\": \"http://sroberts-bp02.cloud.hortonworks.com:8080/api/v1/hosts/sroberts-bp08.cloud.hortonworks.com\",\n",
      "      \"Hosts\": {\n",
      "        \"host_name\": \"sroberts-bp08.cloud.hortonworks.com\"\n",
      "      }\n",
      "    }\n",
      "  ]\n",
      "}\n"
     ]
    }
   ],
   "source": [
    "r = s.get(api_url + '/api/v1/hosts')\n",
    "print(json.dumps(r.json(), indent=2))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Reminder: Ambari Stacks\n",
    "\n",
    "* Stack: HDP, PHD, ...\n",
    "    * Versions: 2.2\n",
    "      * Services: HDFS, SPARK\n",
    "        * Components: NODEMANAGER"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Service & Component List"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 486,
   "metadata": {
    "collapsed": false,
    "scrolled": false,
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [],
   "source": [
    "r = s.get(api_url + '/api/v1/stacks/HDP/versions/2.2/services')\n",
    "\n",
    "stackservicecomponents = {}\n",
    "for a in r.json()['items']:\n",
    "    r = s.get(a['href'] + '/components')\n",
    "    components = []\n",
    "    for b in [a['StackServiceComponents'] for a in r.json()['items']]:\n",
    "        service = b['service_name']\n",
    "        components.append(b['component_name'])\n",
    "    stackservicecomponents[service] = ' '.join(components)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 487,
   "metadata": {
    "collapsed": false,
    "scrolled": false,
    "slideshow": {
     "slide_type": "fragment"
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\">\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>AMBARI_METRICS</th>\n",
       "      <td>METRICS_COLLECTOR METRICS_MONITOR</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>FALCON</th>\n",
       "      <td>FALCON_CLIENT FALCON_SERVER</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>FLUME</th>\n",
       "      <td>FLUME_HANDLER</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>GANGLIA</th>\n",
       "      <td>GANGLIA_MONITOR GANGLIA_SERVER</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>HBASE</th>\n",
       "      <td>HBASE_CLIENT HBASE_MASTER HBASE_REGIONSERVER</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>HDFS</th>\n",
       "      <td>DATANODE HDFS_CLIENT JOURNALNODE NAMENODE SECONDARY_NAMENODE ZKFC</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>HIVE</th>\n",
       "      <td>HCAT HIVE_CLIENT HIVE_METASTORE HIVE_SERVER MYSQL_SERVER WEBHCAT_SERVER</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>KAFKA</th>\n",
       "      <td>KAFKA_BROKER</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>KERBEROS</th>\n",
       "      <td>KERBEROS_CLIENT</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>KNOX</th>\n",
       "      <td>KNOX_GATEWAY</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>MAPREDUCE2</th>\n",
       "      <td>HISTORYSERVER MAPREDUCE2_CLIENT</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>OOZIE</th>\n",
       "      <td>OOZIE_CLIENT OOZIE_SERVER</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>PIG</th>\n",
       "      <td>PIG</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>RANGER</th>\n",
       "      <td>RANGER_ADMIN RANGER_USERSYNC</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>SLIDER</th>\n",
       "      <td>SLIDER</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>SPARK</th>\n",
       "      <td>SPARK_CLIENT SPARK_JOBHISTORYSERVER</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>SQOOP</th>\n",
       "      <td>SQOOP</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>STORM</th>\n",
       "      <td>DRPC_SERVER NIMBUS STORM_UI_SERVER SUPERVISOR</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>TEZ</th>\n",
       "      <td>TEZ_CLIENT</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>YARN</th>\n",
       "      <td>APP_TIMELINE_SERVER NODEMANAGER RESOURCEMANAGER YARN_CLIENT</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>ZOOKEEPER</th>\n",
       "      <td>ZOOKEEPER_CLIENT ZOOKEEPER_SERVER</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                                                      0\n",
       "AMBARI_METRICS                                        METRICS_COLLECTOR METRICS_MONITOR\n",
       "FALCON                                                      FALCON_CLIENT FALCON_SERVER\n",
       "FLUME                                                                     FLUME_HANDLER\n",
       "GANGLIA                                                  GANGLIA_MONITOR GANGLIA_SERVER\n",
       "HBASE                                      HBASE_CLIENT HBASE_MASTER HBASE_REGIONSERVER\n",
       "HDFS                  DATANODE HDFS_CLIENT JOURNALNODE NAMENODE SECONDARY_NAMENODE ZKFC\n",
       "HIVE            HCAT HIVE_CLIENT HIVE_METASTORE HIVE_SERVER MYSQL_SERVER WEBHCAT_SERVER\n",
       "KAFKA                                                                      KAFKA_BROKER\n",
       "KERBEROS                                                                KERBEROS_CLIENT\n",
       "KNOX                                                                       KNOX_GATEWAY\n",
       "MAPREDUCE2                                              HISTORYSERVER MAPREDUCE2_CLIENT\n",
       "OOZIE                                                         OOZIE_CLIENT OOZIE_SERVER\n",
       "PIG                                                                                 PIG\n",
       "RANGER                                                     RANGER_ADMIN RANGER_USERSYNC\n",
       "SLIDER                                                                           SLIDER\n",
       "SPARK                                               SPARK_CLIENT SPARK_JOBHISTORYSERVER\n",
       "SQOOP                                                                             SQOOP\n",
       "STORM                                     DRPC_SERVER NIMBUS STORM_UI_SERVER SUPERVISOR\n",
       "TEZ                                                                          TEZ_CLIENT\n",
       "YARN                        APP_TIMELINE_SERVER NODEMANAGER RESOURCEMANAGER YARN_CLIENT\n",
       "ZOOKEEPER                                             ZOOKEEPER_CLIENT ZOOKEEPER_SERVER"
      ]
     },
     "execution_count": 487,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "pd.DataFrame.from_dict(stackservicecomponents, orient='index').sort()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": false,
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## A Blueprint is\n",
    "\n",
    "JSON document with 3 sections:\n",
    "\n",
    "* `Blueprints`: Ambari Stack to use"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "fragment"
    }
   },
   "source": [
    "* `host_groups`: Grouping of hosts and the Ambari Stack's components to deploy"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "fragment"
    }
   },
   "source": [
    "* `configurations`: (optional) Specific configurations to pass through for the Ambari Stack"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "```json\n",
    "{\n",
    "  \"Blueprints\": {\n",
    "    \"stack_name\": \"HDP\", \"stack_version\": \"2.2\"\n",
    "  },\n",
    "  \n",
    "  \"host_groups\": [\n",
    "    { \"name\": \"master_1\", \"components\": [ { \"name\": \"NAMENODE\" }, ... ] },\n",
    "    { \"name\": \"slave_1\", \"components\": [ { \"name\": \"DATANODE\" }, ... ] }\n",
    "  ],\n",
    "  \n",
    "  \"configurations\": [\n",
    "    { \"hive-site\": { \"hive.execution.engine\": \"tez\" }\n",
    "  ]\n",
    "}\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Blueprint example\n",
    "\n",
    "* With special configurations:\n",
    "  - HA HDFS\n",
    "  - HA YARN Resource Manager\n",
    "  - Set different HDFS dirs depend on host_group\n",
    "  - and Oozie using Postgresql instead of Derby"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 569,
   "metadata": {
    "collapsed": false,
    "scrolled": true,
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{\n",
      "  \"Blueprints\": {\n",
      "    \"stack_name\": \"HDP\",\n",
      "    \"stack_version\": \"2.2\"\n",
      "  },\n",
      "  \"host_groups\": [\n",
      "    {\n",
      "      \"components\": [\n",
      "        {\n",
      "          \"name\": \"HDFS_CLIENT\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"MAPREDUCE2_CLIENT\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"METRICS_COLLECTOR\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"METRICS_MONITOR\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"OOZIE_CLIENT\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"TEZ_CLIENT\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"YARN_CLIENT\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"ZOOKEEPER_CLIENT\"\n",
      "        }\n",
      "      ],\n",
      "      \"name\": \"gateway\",\n",
      "      \"cardinality\": \"1\"\n",
      "    },\n",
      "    {\n",
      "      \"components\": [\n",
      "        {\n",
      "          \"name\": \"HISTORYSERVER\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"JOURNALNODE\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"METRICS_MONITOR\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"NAMENODE\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"OOZIE_SERVER\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"ZKFC\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"ZOOKEEPER_SERVER\"\n",
      "        }\n",
      "      ],\n",
      "      \"name\": \"master_1\",\n",
      "      \"cardinality\": \"1\"\n",
      "    },\n",
      "    {\n",
      "      \"components\": [\n",
      "        {\n",
      "          \"name\": \"APP_TIMELINE_SERVER\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"JOURNALNODE\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"METRICS_MONITOR\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"RESOURCEMANAGER\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"ZOOKEEPER_SERVER\"\n",
      "        }\n",
      "      ],\n",
      "      \"name\": \"master_2\",\n",
      "      \"cardinality\": \"1\"\n",
      "    },\n",
      "    {\n",
      "      \"components\": [\n",
      "        {\n",
      "          \"name\": \"JOURNALNODE\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"METRICS_MONITOR\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"NAMENODE\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"RESOURCEMANAGER\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"ZKFC\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"ZOOKEEPER_SERVER\"\n",
      "        }\n",
      "      ],\n",
      "      \"name\": \"master_3\",\n",
      "      \"cardinality\": \"1\"\n",
      "    },\n",
      "    {\n",
      "      \"components\": [\n",
      "        {\n",
      "          \"name\": \"DATANODE\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"METRICS_MONITOR\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"NODEMANAGER\"\n",
      "        }\n",
      "      ],\n",
      "      \"name\": \"slave_standard\"\n",
      "    },\n",
      "    {\n",
      "      \"components\": [\n",
      "        {\n",
      "          \"name\": \"DATANODE\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"METRICS_MONITOR\"\n",
      "        },\n",
      "        {\n",
      "          \"name\": \"NODEMANAGER\"\n",
      "        }\n",
      "      ],\n",
      "      \"name\": \"slave_archive\",\n",
      "      \"configurations\": [\n",
      "        {\n",
      "          \"yarn-site\": {\n",
      "            \"properties\": {\n",
      "              \"yarn.nodemanager.local-dirs\": \"/mnt/hdfs0/yarn/local,/mnt/hdfs1/yarn/local\",\n",
      "              \"yarn.nodemanager.log-dirs\": \"/mnt/hdfs0/yarn/log,/mnt/hdfs1/yarn/log\"\n",
      "            }\n",
      "          }\n",
      "        },\n",
      "        {\n",
      "          \"hdfs-site\": {\n",
      "            \"properties\": {\n",
      "              \"dfs.datanode.data.dir\": \"/mnt/hdfs0/data,/mnt/hdfs1/data\"\n",
      "            }\n",
      "          }\n",
      "        }\n",
      "      ]\n",
      "    }\n",
      "  ],\n",
      "  \"configurations\": [\n",
      "    {\n",
      "      \"core-site\": {\n",
      "        \"properties\": {\n",
      "          \"ha.zookeeper.quorum\": \"%HOSTGROUP::master_1%:2181,%HOSTGROUP::master_2%:2181,%HOSTGROUP::master_3%:2181\",\n",
      "          \"fs.defaultFS\": \"hdfs://mycluster\"\n",
      "        }\n",
      "      }\n",
      "    },\n",
      "    {\n",
      "      \"hdfs-site\": {\n",
      "        \"properties\": {\n",
      "          \"dfs.ha.fencing.methods\": \"shell(/bin/true)\",\n",
      "          \"dfs.client.failover.proxy.provider.mycluster\": \"org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider\",\n",
      "          \"dfs.namenode.http-address\": \"%HOSTGROUP::master_1%:50070\",\n",
      "          \"dfs.namenode.https-address.mycluster.nn1\": \"%HOSTGROUP::master_1%:50470\",\n",
      "          \"dfs.namenode.http-address.mycluster.nn1\": \"%HOSTGROUP::master_1%:50070\",\n",
      "          \"dfs.ha.namenodes.mycluster\": \"nn1,nn2\",\n",
      "          \"dfs.namenode.https-address\": \"%HOSTGROUP::master_1%:50470\",\n",
      "          \"dfs.namenode.https-address.mycluster.nn2\": \"%HOSTGROUP::master_3%:50470\",\n",
      "          \"dfs.ha.automatic-failover.enabled\": \"true\",\n",
      "          \"dfs.namenode.rpc-address.mycluster.nn1\": \"%HOSTGROUP::master_1%:8020\",\n",
      "          \"dfs.namenode.http-address.mycluster.nn2\": \"%HOSTGROUP::master_3%:50070\",\n",
      "          \"dfs.nameservices\": \"mycluster\",\n",
      "          \"dfs.namenode.rpc-address.mycluster.nn2\": \"%HOSTGROUP::master_3%:8020\",\n",
      "          \"dfs.namenode.shared.edits.dir\": \"qjournal://%HOSTGROUP::master_1%:8485;%HOSTGROUP::master_2%:8485;%HOSTGROUP::master_3%:8485/mycluster\"\n",
      "        }\n",
      "      }\n",
      "    },\n",
      "    {\n",
      "      \"yarn-site\": {\n",
      "        \"properties\": {\n",
      "          \"yarn.resourcemanager.cluster-id\": \"yarn-cluster\",\n",
      "          \"yarn.resourcemanager.ha.enabled\": \"true\",\n",
      "          \"yarn.resourcemanager.admin.address\": \"%HOSTGROUP::master_2%:8141\",\n",
      "          \"yarn.resourcemanager.store.class\": \"org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore\",\n",
      "          \"yarn.timeline-service.address\": \"%HOSTGROUP::master_2%:10200\",\n",
      "          \"yarn.resourcemanager.webapp.address\": \"%HOSTGROUP::master_2%:8088\",\n",
      "          \"hadoop.registry.zk.quorum\": \"%HOSTGROUP::master_3%:2181,%HOSTGROUP::master_2%:2181,%HOSTGROUP::master_1%:2181\",\n",
      "          \"yarn.log.server.url\": \"http://%HOSTGROUP::master_2%:19888/jobhistory/logs\",\n",
      "          \"yarn.timeline-service.webapp.address\": \"%HOSTGROUP::master_2%:8188\",\n",
      "          \"yarn.timeline-service.webapp.https.address\": \"%HOSTGROUP::master_2%:8190\",\n",
      "          \"yarn.resourcemanager.resource-tracker.address\": \"%HOSTGROUP::master_2%:8025\",\n",
      "          \"hadoop.registry.rm.enabled\": \"false\",\n",
      "          \"yarn.resourcemanager.ha.automatic-failover.zk-base-path\": \"/yarn-leader-election\",\n",
      "          \"yarn.resourcemanager.hostname\": \"%HOSTGROUP::master_2%\",\n",
      "          \"yarn.resourcemanager.address\": \"%HOSTGROUP::master_2%:8050\",\n",
      "          \"yarn.resourcemanager.ha.rm-ids\": \"rm1,rm2\",\n",
      "          \"yarn.resourcemanager.recovery.enabled\": \"true\",\n",
      "          \"yarn.resourcemanager.scheduler.address\": \"%HOSTGROUP::master_2%:8030\"\n",
      "        }\n",
      "      }\n",
      "    }\n",
      "  ]\n",
      "}\n"
     ]
    }
   ],
   "source": [
    "blueprint = json.loads(open('blueprints/blueprint-config-example.json').read())\n",
    "#blueprint = json.loads(open('blueprints/blueprint-hdfs-ha.json').read())\n",
    "#blueprint = json.loads(open('blueprints/blueprint-yarn-ha.json').read())\n",
    "#blueprint = json.loads(open('blueprints/hdp-all.json').read())\n",
    "print(json.dumps(blueprint, indent=2))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 570,
   "metadata": {
    "collapsed": true,
    "scrolled": true,
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [],
   "source": [
    "host_groups = {}\n",
    "for group in blueprint['host_groups']:\n",
    "    host_group = group['name']\n",
    "    components = []\n",
    "    for component in group['components']:\n",
    "        components.append(component['name'])\n",
    "    host_groups[host_group] = components"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Host Groups & Components"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 571,
   "metadata": {
    "collapsed": false,
    "scrolled": false,
    "slideshow": {
     "slide_type": "fragment"
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\">\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>gateway</th>\n",
       "      <th>master_1</th>\n",
       "      <th>master_2</th>\n",
       "      <th>master_3</th>\n",
       "      <th>slave_archive</th>\n",
       "      <th>slave_standard</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>HDFS_CLIENT</td>\n",
       "      <td>HISTORYSERVER</td>\n",
       "      <td>APP_TIMELINE_SERVER</td>\n",
       "      <td>JOURNALNODE</td>\n",
       "      <td>DATANODE</td>\n",
       "      <td>DATANODE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>MAPREDUCE2_CLIENT</td>\n",
       "      <td>JOURNALNODE</td>\n",
       "      <td>JOURNALNODE</td>\n",
       "      <td>METRICS_MONITOR</td>\n",
       "      <td>METRICS_MONITOR</td>\n",
       "      <td>METRICS_MONITOR</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>METRICS_COLLECTOR</td>\n",
       "      <td>METRICS_MONITOR</td>\n",
       "      <td>METRICS_MONITOR</td>\n",
       "      <td>NAMENODE</td>\n",
       "      <td>NODEMANAGER</td>\n",
       "      <td>NODEMANAGER</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>METRICS_MONITOR</td>\n",
       "      <td>NAMENODE</td>\n",
       "      <td>RESOURCEMANAGER</td>\n",
       "      <td>RESOURCEMANAGER</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>OOZIE_CLIENT</td>\n",
       "      <td>OOZIE_SERVER</td>\n",
       "      <td>ZOOKEEPER_SERVER</td>\n",
       "      <td>ZKFC</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>TEZ_CLIENT</td>\n",
       "      <td>ZKFC</td>\n",
       "      <td>None</td>\n",
       "      <td>ZOOKEEPER_SERVER</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>YARN_CLIENT</td>\n",
       "      <td>ZOOKEEPER_SERVER</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>ZOOKEEPER_CLIENT</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "             gateway          master_1             master_2          master_3  \\\n",
       "0        HDFS_CLIENT     HISTORYSERVER  APP_TIMELINE_SERVER       JOURNALNODE   \n",
       "1  MAPREDUCE2_CLIENT       JOURNALNODE          JOURNALNODE   METRICS_MONITOR   \n",
       "2  METRICS_COLLECTOR   METRICS_MONITOR      METRICS_MONITOR          NAMENODE   \n",
       "3    METRICS_MONITOR          NAMENODE      RESOURCEMANAGER   RESOURCEMANAGER   \n",
       "4       OOZIE_CLIENT      OOZIE_SERVER     ZOOKEEPER_SERVER              ZKFC   \n",
       "5         TEZ_CLIENT              ZKFC                 None  ZOOKEEPER_SERVER   \n",
       "6        YARN_CLIENT  ZOOKEEPER_SERVER                 None              None   \n",
       "7   ZOOKEEPER_CLIENT              None                 None              None   \n",
       "\n",
       "     slave_archive   slave_standard  \n",
       "0         DATANODE         DATANODE  \n",
       "1  METRICS_MONITOR  METRICS_MONITOR  \n",
       "2      NODEMANAGER      NODEMANAGER  \n",
       "3             None             None  \n",
       "4             None             None  \n",
       "5             None             None  \n",
       "6             None             None  \n",
       "7             None             None  "
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "display(pd.DataFrame.from_dict(OrderedDict(sorted(host_groups.items())), orient='index').T.sort())"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Upload Blueprint\n",
    "\n",
    "POST /api/v1/blueprints/blueprintname"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 549,
   "metadata": {
    "collapsed": false,
    "scrolled": false,
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "201\n"
     ]
    }
   ],
   "source": [
    "## Upload the Blueprint\n",
    "\n",
    "body = blueprint\n",
    "r = s.post(api_url + '/api/v1/blueprints/testblueprint', data=json.dumps(body))\n",
    "print(r.status_code) # should return 201\n",
    "#print(json.dumps(r.json(), indent=2))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false,
    "scrolled": true,
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [],
   "source": [
    "r = s.get(api_url + '/api/v1/blueprints/testblueprint')\n",
    "print(json.dumps(r.json(), indent=2))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Cluster Description"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "source": [
    "### Setup Oozie database\n",
    "On Ambari Server:\n",
    "\n",
    "```bash\n",
    "echo \"host all all 172.24.0.0/16 trust\" >> /var/lib/pgsql/data/pg_hba.conf\n",
    "/etc/init.d/postgresql restart\n",
    "sudo -u postgres psql\n",
    "\n",
    "CREATE DATABASE oozie;\n",
    "CREATE USER oozie WITH PASSWORD 'changethis';\n",
    "GRANT ALL PRIVILEGES ON DATABASE oozie TO oozie;\n",
    "```"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 561,
   "metadata": {
    "collapsed": false,
    "scrolled": false,
    "slideshow": {
     "slide_type": "fragment"
    }
   },
   "outputs": [],
   "source": [
    "cluster = {\n",
    "  \"blueprint\": \"testblueprint\",\n",
    "  \"configurations\": [\n",
    "    { \"oozie-site\": {\n",
    "          \"oozie.db.schema.name\" : \"oozie\",\n",
    "          \"oozie.service.JPAService.create.db.schema\" : \"true\",\n",
    "          \"oozie.service.JPAService.jdbc.driver\" : \"org.postgresql.Driver\",\n",
    "          \"oozie.service.JPAService.jdbc.username\" : \"oozie\",\n",
    "          \"oozie.service.JPAService.jdbc.password\" : \"changethis\",\n",
    "          \"oozie.service.JPAService.jdbc.url\" : \"jdbc:postgresql://sroberts-bp02.cloud.hortonworks.com:5432/oozie?createDatabaseIfNotExist=true\"\n",
    "    }},\n",
    "    { \"yarn-site\" : {\n",
    "          \"yarn.resourcemanager.hostname.rm1\": \"sroberts-bp04.cloud.hortonworks.com\",\n",
    "          \"yarn.resourcemanager.hostname.rm2\": \"sroberts-bp05.cloud.hortonworks.com\"\n",
    "    }}          \n",
    "  ],\n",
    "  \"default_password\": \"changethis\",\n",
    "  \"host_groups\": [\n",
    "    { \"hosts\": [\n",
    "        { \"fqdn\": \"sroberts-bp02.cloud.hortonworks.com\" }\n",
    "      ], \"name\": \"gateway\"\n",
    "    },\n",
    "    { \"hosts\": [\n",
    "        { \"fqdn\": \"sroberts-bp03.cloud.hortonworks.com\" }\n",
    "      ], \"name\": \"master_1\"\n",
    "    },\n",
    "    { \"hosts\": [\n",
    "        { \"fqdn\": \"sroberts-bp04.cloud.hortonworks.com\" }\n",
    "      ], \"name\": \"master_2\"\n",
    "    },\n",
    "    { \"hosts\": [\n",
    "        { \"fqdn\": \"sroberts-bp05.cloud.hortonworks.com\" }\n",
    "      ], \"name\": \"master_3\"\n",
    "    },\n",
    "    { \"configurations\": [\n",
    "       { \"yarn-site\": {\n",
    "         \"yarn.nodemanager.local-dirs\": \"/mnt/hdfs0/yarn/local,/mnt/hdfs1/yarn/local,/mnt/hdfs2/yarn/local\",\n",
    "         \"yarn.nodemanager.log-dirs\": \"/mnt/hdfs0/yarn/log,/mnt/hdfs1/yarn/log,/mnt/hdfs2/yarn/log\"\n",
    "        }\n",
    "       },{ \"hdfs-site\": { \"dfs.datanode.data.dir\": \"/mnt/hdfs0/data,/mnt/hdfs1/data,/mnt/hdfs2/data\"}}\n",
    "      ],\n",
    "      \"hosts\": [\n",
    "        { \"fqdn\": \"sroberts-bp06.cloud.hortonworks.com\" }\n",
    "      ],\n",
    "      \"name\": \"slave_standard\"     \n",
    "    },\n",
    "    { \"hosts\": [\n",
    "        { \"fqdn\": \"sroberts-bp07.cloud.hortonworks.com\" },\n",
    "        { \"fqdn\": \"sroberts-bp08.cloud.hortonworks.com\" }\n",
    "      ], \"name\": \"slave_archive\"\n",
    "    }\n",
    "  ]\n",
    "}"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 551,
   "metadata": {
    "collapsed": false,
    "scrolled": false,
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "202\n",
      "{\n",
      "  \"href\": \"http://sroberts-bp02.cloud.hortonworks.com:8080/api/v1/clusters/mycluster/requests/1\",\n",
      "  \"Requests\": {\n",
      "    \"id\": 1,\n",
      "    \"status\": \"InProgress\"\n",
      "  }\n",
      "}\n"
     ]
    }
   ],
   "source": [
    "body = cluster\n",
    "r = s.post(api_url + '/api/v1/clusters/mycluster', data=json.dumps(body))\n",
    "print(r.status_code) ## Should return 202\n",
    "print(json.dumps(r.json(), indent=2))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 500,
   "metadata": {
    "collapsed": false,
    "scrolled": false,
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{\n",
      "  \"type\": \"INTERNAL_REQUEST\",\n",
      "  \"request_status\": \"IN_PROGRESS\",\n",
      "  \"request_context\": \"Install and start all services\",\n",
      "  \"create_time\": 1430343177885,\n",
      "  \"cluster_name\": \"mycluster\",\n",
      "  \"completed_task_count\": 0,\n",
      "  \"queued_task_count\": 34,\n",
      "  \"inputs\": null,\n",
      "  \"timed_out_task_count\": 0,\n",
      "  \"end_time\": -1,\n",
      "  \"operation_level\": null,\n",
      "  \"aborted_task_count\": 0,\n",
      "  \"failed_task_count\": 0,\n",
      "  \"request_schedule\": null,\n",
      "  \"resource_filters\": [],\n",
      "  \"task_count\": 74,\n",
      "  \"progress_percent\": 5.5540540540540535,\n",
      "  \"id\": 1,\n",
      "  \"exclusive\": false,\n",
      "  \"start_time\": 1430343178728\n",
      "}\n"
     ]
    }
   ],
   "source": [
    "r = s.get(api_url + '/api/v1/clusters/mycluster/requests/1')\n",
    "print(json.dumps(r.json()['Requests'], indent=2))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Export Blueprint\n",
    "\n",
    "/api/v1/blueprints\n",
    "\n",
    "/api/v1/clusters/clustername?format=blueprint"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Field Notes: How to ...\n",
    "\n",
    "* Separate log locations\n",
    "* HA\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Field Notes: Separate Databases\n",
    "    \n",
    "Example: PostgreSQL for Oozie\n",
    "\n",
    "1. Prepare the database (see below)\n",
    "2. Add appropriate configuration to Blueprint or Cluster template\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true,
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Field Notes: Blueprint Schema Changes from 1.7 to 2.0\n",
    "\n",
    "Ambari Metrics replaces Ganglia & Nagios\n",
    "\n",
    "| 1.7                          | 2.0               |\n",
    "|------------------------------|-------------------|\n",
    "| NAGIOS_SERVER GANGLIA SERVER | METRICS_COLLECTOR |\n",
    "| GANGLIA_MONITOR              | METRICS_MONITOR   |\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Field Notes: HDFS dirs\n",
    "\n",
    "- Blueprints will not detect your mount points.\n",
    "- It will use the default path (/hadoop/...) unless set.\n",
    "- Add to your Blueprint or Cluster template.\n",
    "- They can be added globally or different for each host-group.\n",
    "\n",
    "```json\n",
    "{ \"hdfs-site\": { \"dfs.datanode.data.dir\": \"/mnt/hdfs0/data,/mnt/hdfs1/data,/mnt/hdfs2/data\"}}\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Field Notes: Timeouts\n",
    "\n",
    "Raise the limits if running with limited networking or on slow hardware\n",
    "\n",
    "```\n",
    "# grep agent.*timeout /etc/ambari-server/conf/ambari.properties\n",
    "agent.package.install.task.timeout=1800\n",
    "agent.task.timeout=900\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Consideration: Local Repositories\n",
    "\n",
    "/api/v1/stacks/HDP/versions/2.2/operating_systems/"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "notes"
    }
   },
   "source": [
    "```\n",
    "for repo in HDP-2.2 HDP-UTILS-1.1.0.20; do\n",
    "    curl -sSu admin http://${ambari_server}:8080/api/v1/stacks/HDP/versions/2.2/operating_systems/redhat6/repositories/${repo} -o /tmp/update-repo.txt\n",
    "    sed -ir -e 's/\\(public\\|private\\)-repo-1.hortonworks.com/repo.cloud.hortonworks.com/g' -e '/^  \"href\"/d' /tmp/update-repo.txt\n",
    "    curl -sSu admin -H x-requested-by:sean http://${ambari_server}:8080/api/v1/stacks/HDP/versions/2.2/operating_systems/redhat6/repositories/${repo} -T /tmp/update-repo.txt\n",
    "done\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Field Notes: Stack Advisor does not run on Blueprints!"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "fragment"
    }
   },
   "source": [
    "But this undocumented API helps: `/api/v1/stacks/HDP/versions/2.2/recommendations`"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 565,
   "metadata": {
    "collapsed": false,
    "scrolled": true,
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{\n",
      "  \"resources\": [\n",
      "    {\n",
      "      \"services\": [\n",
      "        \"KAFKA\",\n",
      "        \"PIG\",\n",
      "        \"SPARK\",\n",
      "        \"MAPREDUCE2\",\n",
      "        \"YARN\",\n",
      "        \"FALCON\",\n",
      "        \"SLIDER\",\n",
      "        \"HIVE\",\n",
      "        \"TEZ\",\n",
      "        \"ZOOKEEPER\",\n",
      "        \"STORM\",\n",
      "        \"SQOOP\",\n",
      "        \"HBASE\",\n",
      "        \"OOZIE\",\n",
      "        \"FLUME\",\n",
      "        \"KNOX\",\n",
      "        \"HDFS\",\n",
      "        \"AMBARI_METRICS\"\n",
      "      ],\n",
      "      \"recommendations\": {\n",
      "        \"blueprint\": {\n",
      "          \"configurations\": null,\n",
      "          \"host_groups\": [\n",
      "            {\n",
      "              \"components\": [\n",
      "                {\n",
      "                  \"name\": \"NODEMANAGER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"APP_TIMELINE_SERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"DRPC_SERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"NIMBUS\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"RESOURCEMANAGER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"DATANODE\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"FLUME_HANDLER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"SUPERVISOR\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"STORM_UI_SERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"HBASE_REGIONSERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"HISTORYSERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"ZOOKEEPER_SERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"JOURNALNODE\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"ZKFC\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"SECONDARY_NAMENODE\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"METRICS_MONITOR\"\n",
      "                }\n",
      "              ],\n",
      "              \"name\": \"host-group-6\"\n",
      "            },\n",
      "            {\n",
      "              \"components\": [\n",
      "                {\n",
      "                  \"name\": \"NODEMANAGER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"HDFS_CLIENT\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"HIVE_CLIENT\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"SLIDER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"DATANODE\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"FLUME_HANDLER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"SUPERVISOR\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"NAMENODE\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"HBASE_CLIENT\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"HBASE_REGIONSERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"OOZIE_CLIENT\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"KAFKA_BROKER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"PIG\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"ZKFC\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"SPARK_CLIENT\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"METRICS_MONITOR\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"SPARK_JOBHISTORYSERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"KNOX_GATEWAY\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"HCAT\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"YARN_CLIENT\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"SQOOP\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"MYSQL_SERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"MAPREDUCE2_CLIENT\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"ZOOKEEPER_CLIENT\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"ZOOKEEPER_SERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"JOURNALNODE\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"TEZ_CLIENT\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"FALCON_CLIENT\"\n",
      "                }\n",
      "              ],\n",
      "              \"name\": \"host-group-1\"\n",
      "            },\n",
      "            {\n",
      "              \"components\": [\n",
      "                {\n",
      "                  \"name\": \"NODEMANAGER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"HIVE_METASTORE\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"WEBHCAT_SERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"DATANODE\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"FLUME_HANDLER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"METRICS_COLLECTOR\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"FALCON_SERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"SUPERVISOR\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"OOZIE_SERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"HIVE_SERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"HBASE_MASTER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"HBASE_REGIONSERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"ZOOKEEPER_SERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"JOURNALNODE\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"ZKFC\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"METRICS_MONITOR\"\n",
      "                }\n",
      "              ],\n",
      "              \"name\": \"host-group-7\"\n",
      "            },\n",
      "            {\n",
      "              \"components\": [\n",
      "                {\n",
      "                  \"name\": \"NODEMANAGER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"SUPERVISOR\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"HBASE_REGIONSERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"JOURNALNODE\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"ZKFC\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"DATANODE\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"FLUME_HANDLER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"METRICS_MONITOR\"\n",
      "                }\n",
      "              ],\n",
      "              \"name\": \"host-group-5\"\n",
      "            },\n",
      "            {\n",
      "              \"components\": [\n",
      "                {\n",
      "                  \"name\": \"NODEMANAGER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"SUPERVISOR\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"HBASE_REGIONSERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"JOURNALNODE\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"ZKFC\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"DATANODE\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"FLUME_HANDLER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"METRICS_MONITOR\"\n",
      "                }\n",
      "              ],\n",
      "              \"name\": \"host-group-4\"\n",
      "            },\n",
      "            {\n",
      "              \"components\": [\n",
      "                {\n",
      "                  \"name\": \"NODEMANAGER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"SUPERVISOR\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"HBASE_REGIONSERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"JOURNALNODE\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"ZKFC\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"DATANODE\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"FLUME_HANDLER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"METRICS_MONITOR\"\n",
      "                }\n",
      "              ],\n",
      "              \"name\": \"host-group-3\"\n",
      "            },\n",
      "            {\n",
      "              \"components\": [\n",
      "                {\n",
      "                  \"name\": \"NODEMANAGER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"SUPERVISOR\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"HBASE_REGIONSERVER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"JOURNALNODE\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"ZKFC\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"DATANODE\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"FLUME_HANDLER\"\n",
      "                },\n",
      "                {\n",
      "                  \"name\": \"METRICS_MONITOR\"\n",
      "                }\n",
      "              ],\n",
      "              \"name\": \"host-group-2\"\n",
      "            }\n",
      "          ]\n",
      "        },\n",
      "        \"blueprint_cluster_binding\": {\n",
      "          \"host_groups\": [\n",
      "            {\n",
      "              \"name\": \"host-group-1\",\n",
      "              \"hosts\": [\n",
      "                {\n",
      "                  \"fqdn\": \"sroberts-bp02.cloud.hortonworks.com\"\n",
      "                }\n",
      "              ]\n",
      "            },\n",
      "            {\n",
      "              \"name\": \"host-group-3\",\n",
      "              \"hosts\": [\n",
      "                {\n",
      "                  \"fqdn\": \"sroberts-bp05.cloud.hortonworks.com\"\n",
      "                }\n",
      "              ]\n",
      "            },\n",
      "            {\n",
      "              \"name\": \"host-group-5\",\n",
      "              \"hosts\": [\n",
      "                {\n",
      "                  \"fqdn\": \"sroberts-bp07.cloud.hortonworks.com\"\n",
      "                }\n",
      "              ]\n",
      "            },\n",
      "            {\n",
      "              \"name\": \"host-group-7\",\n",
      "              \"hosts\": [\n",
      "                {\n",
      "                  \"fqdn\": \"sroberts-bp04.cloud.hortonworks.com\"\n",
      "                }\n",
      "              ]\n",
      "            },\n",
      "            {\n",
      "              \"name\": \"host-group-6\",\n",
      "              \"hosts\": [\n",
      "                {\n",
      "                  \"fqdn\": \"sroberts-bp03.cloud.hortonworks.com\"\n",
      "                }\n",
      "              ]\n",
      "            },\n",
      "            {\n",
      "              \"name\": \"host-group-4\",\n",
      "              \"hosts\": [\n",
      "                {\n",
      "                  \"fqdn\": \"sroberts-bp06.cloud.hortonworks.com\"\n",
      "                }\n",
      "              ]\n",
      "            },\n",
      "            {\n",
      "              \"name\": \"host-group-2\",\n",
      "              \"hosts\": [\n",
      "                {\n",
      "                  \"fqdn\": \"sroberts-bp08.cloud.hortonworks.com\"\n",
      "                }\n",
      "              ]\n",
      "            }\n",
      "          ]\n",
      "        }\n",
      "      },\n",
      "      \"hosts\": [\n",
      "        \"sroberts-bp08.cloud.hortonworks.com\",\n",
      "        \"sroberts-bp02.cloud.hortonworks.com\",\n",
      "        \"sroberts-bp04.cloud.hortonworks.com\",\n",
      "        \"sroberts-bp03.cloud.hortonworks.com\",\n",
      "        \"sroberts-bp07.cloud.hortonworks.com\",\n",
      "        \"sroberts-bp06.cloud.hortonworks.com\",\n",
      "        \"sroberts-bp05.cloud.hortonworks.com\"\n",
      "      ],\n",
      "      \"href\": \"http://sroberts-bp02.cloud.hortonworks.com:8080/api/v1/stacks/HDP/versions/2.2/recommendations/8\",\n",
      "      \"Recommendation\": {\n",
      "        \"id\": 8\n",
      "      },\n",
      "      \"Versions\": {\n",
      "        \"stack_name\": \"HDP\",\n",
      "        \"stack_version\": \"2.2\"\n",
      "      }\n",
      "    }\n",
      "  ]\n",
      "}\n"
     ]
    }
   ],
   "source": [
    "body = {\n",
    "      \"recommend\" : \"host_groups\",\n",
    "      \"services\" : [ \"AMBARI_METRICS\",\"FALCON\",\"FLUME\",\"HBASE\",\"HDFS\",\"HIVE\",\"KAFKA\",\"KNOX\",\"MAPREDUCE2\",\"OOZIE\",\"PIG\",\"SLIDER\",\"SPARK\",\"SQOOP\",\"STORM\",\"TEZ\",\"YARN\",\"ZOOKEEPER\" ],\n",
    "      \"hosts\" : [ \"sroberts-bp02.cloud.hortonworks.com\",\"sroberts-bp03.cloud.hortonworks.com\",\"sroberts-bp04.cloud.hortonworks.com\",\"sroberts-bp05.cloud.hortonworks.com\",\"sroberts-bp06.cloud.hortonworks.com\",\"sroberts-bp07.cloud.hortonworks.com\",\"sroberts-bp08.cloud.hortonworks.com\" ]\n",
    "}\n",
    "\n",
    "r = s.post(api_url + '/api/v1/stacks/HDP/versions/2.2/recommendations', data=json.dumps(body))\n",
    "print(json.dumps(r.json(), indent=2))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 566,
   "metadata": {
    "collapsed": false,
    "scrolled": true,
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{\n",
      "  \"resources\": [\n",
      "    {\n",
      "      \"services\": [\n",
      "        \"KAFKA\",\n",
      "        \"PIG\",\n",
      "        \"SPARK\",\n",
      "        \"MAPREDUCE2\",\n",
      "        \"YARN\",\n",
      "        \"FALCON\",\n",
      "        \"SLIDER\",\n",
      "        \"HIVE\",\n",
      "        \"TEZ\",\n",
      "        \"ZOOKEEPER\",\n",
      "        \"STORM\",\n",
      "        \"SQOOP\",\n",
      "        \"HBASE\",\n",
      "        \"OOZIE\",\n",
      "        \"FLUME\",\n",
      "        \"KNOX\",\n",
      "        \"HDFS\",\n",
      "        \"AMBARI_METRICS\"\n",
      "      ],\n",
      "      \"recommendations\": {\n",
      "        \"blueprint\": {\n",
      "          \"host_groups\": [],\n",
      "          \"configurations\": {\n",
      "            \"hadoop-env\": {\n",
      "              \"properties\": {\n",
      "                \"namenode_opt_maxnewsize\": \"512\",\n",
      "                \"namenode_opt_newsize\": \"512\",\n",
      "                \"namenode_heapsize\": \"2048\"\n",
      "              }\n",
      "            },\n",
      "            \"hbase-site\": {\n",
      "              \"properties\": {\n",
      "                \"hbase.regionserver.global.memstore.upperLimit\": \"0.4\"\n",
      "              }\n",
      "            },\n",
      "            \"hbase-env\": {\n",
      "              \"properties\": {\n",
      "                \"hbase_master_heapsize\": \"1024\",\n",
      "                \"hbase_regionserver_heapsize\": \"1024\"\n",
      "              }\n",
      "            },\n",
      "            \"ams-hbase-env\": {\n",
      "              \"properties\": {\n",
      "                \"hbase_master_heapsize\": \"1024m\",\n",
      "                \"hbase_regionserver_heapsize\": \"1024m\",\n",
      "                \"hbase_master_xmn_size\": \"128m\"\n",
      "              }\n",
      "            },\n",
      "            \"ams-site\": {\n",
      "              \"properties\": {\n",
      "                \"timeline.metrics.host.aggregator.ttl\": \"86400\"\n",
      "              }\n",
      "            },\n",
      "            \"hive-site\": {\n",
      "              \"properties\": {\n",
      "                \"hive.tez.java.opts\": \"-server -Xmx820m -Djava.net.preferIPv4Stack=true -XX:NewRatio=8 -XX:+UseNUMA -XX:+UseParallelGC -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps\",\n",
      "                \"hive.auto.convert.join.noconditionaltask.size\": \"357564416\",\n",
      "                \"hive.tez.container.size\": \"1024\"\n",
      "              }\n",
      "            },\n",
      "            \"yarn-env\": {\n",
      "              \"properties\": {\n",
      "                \"min_user_id\": \"500\"\n",
      "              }\n",
      "            },\n",
      "            \"hdfs-site\": {\n",
      "              \"properties\": {\n",
      "                \"dfs.datanode.max.transfer.threads\": \"16384\"\n",
      "              }\n",
      "            },\n",
      "            \"mapred-site\": {\n",
      "              \"properties\": {\n",
      "                \"mapreduce.map.java.opts\": \"-Xmx819m\",\n",
      "                \"yarn.app.mapreduce.am.command-opts\": \"-Xmx819m -Dhdp.version=${hdp.version}\",\n",
      "                \"yarn.app.mapreduce.am.resource.mb\": \"1024\",\n",
      "                \"mapreduce.reduce.memory.mb\": \"1024\",\n",
      "                \"mapreduce.task.io.sort.mb\": \"410\",\n",
      "                \"mapreduce.map.memory.mb\": \"1024\",\n",
      "                \"mapreduce.reduce.java.opts\": \"-Xmx819m\"\n",
      "              }\n",
      "            },\n",
      "            \"ams-hbase-site\": {\n",
      "              \"properties\": {\n",
      "                \"hfile.block.cache.size\": \"0.3\",\n",
      "                \"hbase.regionserver.global.memstore.lowerLimit\": \"0.3\",\n",
      "                \"hbase.regionserver.global.memstore.upperLimit\": \"0.35\"\n",
      "              }\n",
      "            },\n",
      "            \"tez-site\": {\n",
      "              \"properties\": {\n",
      "                \"tez.runtime.io.sort.mb\": \"409\",\n",
      "                \"tez.task.resource.memory.mb\": \"1024\",\n",
      "                \"tez.runtime.unordered.output.buffer.size-mb\": \"76\",\n",
      "                \"tez.am.resource.memory.mb\": \"2048\"\n",
      "              }\n",
      "            },\n",
      "            \"ams-env\": {\n",
      "              \"properties\": {\n",
      "                \"metrics_collector_heapsize\": \"512m\"\n",
      "              }\n",
      "            },\n",
      "            \"oozie-site\": {\n",
      "              \"properties\": {\n",
      "                \"oozie.services.ext\": \"org.apache.oozie.service.JMSAccessorService,org.apache.oozie.service.PartitionDependencyManagerService,org.apache.oozie.service.HCatAccessorService\"\n",
      "              }\n",
      "            },\n",
      "            \"yarn-site\": {\n",
      "              \"properties\": {\n",
      "                \"yarn.nodemanager.resource.cpu-vcores\": \"2\",\n",
      "                \"yarn.nodemanager.resource.memory-mb\": \"4096\",\n",
      "                \"yarn.scheduler.maximum-allocation-mb\": \"4096\",\n",
      "                \"yarn.scheduler.minimum-allocation-mb\": \"1024\"\n",
      "              }\n",
      "            }\n",
      "          }\n",
      "        },\n",
      "        \"blueprint_cluster_binding\": {\n",
      "          \"host_groups\": []\n",
      "        }\n",
      "      },\n",
      "      \"hosts\": [\n",
      "        \"sroberts-bp08.cloud.hortonworks.com\",\n",
      "        \"sroberts-bp02.cloud.hortonworks.com\",\n",
      "        \"sroberts-bp04.cloud.hortonworks.com\",\n",
      "        \"sroberts-bp03.cloud.hortonworks.com\",\n",
      "        \"sroberts-bp07.cloud.hortonworks.com\",\n",
      "        \"sroberts-bp06.cloud.hortonworks.com\",\n",
      "        \"sroberts-bp05.cloud.hortonworks.com\"\n",
      "      ],\n",
      "      \"href\": \"http://sroberts-bp02.cloud.hortonworks.com:8080/api/v1/stacks/HDP/versions/2.2/recommendations/9\",\n",
      "      \"Recommendation\": {\n",
      "        \"id\": 9\n",
      "      },\n",
      "      \"Versions\": {\n",
      "        \"stack_name\": \"HDP\",\n",
      "        \"stack_version\": \"2.2\"\n",
      "      }\n",
      "    }\n",
      "  ]\n",
      "}\n"
     ]
    }
   ],
   "source": [
    "body = {\n",
    "      \"recommend\" : \"configurations\",\n",
    "      \"services\" : [ \"AMBARI_METRICS\",\"FALCON\",\"FLUME\",\"HBASE\",\"HDFS\",\"HIVE\",\"KAFKA\",\"KNOX\",\"MAPREDUCE2\",\"OOZIE\",\"PIG\",\"SLIDER\",\"SPARK\",\"SQOOP\",\"STORM\",\"TEZ\",\"YARN\",\"ZOOKEEPER\" ],\n",
    "      \"hosts\" : [ \"sroberts-bp02.cloud.hortonworks.com\",\"sroberts-bp03.cloud.hortonworks.com\",\"sroberts-bp04.cloud.hortonworks.com\",\"sroberts-bp05.cloud.hortonworks.com\",\"sroberts-bp06.cloud.hortonworks.com\",\"sroberts-bp07.cloud.hortonworks.com\",\"sroberts-bp08.cloud.hortonworks.com\" ]\n",
    "}\n",
    "\n",
    "r = s.post(api_url + '/api/v1/stacks/HDP/versions/2.2/recommendations', data=json.dumps(body))\n",
    "print(json.dumps(r.json(), indent=2))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Blueprint Generator\n",
    "\n",
    "https://github.com/seanorama/ambari-bootstrap/tree/master/deploy"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "# The End\n",
    "\n",
    "![Field Notes](https://41.media.tumblr.com/tumblr_mc5ujlmOPE1r1dqs8o1_500.jpg)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "### Field Notes from Aaron Wiebe\n",
    "\n",
    "* We pre-deployed and configured ambari agents on each node.  This allowed us to perform the installation without automated ssh/root permissions being given to Ambari.\n",
    "* Registration was done in batches of maximum 400 nodes.  Doing more than this crushed the internal yum repository during installation and caused timeouts and installation failures.\n",
    "* Local repos were used\n",
    "* Client threads on the ambari server needed to be turned up to handle the high number of agents\n",
    "* AMS is slick, but requires it’s own server.  HBase backed in distributed mode against HDFS.\n",
    "* Ambari server database needed its own server and the key cache of the mysql database was turned up to 24G and threads increased.\n",
    "* Ambari server heap was increased to 12G.\n",
    "* We’re looking at SSDs for Ambari servers and databases in the future."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true,
    "scrolled": true,
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "celltoolbar": "Slideshow",
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.4.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}