part_1_mars_news.ipynb

{
 "cells": [
  {
   "attachments": {},
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Module 11 Challenge\n",
    "## Deliverable 1: Scrape Titles and Preview Text from Mars News"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Import Splinter and BeautifulSoup\n",
    "from splinter import Browser\n",
    "from bs4 import BeautifulSoup"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "browser = Browser('chrome')"
   ]
  },
  {
   "attachments": {},
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Step 1: Visit the Website\n",
    "\n",
    "1. Use automated browsing to visit the [Mars news site](https://static.bc-edx.com/data/web/mars_news/index.html). Inspect the page to identify which elements to scrape.\n",
    "\n",
    "      > **Hint** To identify which elements to scrape, you might want to inspect the page by using Chrome DevTools."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Visit the Mars news site\n",
    "url = 'https://static.bc-edx.com/data/web/mars_news/index.html'\n",
    "browser.visit(url)"
   ]
  },
  {
   "attachments": {},
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Step 2: Scrape the Website\n",
    "\n",
    "Create a Beautiful Soup object and use it to extract text elements from the website."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<html>\n",
      " <head>\n",
      "  <meta charset=\"utf-8\"/>\n",
      "  <meta content=\"width=device-width, initial-scale=1\" name=\"viewport\"/>\n",
      "  <link href=\"css/bootstrap.min.5.2.2.css\" rel=\"stylesheet\" type=\"text/css\"/>\n",
      "  <link href=\"css/font.css\" rel=\"stylesheet\" type=\"text/css\"/>\n",
      "  <link href=\"css/app.css\" rel=\"stylesheet\" type=\"text/css\"/>\n",
      "  <title>\n",
      "   News - Mars Exploration Program\n",
      "  </title>\n",
      " </head>\n",
      " <body>\n",
      "  <div class=\"col-md-12\">\n",
      "   <div class=\"row\">\n",
      "    <nav class=\"navbar navbar-expand-lg navbar-light fixed-top\">\n",
      "     <div class=\"container-fluid\">\n",
      "      <a class=\"navbar-brand\" href=\"#\">\n",
      "       <img src=\"images/logo.png\" width=\"80\"/>\n",
      "       <span class=\"logo\">\n",
      "        MARS Planet Science\n",
      "       </span>\n",
      "       <span class=\"logo1\">\n",
      "        Exploration Program\n",
      "       </span>\n",
      "      </a>\n",
      "      <button aria-controls=\"navbarNav\" aria-expanded=\"false\" aria-label=\"Toggle navigation\" class=\"navbar-toggler\" data-bs-target=\"#navbarNav\" data-bs-toggle=\"collapse\" type=\"button\">\n",
      "       <span class=\"navbar-toggler-icon\">\n",
      "       </span>\n",
      "      </button>\n",
      "      <div class=\"collapse navbar-collapse justify-content-end\" id=\"navbarNav\">\n",
      "       <ul class=\"navbar-nav\">\n",
      "        <li class=\"nav-item\">\n",
      "         <a aria-current=\"page\" class=\"nav-link active\" href=\"#\">\n",
      "          The Red Planet\n",
      "         </a>\n",
      "        </li>\n",
      "        <li class=\"nav-item\">\n",
      "         <a class=\"nav-link\" href=\"#\">\n",
      "          The Program\n",
      "         </a>\n",
      "        </li>\n",
      "        <li class=\"nav-item\">\n",
      "         <a class=\"nav-link\" href=\"#\">\n",
      "          News &amp; Events\n",
      "         </a>\n",
      "        </li>\n",
      "        <li class=\"nav-item\">\n",
      "         <a class=\"nav-link\" href=\"#\">\n",
      "          Multimedia\n",
      "         </a>\n",
      "        </li>\n",
      "        <li class=\"nav-item\">\n",
      "         <a class=\"nav-link\" href=\"#\">\n",
      "          Missions\n",
      "         </a>\n",
      "        </li>\n",
      "        <li class=\"nav-item\">\n",
      "         <a class=\"nav-link\" href=\"#\">\n",
      "          More\n",
      "         </a>\n",
      "        </li>\n",
      "        <li class=\"nav-item nav_search\">\n",
      "         <a class=\"nav-link\" href=\"#\">\n",
      "         </a>\n",
      "        </li>\n",
      "       </ul>\n",
      "      </div>\n",
      "     </div>\n",
      "    </nav>\n",
      "    <section class=\"search\">\n",
      "     <div class=\"container\">\n",
      "      <h1>\n",
      "       News\n",
      "      </h1>\n",
      "      <div class=\"col-md-12 filter\">\n",
      "       <div class=\"row\">\n",
      "        <div class=\"col-md-3 search_binder\">\n",
      "         <input class=\"search_field\" name=\"search\" type=\"text\"/>\n",
      "         <input class=\"search_submit\" name=\"search\" type=\"text\"/>\n",
      "        </div>\n",
      "        <div class=\"col-md-3\">\n",
      "         <select aria-label=\"Default select example\" class=\"form-select\" id=\"year\">\n",
      "          <option selected=\"\">\n",
      "           Latest\n",
      "          </option>\n",
      "         </select>\n",
      "        </div>\n",
      "        <div class=\"col-md-3\">\n",
      "         <select aria-label=\"Default select example\" class=\"form-select\" id=\"cat\">\n",
      "          <option selected=\"\">\n",
      "           All Categories\n",
      "          </option>\n",
      "         </select>\n",
      "        </div>\n",
      "        <div class=\"col-md-3\">\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "     </div>\n",
      "    </section>\n",
      "    <section class=\"image_and_description_container\">\n",
      "     <div class=\"container\" id=\"news\">\n",
      "      <div class=\"col-md-12\">\n",
      "       <hr/>\n",
      "       <div class=\"row\">\n",
      "        <div class=\"col-md-4\">\n",
      "         <div class=\"list_image\">\n",
      "          <img src=\"images/9299_maven-vertical-limb-320x240.jpeg\"/>\n",
      "         </div>\n",
      "        </div>\n",
      "        <div class=\"col-md-8\">\n",
      "         <div class=\"list_text\">\n",
      "          <div class=\"list_date\">\n",
      "           November 9, 2022\n",
      "          </div>\n",
      "          <div class=\"content_title\">\n",
      "           NASA's MAVEN Observes Martian Light Show Caused by Major Solar Storm\n",
      "          </div>\n",
      "          <div class=\"article_teaser_body\">\n",
      "           For the first time in its eight years orbiting Mars, NASA’s MAVEN mission witnessed two different types of ultraviolet aurorae simultaneously, the result of solar storms that began on Aug. 27.\n",
      "          </div>\n",
      "         </div>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "      <div class=\"col-md-12\">\n",
      "       <hr/>\n",
      "       <div class=\"row\">\n",
      "        <div class=\"col-md-4\">\n",
      "         <div class=\"list_image\">\n",
      "          <img src=\"images/9292_PIA25287-320x240.jpeg\"/>\n",
      "         </div>\n",
      "        </div>\n",
      "        <div class=\"col-md-8\">\n",
      "         <div class=\"list_text\">\n",
      "          <div class=\"list_date\">\n",
      "           November 1, 2022\n",
      "          </div>\n",
      "          <div class=\"content_title\">\n",
      "           NASA Prepares to Say 'Farewell' to InSight Spacecraft\n",
      "          </div>\n",
      "          <div class=\"article_teaser_body\">\n",
      "           A closer look at what goes into wrapping up the mission as the spacecraft’s power supply continues to dwindle.\n",
      "          </div>\n",
      "         </div>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "      <div class=\"col-md-12\">\n",
      "       <hr/>\n",
      "       <div class=\"row\">\n",
      "        <div class=\"col-md-4\">\n",
      "         <div class=\"list_image\">\n",
      "          <img src=\"images/9286_PIA25243-320x240.jpeg\"/>\n",
      "         </div>\n",
      "        </div>\n",
      "        <div class=\"col-md-8\">\n",
      "         <div class=\"list_text\">\n",
      "          <div class=\"list_date\">\n",
      "           October 28, 2022\n",
      "          </div>\n",
      "          <div class=\"content_title\">\n",
      "           NASA and ESA Agree on Next Steps to Return Mars Samples to Earth\n",
      "          </div>\n",
      "          <div class=\"article_teaser_body\">\n",
      "           The agency’s Perseverance rover will establish the first sample depot on Mars.\n",
      "          </div>\n",
      "         </div>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "      <div class=\"col-md-12\">\n",
      "       <hr/>\n",
      "       <div class=\"row\">\n",
      "        <div class=\"col-md-4\">\n",
      "         <div class=\"list_image\">\n",
      "          <img src=\"images/9289_1-PIA25583320x240.jpeg\"/>\n",
      "         </div>\n",
      "        </div>\n",
      "        <div class=\"col-md-8\">\n",
      "         <div class=\"list_text\">\n",
      "          <div class=\"list_date\">\n",
      "           October 27, 2022\n",
      "          </div>\n",
      "          <div class=\"content_title\">\n",
      "           NASA's InSight Lander Detects Stunning Meteoroid Impact on Mars\n",
      "          </div>\n",
      "          <div class=\"article_teaser_body\">\n",
      "           The agency’s lander felt the ground shake during the impact while cameras aboard the Mars Reconnaissance Orbiter spotted the yawning new crater from space.\n",
      "          </div>\n",
      "         </div>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "      <div class=\"col-md-12\">\n",
      "       <hr/>\n",
      "       <div class=\"row\">\n",
      "        <div class=\"col-md-4\">\n",
      "         <div class=\"list_image\">\n",
      "          <img src=\"images/9284_1-PIA25287-320x240.jpeg\"/>\n",
      "         </div>\n",
      "        </div>\n",
      "        <div class=\"col-md-8\">\n",
      "         <div class=\"list_text\">\n",
      "          <div class=\"list_date\">\n",
      "           October 21, 2022\n",
      "          </div>\n",
      "          <div class=\"content_title\">\n",
      "           NASA To Host Briefing on InSight, Mars Reconnaissance Orbiter Findings\n",
      "          </div>\n",
      "          <div class=\"article_teaser_body\">\n",
      "           Scientists from two Mars missions will discuss how they combined images and data for a major finding on the Red Planet.\n",
      "          </div>\n",
      "         </div>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "      <div class=\"col-md-12\">\n",
      "       <hr/>\n",
      "       <div class=\"row\">\n",
      "        <div class=\"col-md-4\">\n",
      "         <div class=\"list_image\">\n",
      "          <img src=\"images/9283_1-Illustration-of-SHIELD-320x240.jpeg\"/>\n",
      "         </div>\n",
      "        </div>\n",
      "        <div class=\"col-md-8\">\n",
      "         <div class=\"list_text\">\n",
      "          <div class=\"list_date\">\n",
      "           October 20, 2022\n",
      "          </div>\n",
      "          <div class=\"content_title\">\n",
      "           Why NASA Is Trying To Crash Land on Mars\n",
      "          </div>\n",
      "          <div class=\"article_teaser_body\">\n",
      "           Like a car’s crumple zone, the experimental SHIELD lander is designed to absorb a hard impact.\n",
      "          </div>\n",
      "         </div>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "      <div class=\"col-md-12\">\n",
      "       <hr/>\n",
      "       <div class=\"row\">\n",
      "        <div class=\"col-md-4\">\n",
      "         <div class=\"list_image\">\n",
      "          <img src=\"images/9281_1-PIA25413-320x240.jpeg\"/>\n",
      "         </div>\n",
      "        </div>\n",
      "        <div class=\"col-md-8\">\n",
      "         <div class=\"list_text\">\n",
      "          <div class=\"list_date\">\n",
      "           October 19, 2022\n",
      "          </div>\n",
      "          <div class=\"content_title\">\n",
      "           Curiosity Mars Rover Reaches Long-Awaited Salty Region\n",
      "          </div>\n",
      "          <div class=\"article_teaser_body\">\n",
      "           After years of climbing, the Mars rover has arrived at a special region believed to have formed as Mars’ climate was drying.\n",
      "          </div>\n",
      "         </div>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "      <div class=\"col-md-12\">\n",
      "       <hr/>\n",
      "       <div class=\"row\">\n",
      "        <div class=\"col-md-4\">\n",
      "         <div class=\"list_image\">\n",
      "          <img src=\"images/9276_PIA25337-320x240.jpeg\"/>\n",
      "         </div>\n",
      "        </div>\n",
      "        <div class=\"col-md-8\">\n",
      "         <div class=\"list_text\">\n",
      "          <div class=\"list_date\">\n",
      "           October 12, 2022\n",
      "          </div>\n",
      "          <div class=\"content_title\">\n",
      "           Mars Mission Shields Up for Tests\n",
      "          </div>\n",
      "          <div class=\"article_teaser_body\">\n",
      "           Protecting Mars Sample Return spacecraft from micrometeorites requires high-caliber work.\n",
      "          </div>\n",
      "         </div>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "      <div class=\"col-md-12\">\n",
      "       <hr/>\n",
      "       <div class=\"row\">\n",
      "        <div class=\"col-md-4\">\n",
      "         <div class=\"list_image\">\n",
      "          <img src=\"images/9275_PIA25287-clean320x240.jpeg\"/>\n",
      "         </div>\n",
      "        </div>\n",
      "        <div class=\"col-md-8\">\n",
      "         <div class=\"list_text\">\n",
      "          <div class=\"list_date\">\n",
      "           October 7, 2022\n",
      "          </div>\n",
      "          <div class=\"content_title\">\n",
      "           NASA's InSight Waits Out Dust Storm\n",
      "          </div>\n",
      "          <div class=\"article_teaser_body\">\n",
      "           InSight’s team is taking steps to help the solar-powered lander continue operating for as long as possible.\n",
      "          </div>\n",
      "         </div>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "      <div class=\"col-md-12\">\n",
      "       <hr/>\n",
      "       <div class=\"row\">\n",
      "        <div class=\"col-md-4\">\n",
      "         <div class=\"list_image\">\n",
      "          <img src=\"images/9264_1-PIA25408-320x240.jpeg\"/>\n",
      "         </div>\n",
      "        </div>\n",
      "        <div class=\"col-md-8\">\n",
      "         <div class=\"list_text\">\n",
      "          <div class=\"list_date\">\n",
      "           September 19, 2022\n",
      "          </div>\n",
      "          <div class=\"content_title\">\n",
      "           NASA's InSight 'Hears' Its First Meteoroid Impacts on Mars\n",
      "          </div>\n",
      "          <div class=\"article_teaser_body\">\n",
      "           The Mars lander’s seismometer has picked up vibrations from four separate impacts in the past two years.\n",
      "          </div>\n",
      "         </div>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "      <div class=\"col-md-12\">\n",
      "       <hr/>\n",
      "       <div class=\"row\">\n",
      "        <div class=\"col-md-4\">\n",
      "         <div class=\"list_image\">\n",
      "          <img src=\"images/9261_26987_PIA24925_MAIN-320x240.jpeg\"/>\n",
      "         </div>\n",
      "        </div>\n",
      "        <div class=\"col-md-8\">\n",
      "         <div class=\"list_text\">\n",
      "          <div class=\"list_date\">\n",
      "           September 15, 2022\n",
      "          </div>\n",
      "          <div class=\"content_title\">\n",
      "           NASA's Perseverance Rover Investigates Geologically Rich Mars Terrain\n",
      "          </div>\n",
      "          <div class=\"article_teaser_body\">\n",
      "           The latest findings provide greater detail on a region of the Red Planet that has a watery past and is yielding promising samples for the NASA-ESA Mars Sample Return campaign.\n",
      "          </div>\n",
      "         </div>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "      <div class=\"col-md-12\">\n",
      "       <hr/>\n",
      "       <div class=\"row\">\n",
      "        <div class=\"col-md-4\">\n",
      "         <div class=\"list_image\">\n",
      "          <img src=\"images/9257_PIA25325-320x240.jpeg\"/>\n",
      "         </div>\n",
      "        </div>\n",
      "        <div class=\"col-md-8\">\n",
      "         <div class=\"list_text\">\n",
      "          <div class=\"list_date\">\n",
      "           September 12, 2022\n",
      "          </div>\n",
      "          <div class=\"content_title\">\n",
      "           NASA to Host Briefing on Perseverance Mars Rover Mission Operations\n",
      "          </div>\n",
      "          <div class=\"article_teaser_body\">\n",
      "           Members of the mission will discuss the rover’s activities as it gathers samples in an ancient river delta.\n",
      "          </div>\n",
      "         </div>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "      <div class=\"col-md-12\">\n",
      "       <hr/>\n",
      "       <div class=\"row\">\n",
      "        <div class=\"col-md-4\">\n",
      "         <div class=\"list_image\">\n",
      "          <img src=\"images/9252_1-PIA24836_Perseverance_Selfie_at_Rochette-320x240.jpeg\"/>\n",
      "         </div>\n",
      "        </div>\n",
      "        <div class=\"col-md-8\">\n",
      "         <div class=\"list_text\">\n",
      "          <div class=\"list_date\">\n",
      "           August 25, 2022\n",
      "          </div>\n",
      "          <div class=\"content_title\">\n",
      "           NASA's Perseverance Makes New Discoveries in Mars' Jezero Crater\n",
      "          </div>\n",
      "          <div class=\"article_teaser_body\">\n",
      "           The rover found that Jezero Crater’s floor is made up of volcanic rocks that have interacted with water.\n",
      "          </div>\n",
      "         </div>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "      <div class=\"col-md-12\">\n",
      "       <hr/>\n",
      "       <div class=\"row\">\n",
      "        <div class=\"col-md-4\">\n",
      "         <div class=\"list_image\">\n",
      "          <img src=\"images/9240_1-PIA25407-Curiositys-360-Degree-Panorama-of-Avanaro-320x240.jpeg\"/>\n",
      "         </div>\n",
      "        </div>\n",
      "        <div class=\"col-md-8\">\n",
      "         <div class=\"list_text\">\n",
      "          <div class=\"list_date\">\n",
      "           August 5, 2022\n",
      "          </div>\n",
      "          <div class=\"content_title\">\n",
      "           10 Years Since Landing, NASA's Curiosity Mars Rover Still Has Drive\n",
      "          </div>\n",
      "          <div class=\"article_teaser_body\">\n",
      "           Despite signs of wear, the intrepid spacecraft is about to start an exciting new chapter of its mission as it climbs a Martian mountain.\n",
      "          </div>\n",
      "         </div>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "      <div class=\"col-md-12\">\n",
      "       <hr/>\n",
      "       <div class=\"row\">\n",
      "        <div class=\"col-md-4\">\n",
      "         <div class=\"list_image\">\n",
      "          <img src=\"images/9239_article_pictures2_jpeg-320x240.jpeg\"/>\n",
      "         </div>\n",
      "        </div>\n",
      "        <div class=\"col-md-8\">\n",
      "         <div class=\"list_text\">\n",
      "          <div class=\"list_date\">\n",
      "           August 4, 2022\n",
      "          </div>\n",
      "          <div class=\"content_title\">\n",
      "           SAM's Top 5 Discoveries Aboard NASA's Curiosity Rover at Mars\n",
      "          </div>\n",
      "          <div class=\"article_teaser_body\">\n",
      "           “Selfie” of the Curiosity rover with inset showing the SAM instrument prior to installation on the rover.\n",
      "          </div>\n",
      "         </div>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "     </div>\n",
      "     <hr class=\"container\" style=\"margin: 25px auto;width: 83%;\"/>\n",
      "     <button class=\"btn disable\" id=\"more\">\n",
      "      More\n",
      "     </button>\n",
      "    </section>\n",
      "    <section class=\"last_news\">\n",
      "     <div class=\"container\">\n",
      "      <div class=\"row\">\n",
      "       <div class=\"col-12\">\n",
      "        <h2>\n",
      "         You Might Also Like\n",
      "        </h2>\n",
      "       </div>\n",
      "       <div class=\"col-12\">\n",
      "        <div class=\"carousel slide\" data-ride=\"carousel\" id=\"carouselExampleIndicators2\">\n",
      "         <div class=\"carousel-inner\">\n",
      "          <div class=\"carousel-item active\">\n",
      "           <div class=\"row\">\n",
      "            <div class=\"col-md-4 mb-3\">\n",
      "             <div class=\"card\">\n",
      "              <img alt=\"100%x280\" class=\"img-fluid\" src=\"images/9232_1-PIA01551-sojourner-and-ramp-already-in-PJ-320x240.jpeg\"/>\n",
      "              <div class=\"card-body\">\n",
      "               <p class=\"card-text\">\n",
      "                NASA Marks 25 Years Since Pathfinder Touched Down on Mars\n",
      "               </p>\n",
      "              </div>\n",
      "             </div>\n",
      "            </div>\n",
      "            <div class=\"col-md-4 mb-3\">\n",
      "             <div class=\"card\">\n",
      "              <img alt=\"100%x280\" class=\"img-fluid\" src=\"images/9172_PIA25179-320x240.jpeg\"/>\n",
      "              <div class=\"card-body\">\n",
      "               <p class=\"card-text\">\n",
      "                NASA's Perseverance Rover Captures Video of Solar Eclipse on Mars\n",
      "               </p>\n",
      "              </div>\n",
      "             </div>\n",
      "            </div>\n",
      "            <div class=\"col-md-4 mb-3\">\n",
      "             <div class=\"card\">\n",
      "              <img alt=\"100%x280\" class=\"img-fluid\" src=\"images/9167_maven-in-orbit-320x240.jpeg\"/>\n",
      "              <div class=\"card-body\">\n",
      "               <p class=\"card-text\">\n",
      "                NASA, UAE Mars Missions Agree to Share Science Data\n",
      "               </p>\n",
      "              </div>\n",
      "             </div>\n",
      "            </div>\n",
      "           </div>\n",
      "          </div>\n",
      "         </div>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "     </div>\n",
      "    </section>\n",
      "    <section class=\"footer\">\n",
      "     <div class=\"container\">\n",
      "      <div class=\"col-md-12\">\n",
      "       <div class=\"row\">\n",
      "        <div class=\"col-md-3\">\n",
      "         <h5>\n",
      "          The Red Planet\n",
      "         </h5>\n",
      "         <ul>\n",
      "          <li>\n",
      "           Dashboard\n",
      "          </li>\n",
      "          <li>\n",
      "           Science Goals\n",
      "          </li>\n",
      "          <li>\n",
      "           The Planet\n",
      "          </li>\n",
      "         </ul>\n",
      "        </div>\n",
      "        <div class=\"col-md-3\">\n",
      "         <h5>\n",
      "          The Program\n",
      "         </h5>\n",
      "         <ul>\n",
      "          <li>\n",
      "           Mission Statement\n",
      "          </li>\n",
      "          <li>\n",
      "           About the Program\n",
      "          </li>\n",
      "          <li>\n",
      "           Organization Why Mars?\n",
      "          </li>\n",
      "         </ul>\n",
      "        </div>\n",
      "        <div class=\"col-md-3\">\n",
      "         <h5>\n",
      "          Multimedia\n",
      "         </h5>\n",
      "         <ul>\n",
      "          <li>\n",
      "           Images\n",
      "          </li>\n",
      "          <li>\n",
      "           Videos\n",
      "          </li>\n",
      "          <li>\n",
      "           More Resources\n",
      "          </li>\n",
      "         </ul>\n",
      "        </div>\n",
      "        <div class=\"col-md-3\">\n",
      "         <h5>\n",
      "          Missions\n",
      "         </h5>\n",
      "         <ul>\n",
      "          <li>\n",
      "           Past\n",
      "          </li>\n",
      "          <li>\n",
      "           Present\n",
      "          </li>\n",
      "          <li>\n",
      "           Future\n",
      "          </li>\n",
      "         </ul>\n",
      "        </div>\n",
      "       </div>\n",
      "      </div>\n",
      "     </div>\n",
      "    </section>\n",
      "    <footer class=\"footer\">\n",
      "     <p id=\"datasource\">\n",
      "      Images and news content extracted from NASA's\n",
      "      <a href=\"https://mars.nasa.gov/news/\">\n",
      "       Mars News\n",
      "      </a>\n",
      "      website on November 9, 2022.\n",
      "      <br/>\n",
      "      Images used in accordance with the\n",
      "      <a href=\"https://www.jpl.nasa.gov/jpl-image-use-policy\">\n",
      "       JPL Image Use Policy\n",
      "      </a>\n",
      "      .\n",
      "     </p>\n",
      "     <hr/>\n",
      "     <p id=\"edx\">\n",
      "      This site is operated by edX Boot Camps LLC for educational purposes only.\n",
      "      <br/>\n",
      "      This is not a website endorsed by NASA. This website is intended only for internal academic purposes.\n",
      "     </p>\n",
      "    </footer>\n",
      "    <script src=\"js/bootstrap.bundle.min.5.2.2.js\">\n",
      "    </script>\n",
      "   </div>\n",
      "  </div>\n",
      " </body>\n",
      "</html>\n",
      "\n"
     ]
    }
   ],
   "source": [
    "# Create a Beautiful Soup object\n",
    "html = browser.html\n",
    "mars_soup = BeautifulSoup(html, 'html.parser')\n",
    "\n",
    "# Display the BeautifulSoup object\n",
    "print(mars_soup.prettify())"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Title: NASA's MAVEN Observes Martian Light Show Caused by Major Solar Storm\n",
      "Paragraph: For the first time in its eight years orbiting Mars, NASA’s MAVEN mission witnessed two different types of ultraviolet aurorae simultaneously, the result of solar storms that began on Aug. 27.\n",
      "\n",
      "Title: NASA Prepares to Say 'Farewell' to InSight Spacecraft\n",
      "Paragraph: A closer look at what goes into wrapping up the mission as the spacecraft’s power supply continues to dwindle.\n",
      "\n",
      "Title: NASA and ESA Agree on Next Steps to Return Mars Samples to Earth\n",
      "Paragraph: The agency’s Perseverance rover will establish the first sample depot on Mars.\n",
      "\n",
      "Title: NASA's InSight Lander Detects Stunning Meteoroid Impact on Mars\n",
      "Paragraph: The agency’s lander felt the ground shake during the impact while cameras aboard the Mars Reconnaissance Orbiter spotted the yawning new crater from space.\n",
      "\n",
      "Title: NASA To Host Briefing on InSight, Mars Reconnaissance Orbiter Findings\n",
      "Paragraph: Scientists from two Mars missions will discuss how they combined images and data for a major finding on the Red Planet.\n",
      "\n",
      "Title: Why NASA Is Trying To Crash Land on Mars\n",
      "Paragraph: Like a car’s crumple zone, the experimental SHIELD lander is designed to absorb a hard impact.\n",
      "\n",
      "Title: Curiosity Mars Rover Reaches Long-Awaited Salty Region\n",
      "Paragraph: After years of climbing, the Mars rover has arrived at a special region believed to have formed as Mars’ climate was drying.\n",
      "\n",
      "Title: Mars Mission Shields Up for Tests\n",
      "Paragraph: Protecting Mars Sample Return spacecraft from micrometeorites requires high-caliber work.\n",
      "\n",
      "Title: NASA's InSight Waits Out Dust Storm\n",
      "Paragraph: InSight’s team is taking steps to help the solar-powered lander continue operating for as long as possible.\n",
      "\n",
      "Title: NASA's InSight 'Hears' Its First Meteoroid Impacts on Mars\n",
      "Paragraph: The Mars lander’s seismometer has picked up vibrations from four separate impacts in the past two years.\n",
      "\n",
      "Title: NASA's Perseverance Rover Investigates Geologically Rich Mars Terrain\n",
      "Paragraph: The latest findings provide greater detail on a region of the Red Planet that has a watery past and is yielding promising samples for the NASA-ESA Mars Sample Return campaign.\n",
      "\n",
      "Title: NASA to Host Briefing on Perseverance Mars Rover Mission Operations\n",
      "Paragraph: Members of the mission will discuss the rover’s activities as it gathers samples in an ancient river delta.\n",
      "\n",
      "Title: NASA's Perseverance Makes New Discoveries in Mars' Jezero Crater\n",
      "Paragraph: The rover found that Jezero Crater’s floor is made up of volcanic rocks that have interacted with water.\n",
      "\n",
      "Title: 10 Years Since Landing, NASA's Curiosity Mars Rover Still Has Drive\n",
      "Paragraph: Despite signs of wear, the intrepid spacecraft is about to start an exciting new chapter of its mission as it climbs a Martian mountain.\n",
      "\n",
      "Title: SAM's Top 5 Discoveries Aboard NASA's Curiosity Rover at Mars\n",
      "Paragraph: “Selfie” of the Curiosity rover with inset showing the SAM instrument prior to installation on the rover.\n",
      "\n"
     ]
    }
   ],
   "source": [
    "# Extract all the text elements\n",
    "titles = mars_soup.find_all('div', class_='content_title')\n",
    "paragraphs = mars_soup.find_all('div', class_='article_teaser_body')\n",
    "\n",
    "# Loop through and print the titles and paragraphs\n",
    "for title, paragraph in zip(titles, paragraphs):\n",
    "    print(f\"Title: {title.get_text()}\")\n",
    "    print(f\"Paragraph: {paragraph.get_text()}\")\n",
    "    print()"
   ]
  },
  {
   "attachments": {},
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Step 3: Store the Results\n",
    "\n",
    "Extract the titles and preview text of the news articles that you scraped. Store the scraping results in Python data structures as follows:\n",
    "\n",
    "* Store each title-and-preview pair in a Python dictionary. And, give each dictionary two keys: `title` and `preview`. An example is the following:\n",
    "\n",
    "  ```python\n",
    "  {'title': \"NASA's MAVEN Observes Martian Light Show Caused by Major Solar Storm\", \n",
    "   'preview': \"For the first time in its eight years orbiting Mars, NASA’s MAVEN mission witnessed two different types of ultraviolet aurorae simultaneously, the result of solar storms that began on Aug. 27.\"\n",
    "  }\n",
    "  ```\n",
    "\n",
    "* Store all the dictionaries in a Python list.\n",
    "\n",
    "* Print the list in your notebook."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Create an empty list to store the dictionaries\n",
    "mars_articles = []"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[{'title': \"NASA's MAVEN Observes Martian Light Show Caused by Major Solar Storm\", 'preview': 'For the first time in its eight years orbiting Mars, NASA’s MAVEN mission witnessed two different types of ultraviolet aurorae simultaneously, the result of solar storms that began on Aug. 27.'}, {'title': \"NASA Prepares to Say 'Farewell' to InSight Spacecraft\", 'preview': 'A closer look at what goes into wrapping up the mission as the spacecraft’s power supply continues to dwindle.'}, {'title': 'NASA and ESA Agree on Next Steps to Return Mars Samples to Earth', 'preview': 'The agency’s Perseverance rover will establish the first sample depot on Mars.'}, {'title': \"NASA's InSight Lander Detects Stunning Meteoroid Impact on Mars\", 'preview': 'The agency’s lander felt the ground shake during the impact while cameras aboard the Mars Reconnaissance Orbiter spotted the yawning new crater from space.'}, {'title': 'NASA To Host Briefing on InSight, Mars Reconnaissance Orbiter Findings', 'preview': 'Scientists from two Mars missions will discuss how they combined images and data for a major finding on the Red Planet.'}, {'title': 'Why NASA Is Trying To Crash Land on Mars', 'preview': 'Like a car’s crumple zone, the experimental SHIELD lander is designed to absorb a hard impact.'}, {'title': 'Curiosity Mars Rover Reaches Long-Awaited Salty Region', 'preview': 'After years of climbing, the Mars rover has arrived at a special region believed to have formed as Mars’ climate was drying.'}, {'title': 'Mars Mission Shields Up for Tests', 'preview': 'Protecting Mars Sample Return spacecraft from micrometeorites requires high-caliber work.'}, {'title': \"NASA's InSight Waits Out Dust Storm\", 'preview': 'InSight’s team is taking steps to help the solar-powered lander continue operating for as long as possible.'}, {'title': \"NASA's InSight 'Hears' Its First Meteoroid Impacts on Mars\", 'preview': 'The Mars lander’s seismometer has picked up vibrations from four separate impacts in the past two years.'}, {'title': \"NASA's Perseverance Rover Investigates Geologically Rich Mars Terrain\", 'preview': 'The latest findings provide greater detail on a region of the Red Planet that has a watery past and is yielding promising samples for the NASA-ESA Mars Sample Return campaign.'}, {'title': 'NASA to Host Briefing on Perseverance Mars Rover Mission Operations', 'preview': 'Members of the mission will discuss the rover’s activities as it gathers samples in an ancient river delta.'}, {'title': \"NASA's Perseverance Makes New Discoveries in Mars' Jezero Crater\", 'preview': 'The rover found that Jezero Crater’s floor is made up of volcanic rocks that have interacted with water.'}, {'title': \"10 Years Since Landing, NASA's Curiosity Mars Rover Still Has Drive\", 'preview': 'Despite signs of wear, the intrepid spacecraft is about to start an exciting new chapter of its mission as it climbs a Martian mountain.'}, {'title': \"SAM's Top 5 Discoveries Aboard NASA's Curiosity Rover at Mars\", 'preview': '“Selfie” of the Curiosity rover with inset showing the SAM instrument prior to installation on the rover.'}, {'title': \"NASA's MAVEN Observes Martian Light Show Caused by Major Solar Storm\", 'preview': 'For the first time in its eight years orbiting Mars, NASA’s MAVEN mission witnessed two different types of ultraviolet aurorae simultaneously, the result of solar storms that began on Aug. 27.'}, {'title': \"NASA Prepares to Say 'Farewell' to InSight Spacecraft\", 'preview': 'A closer look at what goes into wrapping up the mission as the spacecraft’s power supply continues to dwindle.'}, {'title': 'NASA and ESA Agree on Next Steps to Return Mars Samples to Earth', 'preview': 'The agency’s Perseverance rover will establish the first sample depot on Mars.'}, {'title': \"NASA's InSight Lander Detects Stunning Meteoroid Impact on Mars\", 'preview': 'The agency’s lander felt the ground shake during the impact while cameras aboard the Mars Reconnaissance Orbiter spotted the yawning new crater from space.'}, {'title': 'NASA To Host Briefing on InSight, Mars Reconnaissance Orbiter Findings', 'preview': 'Scientists from two Mars missions will discuss how they combined images and data for a major finding on the Red Planet.'}, {'title': 'Why NASA Is Trying To Crash Land on Mars', 'preview': 'Like a car’s crumple zone, the experimental SHIELD lander is designed to absorb a hard impact.'}, {'title': 'Curiosity Mars Rover Reaches Long-Awaited Salty Region', 'preview': 'After years of climbing, the Mars rover has arrived at a special region believed to have formed as Mars’ climate was drying.'}, {'title': 'Mars Mission Shields Up for Tests', 'preview': 'Protecting Mars Sample Return spacecraft from micrometeorites requires high-caliber work.'}, {'title': \"NASA's InSight Waits Out Dust Storm\", 'preview': 'InSight’s team is taking steps to help the solar-powered lander continue operating for as long as possible.'}, {'title': \"NASA's InSight 'Hears' Its First Meteoroid Impacts on Mars\", 'preview': 'The Mars lander’s seismometer has picked up vibrations from four separate impacts in the past two years.'}, {'title': \"NASA's Perseverance Rover Investigates Geologically Rich Mars Terrain\", 'preview': 'The latest findings provide greater detail on a region of the Red Planet that has a watery past and is yielding promising samples for the NASA-ESA Mars Sample Return campaign.'}, {'title': 'NASA to Host Briefing on Perseverance Mars Rover Mission Operations', 'preview': 'Members of the mission will discuss the rover’s activities as it gathers samples in an ancient river delta.'}, {'title': \"NASA's Perseverance Makes New Discoveries in Mars' Jezero Crater\", 'preview': 'The rover found that Jezero Crater’s floor is made up of volcanic rocks that have interacted with water.'}, {'title': \"10 Years Since Landing, NASA's Curiosity Mars Rover Still Has Drive\", 'preview': 'Despite signs of wear, the intrepid spacecraft is about to start an exciting new chapter of its mission as it climbs a Martian mountain.'}, {'title': \"SAM's Top 5 Discoveries Aboard NASA's Curiosity Rover at Mars\", 'preview': '“Selfie” of the Curiosity rover with inset showing the SAM instrument prior to installation on the rover.'}]\n"
     ]
    }
   ],
   "source": [
    "\n",
    "# Loop through the titles and paragraphs extracted\n",
    "for title, paragraph in zip(titles, paragraphs):\n",
    "    # Create a dictionary for each article\n",
    "    pair_dict = {\n",
    "        'title': title.get_text(),\n",
    "        'preview': paragraph.get_text()\n",
    "    }\n",
    "    \n",
    "    # Append the dictionary to the list\n",
    "    mars_articles.append(pair_dict)\n",
    "# Print the list to confirm success\n",
    "print(mars_articles)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [],
   "source": [
    "browser.quit()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python (dev)",
   "language": "python",
   "name": "dev"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.10.14"
  },
  "vscode": {
   "interpreter": {
    "hash": "31f2aee4e71d21fbe5cf8b01ff0e069b9275f58929596ceb00d14d90e3e16cd6"
   }
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}