comprehend-crypto.ipynb

{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "d31181b6",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Import Libraries\n",
    "import pandas as pd\n",
    "from collections import OrderedDict\n",
    "import requests\n",
    "import boto3 \n",
    "comprehend = boto3.client('comprehend', region_name='us-west-2')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "c6fbfdd9",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Point to Bucket and File\n",
    "bucket_crypto = \"p3-crypto\"\n",
    "data_key = \"project3crypto.txt\"\n",
    "data_location = 's3://{}/{}'.format(bucket_crypto, data_key)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "id": "6e2e604e",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'[\\'British entrepreneur and financier Richard ODell Poulden hopes that his new venture will relieve the plight of an underserved cohort: Bitcoin billionaires who want to buy a house.\\\\r\\\\nIn October, Poulde\\x85 [+3364 chars]\\', \\'El Salvador introduced Bitcoin as a legal tender alongside the US dollar in 2021. | Illustration by Alex Castro / The Verge\\\\r\\\\n\\\\n \\\\n\\\\n The International Monetary Fund\\x92s executive board has recommended El \\x85 [+2691 chars]\\', \\'On Tuesday, Ilya Lichtenstein and Heather Morgan were arrested in New York and accused of laundering a record $4.5 billion dollars worth of stolen cryptocurrency. In the 24 hours since, the cybersecu\\x85 [+4297 chars]\\', \\'Even if you arent paying attention to Bitcoin and other cryptocurrencies, you might have noticed that their value plummeted last week, with the total value of the market tumbling from a high of $3 tr\\x85 [+4782 chars]\\', \\'On February 3, the group started accepting ether donations on crypto crowdfunding platform Juicebox, eventually raising some $52 million. In exchange for their contributions, all donors received cryp\\x85 [+3219 chars]\\', \\'This Sunday the Los Angeles Rams will meet the Cincinnati Bengals in Super Bowl LVI. But the game is about more than just sports - its also about the adverts. \\\\r\\\\nWith an estimated TV audience of more \\x85 [+228 chars]\\', \\'But in the weeks since, SOL, along with most other cryptocurrencies, has suffered major declines in value. On the evening before the closing of the auction on Tuesday, each SOL was worth about $95.\\\\r\\\\n\\x85 [+876 chars]\\', \"If people who buy cryptocurrencies intended only to hold on to them as speculative investments, there\\'d be no real need for crypto wallets. Exchanges and online brokerages that convert dollars to, sa\\x85 [+3031 chars]\", \\'The couple would never flee from the country at the risk of losing access to their ability to have children, the lawyer wrote.\\\\r\\\\nAt the hearing, a prosecutor, Margaret Lynaugh, said in opposing bail f\\x85 [+1600 chars]\\', \\'In one 2020 article for the magazine, she explored how to protect your business as cybercriminals and fraudsters are taking advantage of disruptions caused by the pandemic.\\\\r\\\\nFor Inc.s entrepreneurial\\x85 [+1705 chars]\\', \\'Illustration by Alex Castro / The Verge\\\\r\\\\n\\\\n \\\\n\\\\n\\\\n Mainstream adoption means being listed in the App Store One of Web3\\x92s benefits, according to boosters such as Jack Dorsey, is that it\\x92s censorship-resis\\x85 [+7508 chars]\\', \\'The confiscation of the Bitcoin that remained in Mr. Lichtensteins wallet on Feb. 1, worth roughly $3.6 billion at the time, was the Justice Departments largest financial seizure ever, officials have\\x85 [+1442 chars]\\', \\'Israeli national Tal Prihar pled guilty to routing money from kickbacks through Bitcoin and shell companies \\\\r\\\\nIllustration by Alex Castro / The Verge\\\\r\\\\nIn the culmination of a two-year legal process, \\x85 [+1448 chars]\\', \\'Rate, review, share on Apple Podcasts, Soundcloud, Audioboom, Mixcloud, Acast and Stitcher, and join the conversation on Facebook, Twitter and email.\\\\r\\\\nOn the podcast today; the Guardians UK technolog\\x85 [+656 chars]\\', \\'Enlarge/ Actress Reese Witherspoon during an interview on Thursday, December 17, 2021.\\\\r\\\\n47 with 35 posters participating\\\\r\\\\nAt 12:24 pm on January 11, the actor and entrepreneur Reese Witherspoon made \\x85 [+2255 chars]\\', \\'Nearly a year after introducing Reddit Talk, the company is expanding\\\\r\\\\n its live audio chats to desktop and adding several new features to make the conversations easier to find and participate in.\\\\r\\\\nW\\x85 [+1133 chars]\\', \\'Feb 1 (Reuters) - Bitcoin is beginning to reassert its dominance over challengers to its cryptocurrency crown.\\\\r\\\\nThe original digital coin was assailed by thousands of new \"altcoin\" competitors in 202\\x85 [+3972 chars]\\', \\'Im worried that native Puerto Ricans wont be able to live or invest here and will end up displaced, he said. I thought the prices were only going up in the downtown area, but the properties in the mo\\x85 [+1038 chars]\\', \\'January 24, 2022 - Depending upon who you talk to, cryptocurrency is all the rage, a Ponzi scheme or yet another energy-consuming scourge on the environment. (See tweets by Elon Musk from mid-May 202\\x85 [+10597 chars]\\', \\'MUMBAI, Feb 1 (Reuters) - India\\\\\\'s finance minister on Tuesday said the central bank will introduce a digital currency in the next financial year using blockchain and other supporting technology.\\\\r\\\\n\"In\\x85 [+1231 chars]\\']\\r\\n'"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Create S3 Client and get the object using bucket name and object key\n",
    "s3_client = boto3.client('s3')\n",
    "obj = s3_client.get_object(Bucket=bucket_crypto, Key=data_key)\n",
    "\n",
    "# Read Object Content\n",
    "contents = obj['Body'].read()\n",
    "# print(contents.decode(\"latin\"))\n",
    "crypto_txt = contents.decode(\"latin\")\n",
    "crypto_txt"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "id": "e285cb82",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Key phrases\n",
    "phrases = comprehend.detect_key_phrases(Text=crypto_txt, LanguageCode='en')\n",
    "\n",
    "# Entities\n",
    "entities = comprehend.detect_entities(Text=crypto_txt, LanguageCode='en')\n",
    "\n",
    "#Sentiments\n",
    "sentiments = comprehend.detect_sentiment(Text=crypto_txt, LanguageCode='en')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "id": "724f477e",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "------- phrases ---------\n",
      "'British entrepreneur and financier Richard ODell Poulden\n",
      "his new venture\n",
      "the plight\n",
      "an underserved cohort\n",
      "Bitcoin billionaires\n",
      "a house\n",
      "October\n",
      "Poulde",
      " [+3364 chars\n",
      "El Salvador\n",
      "Bitcoin\n",
      "a legal tender\n",
      "the US dollar\n",
      "2021\n",
      "| Illustration\n",
      "Alex Castro / The Verge\\r\\n\\n\n",
      "The International Monetary Funds\n",
      "executive board\n",
      "El ",
      " [+2691 chars]\n",
      "Tuesday\n",
      "Ilya Lichtenstein and\n",
      "Heather Morgan\n",
      "New York\n",
      "a record\n",
      "$4.5 billion dollars\n",
      "stolen cryptocurrency\n",
      "the 24 hours\n",
      "the cybersecu",
      " [+4297 chars\n",
      "attention\n",
      "Bitcoin\n",
      "other cryptocurrencies\n",
      "their value\n",
      "last week\n",
      "the total value\n",
      "the market\n",
      "a high\n",
      "$3 tr",
      " [+4782 chars]\n",
      "February 3\n",
      "the group\n",
      "ether donations\n",
      "crypto crowdfunding platform Juicebox\n",
      "some $52 million\n",
      "exchange\n",
      "their contributions\n",
      "all donors\n",
      "cryp",
      " [+3219 chars]\n",
      "This Sunday\n",
      "the Los Angeles Rams\n",
      "the Cincinnati Bengals\n",
      "Super Bowl LVI\n",
      "the game\n",
      "about more than just sports\n",
      "the adverts\n",
      "an estimated TV audience\n",
      "more ",
      " [+228 chars]\n",
      "the weeks\n",
      "SOL\n",
      "most other cryptocurrencies\n",
      "major declines\n",
      "the evening\n",
      "the closing\n",
      "the auction\n",
      "Tuesday\n",
      "each SOL\n",
      "about $95\n",
      "\\r\\n",
      " [+876 chars]\n",
      "people\n",
      "cryptocurrencies\n",
      "speculative investments\n",
      "no real need\n",
      "crypto wallets\n",
      "Exchanges\n",
      "online brokerages\n",
      "dollars\n",
      "+3031 chars]\n",
      "The couple\n",
      "the country\n",
      "the risk\n",
      "access\n",
      "their ability\n",
      "children\n",
      "the lawyer\n",
      "the hearing\n",
      "a prosecutor\n",
      "Margaret Lynaugh\n",
      "bail\n",
      "[+1600 chars]\n",
      "one 2020 article\n",
      "the magazine\n",
      "your business\n",
      "cybercriminals and fraudsters\n",
      "advantage\n",
      "disruptions\n",
      "the pandemic\n",
      "Inc.s entrepreneurial",
      " [+1705 chars]\n",
      "Illustration\n",
      "Alex Castro /\n",
      "The Verge\\r\\n\\n \\n\\n\\n Mainstream adoption\n",
      "the App Store One\n",
      "Web3s\n",
      "benefits\n",
      "boosters\n",
      "Jack Dorsey\n",
      "censorship-resis\n",
      "+7508 chars]\n",
      "The confiscation\n",
      "the Bitcoin\n",
      "Mr. Lichtensteins wallet\n",
      "Feb. 1\n",
      "roughly $3.6 billion\n",
      "the time\n",
      "the Justice Departments largest financial seizure\n",
      "officials\n",
      "[+1442 chars]\n",
      "Israeli national Tal Prihar\n",
      "money\n",
      "kickbacks\n",
      "Bitcoin\n",
      "shell companies\n",
      "\\r\\nIllustration\n",
      "Alex Castro / The Verge\\r\\\n",
      "the culmination\n",
      "a two-year legal process\n",
      "[+1448 chars]\n",
      "Rate\n",
      "Apple Podcasts, Soundcloud, Audioboom, Mixcloud, Acast and Stitcher\n",
      "the conversation\n",
      "Facebook, Twitter and email\n",
      "the podcast\n",
      "today\n",
      "the Guardians UK technolog",
      " [+656 chars]\n",
      "Enlarge\n",
      "Reese Witherspoon\n",
      "an interview\n",
      "Thursday\n",
      "December 17, 2021\n",
      "35 posters\n",
      "12:24 pm\n",
      "January 11\n",
      "the actor and entrepreneur Reese Witherspoon\n",
      "[+2255 chars]\n",
      "Nearly a year\n",
      "Reddit Talk\n",
      "the company\n",
      "its live audio chats\n",
      "desktop\n",
      "several new features\n",
      "the conversations\n",
      "\\r\\nW",
      " [\n",
      "+1133 chars\n",
      "Feb 1\n",
      "Reuters\n",
      "Bitcoin\n",
      "its dominance\n",
      "challengers\n",
      "its cryptocurrency crown\n",
      "original digital coin\n",
      "thousands\n",
      "new \"altcoin\" competitors\n",
      "202",
      " [+3972 chars]\n",
      "Im\n",
      "native Puerto Ricans\n",
      "displaced\n",
      "the prices\n",
      "the downtown area\n",
      "the properties\n",
      "the mo",
      " [+1038 chars]\n",
      "January 24, 2022\n",
      "cryptocurrency\n",
      "all the rage\n",
      "a Ponzi scheme\n",
      "yet another energy-consuming scourge\n",
      "the environment\n",
      "tweets\n",
      "Elon Musk\n",
      "mid-May 202",
      " [+10597 chars]\n",
      "MUMBAI\n",
      "Feb 1\n",
      "Reuters\n",
      "India\\\n",
      "finance minister\n",
      "Tuesday\n",
      "the central bank\n",
      "a digital currency\n",
      "the next financial year\n",
      "blockchain\n",
      "other supporting technology\n",
      "\\r\\n\n"
     ]
    }
   ],
   "source": [
    "# Print the phrases:\n",
    "print('------- phrases ---------')\n",
    "for i in range(0, len(phrases['KeyPhrases'])):\n",
    "    print((phrases['KeyPhrases'][i]['Text']))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "id": "dcb52d39",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "------- entity : entity type ---------\n",
      "British : OTHER\n",
      "Richard ODell Poulden : PERSON\n",
      "October : DATE\n",
      "Poulde : PERSON\n",
      "+3364 chars : QUANTITY\n",
      "El Salvador : ORGANIZATION\n",
      "US : LOCATION\n",
      "2021 : DATE\n",
      "Alex Castro : PERSON\n",
      "The Verge : ORGANIZATION\n",
      "International Monetary Funds : ORGANIZATION\n",
      "El : PERSON\n",
      "+2691 chars : QUANTITY\n",
      "Tuesday : DATE\n",
      "Ilya Lichtenstein : PERSON\n",
      "Heather Morgan : PERSON\n",
      "New York : LOCATION\n",
      "$4.5 billion dollars : QUANTITY\n",
      "24 hours : QUANTITY\n",
      "+4297 chars : QUANTITY\n",
      "Bitcoin : OTHER\n",
      "last week : DATE\n",
      "$3 tr : QUANTITY\n",
      "+4782 chars : QUANTITY\n",
      "February 3 : DATE\n",
      "Juicebox : ORGANIZATION\n",
      "$52 million : QUANTITY\n",
      "+3219 chars : QUANTITY\n",
      "This Sunday : DATE\n",
      "Los Angeles Rams : ORGANIZATION\n",
      "Cincinnati Bengals : ORGANIZATION\n",
      "Super Bowl LVI : EVENT\n",
      "+228 chars : QUANTITY\n",
      "SOL : ORGANIZATION\n",
      "Tuesday : DATE\n",
      "each SOL : QUANTITY\n",
      "about $95. : QUANTITY\n",
      "+876 chars : QUANTITY\n",
      "+3031 chars : QUANTITY\n",
      "couple : QUANTITY\n",
      "Margaret Lynaugh : PERSON\n",
      "+1600 chars : QUANTITY\n",
      "one : QUANTITY\n",
      "2020 : DATE\n",
      "Inc.s : ORGANIZATION\n",
      "+1705 chars : QUANTITY\n",
      "Alex Castro : PERSON\n",
      "The Verge : ORGANIZATION\n",
      "App Store : TITLE\n",
      "One : QUANTITY\n",
      "Web3s : ORGANIZATION\n",
      "Jack Dorsey : PERSON\n",
      "+7508 chars : QUANTITY\n",
      "Bitcoin : OTHER\n",
      "Lichtensteins : PERSON\n",
      "Feb. 1 : DATE\n",
      "$3.6 billion : QUANTITY\n",
      "Justice Departments : ORGANIZATION\n",
      "+1442 chars : QUANTITY\n",
      "Israeli : OTHER\n",
      "Tal Prihar : PERSON\n",
      "Alex Castro : PERSON\n",
      "The Verge : ORGANIZATION\n",
      "two-year : QUANTITY\n",
      "+1448 chars : QUANTITY\n",
      "Apple Podcasts : TITLE\n",
      "Soundcloud : ORGANIZATION\n",
      "Audioboom : ORGANIZATION\n",
      "Mixcloud : ORGANIZATION\n",
      "Acast : ORGANIZATION\n",
      "Stitcher : ORGANIZATION\n",
      "Facebook : ORGANIZATION\n",
      "Twitter : ORGANIZATION\n",
      "today : DATE\n",
      "Guardians UK : ORGANIZATION\n",
      "+656 chars : QUANTITY\n",
      "Reese Witherspoon : PERSON\n",
      "Thursday, December 17, 2021 : DATE\n",
      "35 posters : QUANTITY\n",
      "12:24 pm : DATE\n",
      "January 11 : DATE\n",
      "Reese Witherspoon : PERSON\n",
      "+2255 chars : QUANTITY\n",
      "Nearly a year : DATE\n",
      "Reddit Talk : TITLE\n",
      "several new features : QUANTITY\n",
      "+1133 chars : QUANTITY\n",
      "Feb 1 : DATE\n",
      "Reuters : ORGANIZATION\n",
      "Bitcoin : OTHER\n",
      "thousands of new \"altcoin\" competitors : QUANTITY\n",
      "202 : QUANTITY\n",
      "+3972 chars : QUANTITY\n",
      "Puerto Ricans : PERSON\n",
      "+1038 chars : QUANTITY\n",
      "January 24, 2022 : DATE\n",
      "Elon Musk : PERSON\n",
      "mid-May 202 : DATE\n",
      "+10597 chars : QUANTITY\n",
      "MUMBAI : LOCATION\n",
      "Feb 1 : DATE\n",
      "Reuters : ORGANIZATION\n",
      "India : LOCATION\n",
      "finance : PERSON\n",
      "Tuesday : DATE\n",
      "next financial year : DATE\n",
      "+1231 chars : QUANTITY\n"
     ]
    }
   ],
   "source": [
    "# Print the entities with entitity type:\n",
    "print('------- entity : entity type ---------')\n",
    "for i in range(0, len(entities['Entities'])):\n",
    "    print(entities['Entities'][i]['Text'] + ' : ' + entities['Entities'][i]['Type'])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "id": "63c66f99",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "------- sentiment ---------\n",
      "NEUTRAL\n"
     ]
    }
   ],
   "source": [
    "# Print the sentiment:\n",
    "print('------- sentiment ---------')\n",
    "print(sentiments['Sentiment'])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "c94a4486",
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.11"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}