P7 azure cognitive services.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "f544da9b-3230-4c4b-8597-f6fb75e6150e",
   "metadata": {},
   "source": [
    "# azure KEYVAULT\n",
    "* variables d'environnement:\n",
    "    * AZURE_CLIENT_ID : id de l'application déclarée dans azure active directory\n",
    "    * AZURE_CLIENT_SECRET: secret de l'application \n",
    "    * AZURE_KV: nom du KV\n",
    "    * AZURE_TENANT_ID: id du azure TENANT\n",
    "* autoriser l'application dans access policy en veillant à selection l application dans princicpal\n",
    "    * pas la peine de selectionner dans application authorisée\n",
    "* DefaultAzureCredential() lira dans l'ordre les var environ avec secret, puis avec certificat et enfin avec user/password\n",
    "* Key Vault utilise l’authentification Azure Active Directory (Azure AD), qui nécessite un principal de sécurité Azure AD pour accorder l’accès. Un principal de sécurité Azure AD peut être un utilisateur, un principal de service d’application, une identité managée pour les ressources Azure ou un groupe de l’un de ces types\n",
    "* il est recommandé d’utiliser **l’identité managée** pour les applications déployées sur Azure. \n",
    "    * le principal de service avec un certificat est une alternative possible. Dans ce scénario, le certificat doit être stocké dans Key Vault et faire l’objet d’une rotation fréquente\n",
    "    \n",
    "* **bonnes pratiques**:\n",
    "    * Développement local : principal d’utilisateur ou principal de service avec un secret\n",
    "    * Environnements de test et de développement : identité managée, principal de service avec certificat ou principal du service avec un secret.\n",
    "    * Environnement de production : identité managée ou principal de service avec un certificat.\n",
    "\n",
    "* Les identités managées permettent aux développeurs de ne plus avoir à gérer les informations d'identification\n",
    "    * Par exemple, une application peut utiliser une identité managée pour accéder à des ressources comme Azure Key Vault :\n",
    "        * où les développeurs peuvent stocker des informations d'identification de manière sécurisée, \n",
    "        * ou pour accéder à des comptes de stockage."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "5a17c1d6-09f7-4960-8615-593f40a118d7",
   "metadata": {},
   "source": [
    "## 1-creation de clés dans azure keyvault"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "b8313cb7-37d1-4f42-8c0c-ac0d546311b8",
   "metadata": {},
   "outputs": [
    {
     "name": "stdin",
     "output_type": "stream",
     "text": [
      "Input a name for your secret >  yom\n",
      "Input a value for your secret >  yom\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Creating a secret in nab-kv called 'yom' with the value 'yom' ...\n",
      " done.\n"
     ]
    }
   ],
   "source": [
    "#https://docs.microsoft.com/en-us/azure/key-vault/secrets/quick-create-python\n",
    "#pip install azure-identity\n",
    "#pip install azure-keyvault-secrets\n",
    "\n",
    "# creation de clés\n",
    "\n",
    "import os\n",
    "from azure.keyvault.secrets import SecretClient\n",
    "from azure.identity import DefaultAzureCredential\n",
    "\n",
    "keyVaultName = os.environ[\"AZURE_KV\"]\n",
    "KVUri = f\"https://{keyVaultName}.vault.azure.net\"\n",
    "\n",
    "credential = DefaultAzureCredential()\n",
    "client = SecretClient(vault_url=KVUri, credential=credential)\n",
    "\n",
    "secretName = input(\"Input a name for your secret > \")\n",
    "secretValue = input(\"Input a value for your secret > \")\n",
    "\n",
    "print(f\"Creating a secret in {keyVaultName} called '{secretName}' with the value '{secretValue}' ...\")\n",
    "\n",
    "client.set_secret(secretName, secretValue)\n",
    "\n",
    "print(\" done.\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "6717dc78-39a0-4b8e-b6b7-a878aeea9714",
   "metadata": {},
   "source": [
    "## 2-extraction de clés de azure keyvault"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "b7b8d988-5eeb-4868-9881-b05225236514",
   "metadata": {},
   "outputs": [],
   "source": [
    "# extraction de clés\n",
    "import os\n",
    "from azure.keyvault.secrets import SecretClient\n",
    "from azure.identity import DefaultAzureCredential\n",
    "\n",
    "keyVaultName = os.environ[\"AZURE_KV\"]\n",
    "KVUri = f\"https://{keyVaultName}.vault.azure.net\"\n",
    "\n",
    "credential = DefaultAzureCredential()\n",
    "client = SecretClient(vault_url=KVUri, credential=credential)\n",
    "\n",
    "print(f\"Retrieving your secret from {keyVaultName}.\")\n",
    "\n",
    "secretName='nab-cs-language-secret'\n",
    "retrieved_secret = client.get_secret(secretName)\n",
    "\n",
    "print(f\"Your secret is '{retrieved_secret.value}'.\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "fc2a9177-0c74-4f8f-abda-6c43062c46f3",
   "metadata": {},
   "source": [
    "## 3- suppresion de clés dans azure keyvault"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "9903f030-b1fa-4ccc-bbb5-642bd4f855c6",
   "metadata": {},
   "outputs": [],
   "source": [
    "#suppresion de clé \n",
    "#si les droits de suppresion sont donnés dan sla policy\n",
    "print(f\"Deleting your secret from {keyVaultName} ...\")\n",
    "\n",
    "poller = client.begin_delete_secret(secretName)\n",
    "deleted_secret = poller.result()\n",
    "\n",
    "print(\" done.\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "6c37dfd6-7dab-4133-9c98-480d1ca2e7ef",
   "metadata": {},
   "source": [
    "# cognitives services : sentiment analysis : test sur 500 textes\n",
    "  * tarification: \n",
    "    https://azure.microsoft.com/fr-fr/pricing/details/cognitive-services/language-service/\n",
    "  * gratuits 5000 textes (1000 caracteres) / mois\n",
    "  * 90 centimes par 1000 textes pour les premiers 500000 -> 450€ pour 500000 textes ed 1000 caracteres\n",
    "        \n",
    "  * limitations:\n",
    "      * les performances dépendent d'un certain nombre de facteurs tels que \n",
    "           * le domaine du sujet, \n",
    "           * les caractéristiques du texte traité, \n",
    "           * le cas d'utilisation du système et \n",
    "           * la façon dont les gens interprètent la sortie du système\n",
    "       * modèle est entrainé sur les avis de produits et de services\n",
    "       * aucune compréhension de l'importance relative des différentes phrases qui sont envoyées ensemble\n",
    "       * difficultés à reconnaître le sarcasme. \n",
    "       * le score de confiance ne reflète pas l'intensité du sentiment mais la confiance du modèle pour un sentiment particulier (positif, neutre, négatif). \n",
    "       * limite de données: https://docs.microsoft.com/fr-fr/azure/cognitive-services/language-service/sentiment-opinion-mining/how-to/call-api\n",
    "       * limite de taux de transfert"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "f221fd0b-364f-48db-9462-6c82ad4bd976",
   "metadata": {},
   "source": [
    "## 1-import de tweets"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "80a6359a-59c4-4cdd-a84f-be4fe0b79306",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "2.8243205547332764\n",
      "le fichier contient  1600000 lignes\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>target</th>\n",
       "      <th>id</th>\n",
       "      <th>date</th>\n",
       "      <th>flag</th>\n",
       "      <th>user</th>\n",
       "      <th>text</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0</td>\n",
       "      <td>1467810369</td>\n",
       "      <td>Mon Apr 06 22:19:45 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>_TheSpecialOne_</td>\n",
       "      <td>@switchfoot http://twitpic.com/2y1zl - Awww, t...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0</td>\n",
       "      <td>1467810672</td>\n",
       "      <td>Mon Apr 06 22:19:49 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>scotthamilton</td>\n",
       "      <td>is upset that he can't update his Facebook by ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0</td>\n",
       "      <td>1467810917</td>\n",
       "      <td>Mon Apr 06 22:19:53 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>mattycus</td>\n",
       "      <td>@Kenichan I dived many times for the ball. Man...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>0</td>\n",
       "      <td>1467811184</td>\n",
       "      <td>Mon Apr 06 22:19:57 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>ElleCTF</td>\n",
       "      <td>my whole body feels itchy and like its on fire</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>0</td>\n",
       "      <td>1467811193</td>\n",
       "      <td>Mon Apr 06 22:19:57 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>Karoli</td>\n",
       "      <td>@nationwideclass no, it's not behaving at all....</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1599995</th>\n",
       "      <td>4</td>\n",
       "      <td>2193601966</td>\n",
       "      <td>Tue Jun 16 08:40:49 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>AmandaMarie1028</td>\n",
       "      <td>Just woke up. Having no school is the best fee...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1599996</th>\n",
       "      <td>4</td>\n",
       "      <td>2193601969</td>\n",
       "      <td>Tue Jun 16 08:40:49 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>TheWDBoards</td>\n",
       "      <td>TheWDB.com - Very cool to hear old Walt interv...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1599997</th>\n",
       "      <td>4</td>\n",
       "      <td>2193601991</td>\n",
       "      <td>Tue Jun 16 08:40:49 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>bpbabe</td>\n",
       "      <td>Are you ready for your MoJo Makeover? Ask me f...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1599998</th>\n",
       "      <td>4</td>\n",
       "      <td>2193602064</td>\n",
       "      <td>Tue Jun 16 08:40:49 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>tinydiamondz</td>\n",
       "      <td>Happy 38th Birthday to my boo of alll time!!! ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1599999</th>\n",
       "      <td>4</td>\n",
       "      <td>2193602129</td>\n",
       "      <td>Tue Jun 16 08:40:50 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>RyanTrevMorris</td>\n",
       "      <td>happy #charitytuesday @theNSPCC @SparksCharity...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>1600000 rows × 6 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "         target          id                          date      flag  \\\n",
       "0             0  1467810369  Mon Apr 06 22:19:45 PDT 2009  NO_QUERY   \n",
       "1             0  1467810672  Mon Apr 06 22:19:49 PDT 2009  NO_QUERY   \n",
       "2             0  1467810917  Mon Apr 06 22:19:53 PDT 2009  NO_QUERY   \n",
       "3             0  1467811184  Mon Apr 06 22:19:57 PDT 2009  NO_QUERY   \n",
       "4             0  1467811193  Mon Apr 06 22:19:57 PDT 2009  NO_QUERY   \n",
       "...         ...         ...                           ...       ...   \n",
       "1599995       4  2193601966  Tue Jun 16 08:40:49 PDT 2009  NO_QUERY   \n",
       "1599996       4  2193601969  Tue Jun 16 08:40:49 PDT 2009  NO_QUERY   \n",
       "1599997       4  2193601991  Tue Jun 16 08:40:49 PDT 2009  NO_QUERY   \n",
       "1599998       4  2193602064  Tue Jun 16 08:40:49 PDT 2009  NO_QUERY   \n",
       "1599999       4  2193602129  Tue Jun 16 08:40:50 PDT 2009  NO_QUERY   \n",
       "\n",
       "                    user                                               text  \n",
       "0        _TheSpecialOne_  @switchfoot http://twitpic.com/2y1zl - Awww, t...  \n",
       "1          scotthamilton  is upset that he can't update his Facebook by ...  \n",
       "2               mattycus  @Kenichan I dived many times for the ball. Man...  \n",
       "3                ElleCTF    my whole body feels itchy and like its on fire   \n",
       "4                 Karoli  @nationwideclass no, it's not behaving at all....  \n",
       "...                  ...                                                ...  \n",
       "1599995  AmandaMarie1028  Just woke up. Having no school is the best fee...  \n",
       "1599996      TheWDBoards  TheWDB.com - Very cool to hear old Walt interv...  \n",
       "1599997           bpbabe  Are you ready for your MoJo Makeover? Ask me f...  \n",
       "1599998     tinydiamondz  Happy 38th Birthday to my boo of alll time!!! ...  \n",
       "1599999   RyanTrevMorris  happy #charitytuesday @theNSPCC @SparksCharity...  \n",
       "\n",
       "[1600000 rows x 6 columns]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "import pandas as pd\n",
    "import time\n",
    "\n",
    "start = time.time()\n",
    "data = pd.read_csv('input/sentiment140/training.1600000.processed.noemoticon.csv', delimiter = ',', header=None)\n",
    "print(time.time()-start)\n",
    "print('le fichier contient ', len(data.index),'lignes' )\n",
    "data.columns=['target','id','date','flag','user','text']\n",
    "display(data)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "ee5fc49d-dba7-4446-b0fa-c0b3fdcde66b",
   "metadata": {},
   "source": [
    "## 2- melange et extraction de 500 twwets avec mise en place des colonnes de score de confiance"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "id": "12c5727b-63a8-4154-9281-69eb4da7ba79",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>target</th>\n",
       "      <th>id</th>\n",
       "      <th>date</th>\n",
       "      <th>flag</th>\n",
       "      <th>user</th>\n",
       "      <th>text</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0</td>\n",
       "      <td>2064642004</td>\n",
       "      <td>Sun Jun 07 06:48:44 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>fawcett94</td>\n",
       "      <td>god its so depressing to be back in england af...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0</td>\n",
       "      <td>2055179073</td>\n",
       "      <td>Sat Jun 06 08:50:52 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>ikesonthereal</td>\n",
       "      <td>@shach7 lucky bastard!!! lol cloudy over here</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0</td>\n",
       "      <td>2259170043</td>\n",
       "      <td>Sat Jun 20 17:07:53 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>sneezymonica</td>\n",
       "      <td>@dailydreamer No, I def won't make it back! jo...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>0</td>\n",
       "      <td>2051333783</td>\n",
       "      <td>Fri Jun 05 21:41:37 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>katie0509</td>\n",
       "      <td>is actually sick from the medicine  hopefully ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>0</td>\n",
       "      <td>2006027229</td>\n",
       "      <td>Tue Jun 02 10:32:42 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>AnnefromTO</td>\n",
       "      <td>@thewrongshoes aw man, I wish I was there, I c...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>799995</th>\n",
       "      <td>0</td>\n",
       "      <td>2203039686</td>\n",
       "      <td>Tue Jun 16 22:54:26 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>Lurquer</td>\n",
       "      <td>@pcsketch too many deadlines right now, and me...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>799996</th>\n",
       "      <td>0</td>\n",
       "      <td>2056973855</td>\n",
       "      <td>Sat Jun 06 12:08:16 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>timho90</td>\n",
       "      <td>So cold inside at work. Two more hours at work...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>799997</th>\n",
       "      <td>0</td>\n",
       "      <td>2262649661</td>\n",
       "      <td>Sat Jun 20 22:56:34 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>mjstopani</td>\n",
       "      <td>On the phone with my best friend, it's so sad....</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>799998</th>\n",
       "      <td>0</td>\n",
       "      <td>2013443182</td>\n",
       "      <td>Tue Jun 02 22:41:17 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>emcahu</td>\n",
       "      <td>@Joey_Lenzmeier it's the only way to talk to y...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>799999</th>\n",
       "      <td>0</td>\n",
       "      <td>2186351303</td>\n",
       "      <td>Mon Jun 15 18:42:56 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>BabyStrizzy</td>\n",
       "      <td>i think i'm the only person who hasnt seen han...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>800000 rows × 6 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "        target          id                          date      flag  \\\n",
       "0            0  2064642004  Sun Jun 07 06:48:44 PDT 2009  NO_QUERY   \n",
       "1            0  2055179073  Sat Jun 06 08:50:52 PDT 2009  NO_QUERY   \n",
       "2            0  2259170043  Sat Jun 20 17:07:53 PDT 2009  NO_QUERY   \n",
       "3            0  2051333783  Fri Jun 05 21:41:37 PDT 2009  NO_QUERY   \n",
       "4            0  2006027229  Tue Jun 02 10:32:42 PDT 2009  NO_QUERY   \n",
       "...        ...         ...                           ...       ...   \n",
       "799995       0  2203039686  Tue Jun 16 22:54:26 PDT 2009  NO_QUERY   \n",
       "799996       0  2056973855  Sat Jun 06 12:08:16 PDT 2009  NO_QUERY   \n",
       "799997       0  2262649661  Sat Jun 20 22:56:34 PDT 2009  NO_QUERY   \n",
       "799998       0  2013443182  Tue Jun 02 22:41:17 PDT 2009  NO_QUERY   \n",
       "799999       0  2186351303  Mon Jun 15 18:42:56 PDT 2009  NO_QUERY   \n",
       "\n",
       "                 user                                               text  \n",
       "0           fawcett94  god its so depressing to be back in england af...  \n",
       "1       ikesonthereal     @shach7 lucky bastard!!! lol cloudy over here   \n",
       "2        sneezymonica  @dailydreamer No, I def won't make it back! jo...  \n",
       "3           katie0509  is actually sick from the medicine  hopefully ...  \n",
       "4          AnnefromTO  @thewrongshoes aw man, I wish I was there, I c...  \n",
       "...               ...                                                ...  \n",
       "799995        Lurquer  @pcsketch too many deadlines right now, and me...  \n",
       "799996        timho90  So cold inside at work. Two more hours at work...  \n",
       "799997      mjstopani  On the phone with my best friend, it's so sad....  \n",
       "799998         emcahu  @Joey_Lenzmeier it's the only way to talk to y...  \n",
       "799999    BabyStrizzy  i think i'm the only person who hasnt seen han...  \n",
       "\n",
       "[800000 rows x 6 columns]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>target</th>\n",
       "      <th>id</th>\n",
       "      <th>date</th>\n",
       "      <th>flag</th>\n",
       "      <th>user</th>\n",
       "      <th>text</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>4</td>\n",
       "      <td>2014192235</td>\n",
       "      <td>Wed Jun 03 00:44:26 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>louisethom</td>\n",
       "      <td>lovely weather again</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>4</td>\n",
       "      <td>2189659044</td>\n",
       "      <td>Tue Jun 16 00:34:25 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>PEETEE1980</td>\n",
       "      <td>@cheydee this is amaing weather, hope it lasts...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>4</td>\n",
       "      <td>1880047403</td>\n",
       "      <td>Thu May 21 23:56:14 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>silkyninja</td>\n",
       "      <td>@BabeNatasha awww you're the greatest!</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>4</td>\n",
       "      <td>1825047295</td>\n",
       "      <td>Sun May 17 04:06:26 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>ZeroProduction</td>\n",
       "      <td>Awesome way to increase your followers http://...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>4</td>\n",
       "      <td>1980956525</td>\n",
       "      <td>Sun May 31 08:04:56 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>DinoGoesRawr</td>\n",
       "      <td>Dark brown with red tint, have i ever told any...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>799995</th>\n",
       "      <td>4</td>\n",
       "      <td>1976480244</td>\n",
       "      <td>Sat May 30 17:26:16 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>theyoungestkim</td>\n",
       "      <td>@DanteLaSalle Ready for FT2: Still Broke  send...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>799996</th>\n",
       "      <td>4</td>\n",
       "      <td>2062594892</td>\n",
       "      <td>Sat Jun 06 23:41:50 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>irisush</td>\n",
       "      <td>@rubyzuby I liked your name</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>799997</th>\n",
       "      <td>4</td>\n",
       "      <td>2058145737</td>\n",
       "      <td>Sat Jun 06 14:21:23 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>letsbetigers</td>\n",
       "      <td>McDick's called! Orientation tomorrow at three!</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>799998</th>\n",
       "      <td>4</td>\n",
       "      <td>2002560772</td>\n",
       "      <td>Tue Jun 02 04:33:51 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>xoxo_leah</td>\n",
       "      <td>@Eminem You were class on Jonathan Ross</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>799999</th>\n",
       "      <td>4</td>\n",
       "      <td>1989622613</td>\n",
       "      <td>Mon Jun 01 02:12:40 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>dchan77fr</td>\n",
       "      <td>@cindyjag Thanks Cindy, I'm feeling better so ...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>800000 rows × 6 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "        target          id                          date      flag  \\\n",
       "0            4  2014192235  Wed Jun 03 00:44:26 PDT 2009  NO_QUERY   \n",
       "1            4  2189659044  Tue Jun 16 00:34:25 PDT 2009  NO_QUERY   \n",
       "2            4  1880047403  Thu May 21 23:56:14 PDT 2009  NO_QUERY   \n",
       "3            4  1825047295  Sun May 17 04:06:26 PDT 2009  NO_QUERY   \n",
       "4            4  1980956525  Sun May 31 08:04:56 PDT 2009  NO_QUERY   \n",
       "...        ...         ...                           ...       ...   \n",
       "799995       4  1976480244  Sat May 30 17:26:16 PDT 2009  NO_QUERY   \n",
       "799996       4  2062594892  Sat Jun 06 23:41:50 PDT 2009  NO_QUERY   \n",
       "799997       4  2058145737  Sat Jun 06 14:21:23 PDT 2009  NO_QUERY   \n",
       "799998       4  2002560772  Tue Jun 02 04:33:51 PDT 2009  NO_QUERY   \n",
       "799999       4  1989622613  Mon Jun 01 02:12:40 PDT 2009  NO_QUERY   \n",
       "\n",
       "                  user                                               text  \n",
       "0           louisethom                              lovely weather again   \n",
       "1           PEETEE1980  @cheydee this is amaing weather, hope it lasts...  \n",
       "2           silkyninja            @BabeNatasha awww you're the greatest!   \n",
       "3       ZeroProduction  Awesome way to increase your followers http://...  \n",
       "4         DinoGoesRawr  Dark brown with red tint, have i ever told any...  \n",
       "...                ...                                                ...  \n",
       "799995  theyoungestkim  @DanteLaSalle Ready for FT2: Still Broke  send...  \n",
       "799996         irisush                       @rubyzuby I liked your name   \n",
       "799997    letsbetigers   McDick's called! Orientation tomorrow at three!   \n",
       "799998       xoxo_leah           @Eminem You were class on Jonathan Ross   \n",
       "799999       dchan77fr  @cindyjag Thanks Cindy, I'm feeling better so ...  \n",
       "\n",
       "[800000 rows x 6 columns]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>target</th>\n",
       "      <th>id</th>\n",
       "      <th>date</th>\n",
       "      <th>flag</th>\n",
       "      <th>user</th>\n",
       "      <th>text</th>\n",
       "      <th>neg</th>\n",
       "      <th>neut</th>\n",
       "      <th>pos</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>4</td>\n",
       "      <td>1467823594</td>\n",
       "      <td>Mon Apr 06 22:23:05 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>ClareStewart</td>\n",
       "      <td>@ALBinLA.  I was just thinking about you tonig...</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>4</td>\n",
       "      <td>1467863012</td>\n",
       "      <td>Mon Apr 06 22:33:24 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>kristinloves</td>\n",
       "      <td>has discovered that she loves easter crafts, e...</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0</td>\n",
       "      <td>1467835305</td>\n",
       "      <td>Mon Apr 06 22:26:10 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>MissLaura317</td>\n",
       "      <td>@januarycrimson Sorry, babe!!  My fam annoys m...</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>0</td>\n",
       "      <td>1467839477</td>\n",
       "      <td>Mon Apr 06 22:27:16 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>becklyn13</td>\n",
       "      <td>Hanging in Crooners. Wanna sing. Can't. Sucks.</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>4</td>\n",
       "      <td>1467823216</td>\n",
       "      <td>Mon Apr 06 22:23:00 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>anyyankeest</td>\n",
       "      <td>@iJohn kitteh is sleepin on my crotch which pr...</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>495</th>\n",
       "      <td>0</td>\n",
       "      <td>1467853356</td>\n",
       "      <td>Mon Apr 06 22:30:54 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>dbmendel</td>\n",
       "      <td>Picked Mich St to win it all from the get go. ...</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>496</th>\n",
       "      <td>0</td>\n",
       "      <td>1467844140</td>\n",
       "      <td>Mon Apr 06 22:28:32 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>Twokids1</td>\n",
       "      <td>@rumblepurr lol.. wish they understood dayligh...</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>497</th>\n",
       "      <td>0</td>\n",
       "      <td>1467860144</td>\n",
       "      <td>Mon Apr 06 22:32:38 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>Jana1976</td>\n",
       "      <td>@JonathanRKnight I hate the limited letters,to...</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>498</th>\n",
       "      <td>0</td>\n",
       "      <td>1467836111</td>\n",
       "      <td>Mon Apr 06 22:26:22 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>perrohunter</td>\n",
       "      <td>@makeherfamous hmm  , do u really enjoy being ...</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>499</th>\n",
       "      <td>0</td>\n",
       "      <td>1467818603</td>\n",
       "      <td>Mon Apr 06 22:21:49 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>kennypham</td>\n",
       "      <td>Sad, sad, sad. I don't know why but I hate thi...</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>500 rows × 9 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "     target          id                          date      flag          user  \\\n",
       "0         4  1467823594  Mon Apr 06 22:23:05 PDT 2009  NO_QUERY  ClareStewart   \n",
       "1         4  1467863012  Mon Apr 06 22:33:24 PDT 2009  NO_QUERY  kristinloves   \n",
       "2         0  1467835305  Mon Apr 06 22:26:10 PDT 2009  NO_QUERY  MissLaura317   \n",
       "3         0  1467839477  Mon Apr 06 22:27:16 PDT 2009  NO_QUERY     becklyn13   \n",
       "4         4  1467823216  Mon Apr 06 22:23:00 PDT 2009  NO_QUERY   anyyankeest   \n",
       "..      ...         ...                           ...       ...           ...   \n",
       "495       0  1467853356  Mon Apr 06 22:30:54 PDT 2009  NO_QUERY      dbmendel   \n",
       "496       0  1467844140  Mon Apr 06 22:28:32 PDT 2009  NO_QUERY      Twokids1   \n",
       "497       0  1467860144  Mon Apr 06 22:32:38 PDT 2009  NO_QUERY      Jana1976   \n",
       "498       0  1467836111  Mon Apr 06 22:26:22 PDT 2009  NO_QUERY   perrohunter   \n",
       "499       0  1467818603  Mon Apr 06 22:21:49 PDT 2009  NO_QUERY     kennypham   \n",
       "\n",
       "                                                  text  neg  neut  pos  \n",
       "0    @ALBinLA.  I was just thinking about you tonig...   -1    -1   -1  \n",
       "1    has discovered that she loves easter crafts, e...   -1    -1   -1  \n",
       "2    @januarycrimson Sorry, babe!!  My fam annoys m...   -1    -1   -1  \n",
       "3      Hanging in Crooners. Wanna sing. Can't. Sucks.    -1    -1   -1  \n",
       "4    @iJohn kitteh is sleepin on my crotch which pr...   -1    -1   -1  \n",
       "..                                                 ...  ...   ...  ...  \n",
       "495  Picked Mich St to win it all from the get go. ...   -1    -1   -1  \n",
       "496  @rumblepurr lol.. wish they understood dayligh...   -1    -1   -1  \n",
       "497  @JonathanRKnight I hate the limited letters,to...   -1    -1   -1  \n",
       "498  @makeherfamous hmm  , do u really enjoy being ...   -1    -1   -1  \n",
       "499  Sad, sad, sad. I don't know why but I hate thi...   -1    -1   -1  \n",
       "\n",
       "[500 rows x 9 columns]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "data1=data.loc[data.target==0,:]\n",
    "data1_shuffled=data1.sample(frac=1).reset_index(drop=True)\n",
    "display(data1_shuffled)\n",
    "data2=data.loc[data.target==4,:]\n",
    "data2_shuffled=data2.sample(frac=1).reset_index(drop=True)\n",
    "display(data2_shuffled)\n",
    "\n",
    "data2acs=pd.concat([data1.iloc[0:250].copy(),data2.iloc[0:250].copy()])\n",
    "data2acs_shuffled=data2acs.sample(frac=1).reset_index(drop=True)\n",
    "\n",
    "data2acs_shuffled['neg']=-1\n",
    "data2acs_shuffled['neut']=-1\n",
    "data2acs_shuffled['pos']=-1\n",
    "\n",
    "display(data2acs_shuffled)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "a7da7107-b50f-4735-a193-316361b33bff",
   "metadata": {},
   "source": [
    "## 3- appel du cognitive services pour analyser les sentiments des tweets"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "9c640a55-79b1-4931-9b4e-11ccd664be59",
   "metadata": {},
   "outputs": [],
   "source": [
    "#pip install azure-ai-textanalytics==5.1.0\n",
    "\n",
    "# extraction de clés\n",
    "import os\n",
    "from azure.keyvault.secrets import SecretClient\n",
    "from azure.identity import DefaultAzureCredential\n",
    "import time\n",
    "\n",
    "keyVaultName = os.environ[\"AZURE_KV\"]\n",
    "KVUri = f\"https://{keyVaultName}.vault.azure.net\"\n",
    "\n",
    "credential = DefaultAzureCredential()\n",
    "client = SecretClient(vault_url=KVUri, credential=credential)\n",
    "\n",
    "\n",
    "secretName='nab-cs-language-secret'\n",
    "retrieved_secret = client.get_secret(secretName).value\n",
    "\n",
    "###########################################################################\n",
    "\n",
    "\n",
    "key = retrieved_secret\n",
    "endpoint =\"https://nab-cs-langage.cognitiveservices.azure.com/\"\n",
    "\n",
    "from azure.ai.textanalytics import TextAnalyticsClient\n",
    "from azure.core.credentials import AzureKeyCredential\n",
    "\n",
    "# Authenticate the client using your key and endpoint \n",
    "def authenticate_client():\n",
    "    ta_credential = AzureKeyCredential(key)\n",
    "    text_analytics_client = TextAnalyticsClient(\n",
    "            endpoint=endpoint, \n",
    "            credential=ta_credential)\n",
    "    return text_analytics_client\n",
    "\n",
    "client = authenticate_client()\n",
    "\n",
    "# Example function for detecting sentiment in text\n",
    "def sentiment_analysis_example(client,data):\n",
    "    \n",
    "    data2acs=data.copy()\n",
    "    for i in range(0,data2acs.shape[0],10):\n",
    "        #on a bizarrement des pauses tous les 100\n",
    "        #on a le droit à 10 docs par request\n",
    "        print(i)\n",
    "        documents=[]\n",
    "        for j in range(10):\n",
    "            documents.append(data.text.iloc[i+j])\n",
    "        response = client.analyze_sentiment(documents=documents)\n",
    "        for j in range(10):\n",
    "            data2acs['pos'].iloc[i+j]=response[j].confidence_scores.positive\n",
    "            data2acs['neut'].iloc[i+j]=response[j].confidence_scores.neutral\n",
    "            data2acs['neg'].iloc[i+j]=response[j].confidence_scores.negative\n",
    "\n",
    "    return data2acs \n",
    "\n",
    "start = time.time()\n",
    "res=sentiment_analysis_example(client,data2acs_shuffled)\n",
    "stime=time.time()-start"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "id": "26c3ad3a-bdff-4fa1-91e2-ac99b3e10a99",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "61.757548809051514\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>target</th>\n",
       "      <th>id</th>\n",
       "      <th>date</th>\n",
       "      <th>flag</th>\n",
       "      <th>user</th>\n",
       "      <th>text</th>\n",
       "      <th>neg</th>\n",
       "      <th>neut</th>\n",
       "      <th>pos</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0</td>\n",
       "      <td>1467819650</td>\n",
       "      <td>Mon Apr 06 22:22:05 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>antzpantz</td>\n",
       "      <td>@Viennah Yay! I'm happy for you with your job!...</td>\n",
       "      <td>0.00</td>\n",
       "      <td>0.00</td>\n",
       "      <td>0.99</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0</td>\n",
       "      <td>1467815923</td>\n",
       "      <td>Mon Apr 06 22:21:07 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>fatkat309</td>\n",
       "      <td>some1 hacked my account on aim  now i have to ...</td>\n",
       "      <td>0.97</td>\n",
       "      <td>0.02</td>\n",
       "      <td>0.00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0</td>\n",
       "      <td>1467811184</td>\n",
       "      <td>Mon Apr 06 22:19:57 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>ElleCTF</td>\n",
       "      <td>my whole body feels itchy and like its on fire</td>\n",
       "      <td>0.94</td>\n",
       "      <td>0.05</td>\n",
       "      <td>0.01</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>4</td>\n",
       "      <td>1467823989</td>\n",
       "      <td>Mon Apr 06 22:23:12 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>andwhenyousing</td>\n",
       "      <td>Across the Universe. Sleep. Rehearsal tomorrow.</td>\n",
       "      <td>0.04</td>\n",
       "      <td>0.92</td>\n",
       "      <td>0.04</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>4</td>\n",
       "      <td>1467823936</td>\n",
       "      <td>Mon Apr 06 22:23:11 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>PamelaPJA</td>\n",
       "      <td>I think I met my first &amp;quot;snob&amp;quot; on twi...</td>\n",
       "      <td>0.83</td>\n",
       "      <td>0.16</td>\n",
       "      <td>0.01</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>95</th>\n",
       "      <td>4</td>\n",
       "      <td>1467822924</td>\n",
       "      <td>Mon Apr 06 22:22:55 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>ddjuli</td>\n",
       "      <td>@nicolerichie: your picture is very sweet</td>\n",
       "      <td>0.00</td>\n",
       "      <td>0.00</td>\n",
       "      <td>0.99</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>96</th>\n",
       "      <td>4</td>\n",
       "      <td>1467824422</td>\n",
       "      <td>Mon Apr 06 22:23:19 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>deeper2k</td>\n",
       "      <td>@stevecla it is a wallpaper with Red Square I ...</td>\n",
       "      <td>0.09</td>\n",
       "      <td>0.78</td>\n",
       "      <td>0.12</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>97</th>\n",
       "      <td>4</td>\n",
       "      <td>1467823109</td>\n",
       "      <td>Mon Apr 06 22:22:58 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>mark_liu</td>\n",
       "      <td>@LordPov Are you meant to add on the back of t...</td>\n",
       "      <td>0.13</td>\n",
       "      <td>0.85</td>\n",
       "      <td>0.02</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>98</th>\n",
       "      <td>0</td>\n",
       "      <td>1467813579</td>\n",
       "      <td>Mon Apr 06 22:20:31 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>starkissed</td>\n",
       "      <td>@LettyA ahh ive always wanted to see rent  lov...</td>\n",
       "      <td>0.00</td>\n",
       "      <td>0.01</td>\n",
       "      <td>0.99</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>99</th>\n",
       "      <td>4</td>\n",
       "      <td>1467824454</td>\n",
       "      <td>Mon Apr 06 22:23:20 PDT 2009</td>\n",
       "      <td>NO_QUERY</td>\n",
       "      <td>vmdavinci</td>\n",
       "      <td>@r_keith_hill Thanks for your response. Ihad a...</td>\n",
       "      <td>0.01</td>\n",
       "      <td>0.04</td>\n",
       "      <td>0.95</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>100 rows × 9 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "    target          id                          date      flag  \\\n",
       "0        0  1467819650  Mon Apr 06 22:22:05 PDT 2009  NO_QUERY   \n",
       "1        0  1467815923  Mon Apr 06 22:21:07 PDT 2009  NO_QUERY   \n",
       "2        0  1467811184  Mon Apr 06 22:19:57 PDT 2009  NO_QUERY   \n",
       "3        4  1467823989  Mon Apr 06 22:23:12 PDT 2009  NO_QUERY   \n",
       "4        4  1467823936  Mon Apr 06 22:23:11 PDT 2009  NO_QUERY   \n",
       "..     ...         ...                           ...       ...   \n",
       "95       4  1467822924  Mon Apr 06 22:22:55 PDT 2009  NO_QUERY   \n",
       "96       4  1467824422  Mon Apr 06 22:23:19 PDT 2009  NO_QUERY   \n",
       "97       4  1467823109  Mon Apr 06 22:22:58 PDT 2009  NO_QUERY   \n",
       "98       0  1467813579  Mon Apr 06 22:20:31 PDT 2009  NO_QUERY   \n",
       "99       4  1467824454  Mon Apr 06 22:23:20 PDT 2009  NO_QUERY   \n",
       "\n",
       "              user                                               text   neg  \\\n",
       "0        antzpantz  @Viennah Yay! I'm happy for you with your job!...  0.00   \n",
       "1        fatkat309  some1 hacked my account on aim  now i have to ...  0.97   \n",
       "2          ElleCTF    my whole body feels itchy and like its on fire   0.94   \n",
       "3   andwhenyousing   Across the Universe. Sleep. Rehearsal tomorrow.   0.04   \n",
       "4        PamelaPJA  I think I met my first &quot;snob&quot; on twi...  0.83   \n",
       "..             ...                                                ...   ...   \n",
       "95          ddjuli         @nicolerichie: your picture is very sweet   0.00   \n",
       "96        deeper2k  @stevecla it is a wallpaper with Red Square I ...  0.09   \n",
       "97        mark_liu  @LordPov Are you meant to add on the back of t...  0.13   \n",
       "98      starkissed  @LettyA ahh ive always wanted to see rent  lov...  0.00   \n",
       "99       vmdavinci  @r_keith_hill Thanks for your response. Ihad a...  0.01   \n",
       "\n",
       "    neut   pos  \n",
       "0   0.00  0.99  \n",
       "1   0.02  0.00  \n",
       "2   0.05  0.01  \n",
       "3   0.92  0.04  \n",
       "4   0.16  0.01  \n",
       "..   ...   ...  \n",
       "95  0.00  0.99  \n",
       "96  0.78  0.12  \n",
       "97  0.85  0.02  \n",
       "98  0.01  0.99  \n",
       "99  0.04  0.95  \n",
       "\n",
       "[100 rows x 9 columns]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "print(time.time()-start)\n",
    "display(res)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "167d0d29-f0f8-4bb0-9cab-b102a80751cc",
   "metadata": {},
   "source": [
    "## 4- accuracy avec prise en compte du neutral"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "id": "c07b5547-422f-4ec1-9504-d5fdec6fc457",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "              precision    recall  f1-score   support\n",
      "\n",
      "           0       0.79      0.57      0.67       235\n",
      "           1       0.00      0.00      0.00         0\n",
      "           2       0.76      0.60      0.67       265\n",
      "\n",
      "    accuracy                           0.59       500\n",
      "   macro avg       0.52      0.39      0.44       500\n",
      "weighted avg       0.77      0.59      0.67       500\n",
      "\n"
     ]
    }
   ],
   "source": [
    "import numpy as np\n",
    "from sklearn.metrics import confusion_matrix,f1_score,classification_report\n",
    "\n",
    "res['label3']=res.loc[:,['neg','neut','pos']].apply(np.argmax, axis=1)\n",
    "res['target3']=res['target'].map({0:0,4:2})\n",
    "\n",
    "print(classification_report(res['target3'],res['label3'],target_names=['0','1','2'],zero_division=0))"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "84349912-8be1-4a55-b0e9-37e36599e52d",
   "metadata": {},
   "source": [
    "## 5- accuracy sans prise en compte du neutral"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "id": "5ec528a1-07e1-4d56-9d17-b1c13099efdc",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "              precision    recall  f1-score   support\n",
      "\n",
      "           0       0.74      0.68      0.71       235\n",
      "           1       0.73      0.78      0.76       265\n",
      "\n",
      "    accuracy                           0.73       500\n",
      "   macro avg       0.73      0.73      0.73       500\n",
      "weighted avg       0.73      0.73      0.73       500\n",
      "\n"
     ]
    }
   ],
   "source": [
    "\n",
    "res['label2']=res.loc[:,['neg','pos']].apply(np.argmax, axis=1)\n",
    "res['target2']=res['target'].map({0:0,4:1})\n",
    "\n",
    "\n",
    "print(classification_report(res['target2'],res['label2'],target_names=['0','1'],zero_division=0))"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.8"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}