examples/search.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": false
   },
   "source": [
    "# Using ChatNoir in PyTerrier experiments\n",
    "The [ChatNoir](https://chatnoir.eu/) search engine is a low-barrier way to search the ClueWeb and CommonCrawl corpora.\n",
    "Using its search API via the [`chatnoir-pyterrier`](https://pypi.org/project/chatnoir-pyterrier/) Python package,\n",
    "we can integrate the ClueWeb and CommonCrawl into PyTerrier experiments without the hassle of indexing either of them.\n",
    "This facilitates research with these large web crawls for individuals and institutions without extensive hardware.\n",
    "\n",
    "(Note: `chatnoir-pyterrier` uses [`chatnoir-api`](https://pypi.org/project/chatnoir-api/) under the hood.)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": false
   },
   "source": [
    "## Setup"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": false
   },
   "source": [
    "Install Python packages if run in Google Colab."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "from sys import modules\n",
    "\n",
    "if \"google.colab\" in modules:\n",
    "    !pip install -q chatnoir-pyterrier python-terrier"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": false
   },
   "source": [
    "## Retrieval pipeline\n",
    "We can now create a retrieval pipeline which retrieves results from [ChatNoir](https://chatnoir.eu/).\n",
    "Create a `ChatNoirRetrieve` transformer by specifying the ChatNoir API key and (optionally) some index.\n",
    "You can then use the pipeline in the same way as `BatchRetrieve`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "from chatnoir_pyterrier import ChatNoirRetrieve\n",
    "\n",
    "chatnoir_cw12 = ChatNoirRetrieve(index=\"clueweb12\", verbose=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": false
   },
   "source": [
    "### Search\n",
    "For example, we can search the ClueWeb12 for documents containing `python library`:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Searching with ChatNoir: 100%|██████████| 1/1 [00:01<00:00,  1.04s/query]\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>qid</th>\n",
       "      <th>query</th>\n",
       "      <th>docno</th>\n",
       "      <th>score</th>\n",
       "      <th>rank</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>python library</td>\n",
       "      <td>clueweb12-0205wb-25-32436</td>\n",
       "      <td>1934.6893</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>python library</td>\n",
       "      <td>clueweb12-0208wb-28-20755</td>\n",
       "      <td>1930.6849</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1</td>\n",
       "      <td>python library</td>\n",
       "      <td>clueweb12-0006wb-18-00118</td>\n",
       "      <td>1927.1230</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>python library</td>\n",
       "      <td>clueweb12-1701wb-32-34607</td>\n",
       "      <td>1923.3622</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1</td>\n",
       "      <td>python library</td>\n",
       "      <td>clueweb12-0818wb-78-03791</td>\n",
       "      <td>1921.8531</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>1</td>\n",
       "      <td>python library</td>\n",
       "      <td>clueweb12-1616wb-96-24738</td>\n",
       "      <td>1921.5735</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>1</td>\n",
       "      <td>python library</td>\n",
       "      <td>clueweb12-0817wb-55-06948</td>\n",
       "      <td>1920.2981</td>\n",
       "      <td>6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>1</td>\n",
       "      <td>python library</td>\n",
       "      <td>clueweb12-0707wb-61-32502</td>\n",
       "      <td>1916.4521</td>\n",
       "      <td>7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>1</td>\n",
       "      <td>python library</td>\n",
       "      <td>clueweb12-0409wb-58-16488</td>\n",
       "      <td>1889.8235</td>\n",
       "      <td>8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>1</td>\n",
       "      <td>python library</td>\n",
       "      <td>clueweb12-0008wb-49-08484</td>\n",
       "      <td>1889.5938</td>\n",
       "      <td>9</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "  qid           query                      docno      score  rank\n",
       "0   1  python library  clueweb12-0205wb-25-32436  1934.6893     0\n",
       "1   1  python library  clueweb12-0208wb-28-20755  1930.6849     1\n",
       "2   1  python library  clueweb12-0006wb-18-00118  1927.1230     2\n",
       "3   1  python library  clueweb12-1701wb-32-34607  1923.3622     3\n",
       "4   1  python library  clueweb12-0818wb-78-03791  1921.8531     4\n",
       "5   1  python library  clueweb12-1616wb-96-24738  1921.5735     5\n",
       "6   1  python library  clueweb12-0817wb-55-06948  1920.2981     6\n",
       "7   1  python library  clueweb12-0707wb-61-32502  1916.4521     7\n",
       "8   1  python library  clueweb12-0409wb-58-16488  1889.8235     8\n",
       "9   1  python library  clueweb12-0008wb-49-08484  1889.5938     9"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "chatnoir_cw12.search(\"python library\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": false
   },
   "source": [
    "### Evaluation\n",
    "We can also use the pipeline in a PyTerrier `Experiment` (and compare it to other retrieval pipelines).\n",
    "First, we need to download the test topics, for example from the TREC Web Track 2014.\n",
    "(Refer to the [PyTerrier documentation](https://pyterrier.readthedocs.io/en/latest/datasets.html#examples) for more detailed guides.)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "[INFO] [starting] https://trec.nist.gov/data/web/2014/trec2014-topics.xml\n",
      "[INFO] [finished] https://trec.nist.gov/data/web/2014/trec2014-topics.xml: [00:00] [22.9kB] [114kB/s]\n",
      "                                                                                   \r"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "terrier-assemblies 5.10 jar-with-dependencies not found, downloading to /home/heinrich/.pyterrier...\n",
      "Done\n",
      "terrier-python-helper 0.0.8 jar not found, downloading to /home/heinrich/.pyterrier...\n",
      "Done\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Java started (triggered by _pt_tokeniser) and loaded: pyterrier.java, pyterrier.terrier.java [version=5.10 (build: craigm 2024-08-22 17:33), helper_version=0.0.8]\n"
     ]
    }
   ],
   "source": [
    "from pandas import DataFrame\n",
    "from pyterrier.datasets import Dataset, get_dataset\n",
    "\n",
    "dataset: Dataset = get_dataset(\"irds:clueweb12/trec-web-2014\")\n",
    "topics: DataFrame = dataset.get_topics(variant=\"query\").iloc[:5]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": false
   },
   "source": [
    "Now we can, for example, retrieve documents for the TREC Web Track 2014 topics."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Searching with ChatNoir: 100%|██████████| 5/5 [00:51<00:00, 10.29s/query]\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>qid</th>\n",
       "      <th>query</th>\n",
       "      <th>docno</th>\n",
       "      <th>score</th>\n",
       "      <th>rank</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>251</td>\n",
       "      <td>identifying spider bites</td>\n",
       "      <td>clueweb12-0001wb-99-01299</td>\n",
       "      <td>2583.1420</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>251</td>\n",
       "      <td>identifying spider bites</td>\n",
       "      <td>clueweb12-0604wb-92-22824</td>\n",
       "      <td>1913.1904</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>251</td>\n",
       "      <td>identifying spider bites</td>\n",
       "      <td>clueweb12-0310wb-50-11456</td>\n",
       "      <td>1909.5555</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>251</td>\n",
       "      <td>identifying spider bites</td>\n",
       "      <td>clueweb12-1716wb-96-27852</td>\n",
       "      <td>1909.4258</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>251</td>\n",
       "      <td>identifying spider bites</td>\n",
       "      <td>clueweb12-0110wb-54-25957</td>\n",
       "      <td>1905.8689</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>251</td>\n",
       "      <td>identifying spider bites</td>\n",
       "      <td>clueweb12-0308wb-28-03934</td>\n",
       "      <td>1891.4822</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>251</td>\n",
       "      <td>identifying spider bites</td>\n",
       "      <td>clueweb12-0006wb-33-07815</td>\n",
       "      <td>1853.0745</td>\n",
       "      <td>6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>251</td>\n",
       "      <td>identifying spider bites</td>\n",
       "      <td>clueweb12-1701wb-90-31942</td>\n",
       "      <td>1807.2461</td>\n",
       "      <td>7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>251</td>\n",
       "      <td>identifying spider bites</td>\n",
       "      <td>clueweb12-0300wb-82-24885</td>\n",
       "      <td>1798.9708</td>\n",
       "      <td>8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>251</td>\n",
       "      <td>identifying spider bites</td>\n",
       "      <td>clueweb12-1910wb-43-12567</td>\n",
       "      <td>1740.1986</td>\n",
       "      <td>9</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>252</td>\n",
       "      <td>history of orcas island</td>\n",
       "      <td>clueweb12-0302wb-83-05876</td>\n",
       "      <td>2384.5310</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>252</td>\n",
       "      <td>history of orcas island</td>\n",
       "      <td>clueweb12-0911wb-12-05181</td>\n",
       "      <td>2134.3562</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>252</td>\n",
       "      <td>history of orcas island</td>\n",
       "      <td>clueweb12-0714wb-74-26861</td>\n",
       "      <td>1926.7454</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>252</td>\n",
       "      <td>history of orcas island</td>\n",
       "      <td>clueweb12-0900wb-33-02598</td>\n",
       "      <td>1922.7214</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>252</td>\n",
       "      <td>history of orcas island</td>\n",
       "      <td>clueweb12-1206wb-26-29737</td>\n",
       "      <td>1912.8632</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>252</td>\n",
       "      <td>history of orcas island</td>\n",
       "      <td>clueweb12-0709wb-23-21512</td>\n",
       "      <td>1909.8712</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>252</td>\n",
       "      <td>history of orcas island</td>\n",
       "      <td>clueweb12-0713wb-63-28106</td>\n",
       "      <td>1905.2705</td>\n",
       "      <td>6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>252</td>\n",
       "      <td>history of orcas island</td>\n",
       "      <td>clueweb12-0713wb-77-24557</td>\n",
       "      <td>1884.2883</td>\n",
       "      <td>7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>252</td>\n",
       "      <td>history of orcas island</td>\n",
       "      <td>clueweb12-1206wb-40-25916</td>\n",
       "      <td>1877.0739</td>\n",
       "      <td>8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>252</td>\n",
       "      <td>history of orcas island</td>\n",
       "      <td>clueweb12-0710wb-97-10735</td>\n",
       "      <td>1852.9235</td>\n",
       "      <td>9</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>253</td>\n",
       "      <td>tooth abscess</td>\n",
       "      <td>clueweb12-0701wb-49-32906</td>\n",
       "      <td>3359.6430</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>253</td>\n",
       "      <td>tooth abscess</td>\n",
       "      <td>clueweb12-0006wb-91-28207</td>\n",
       "      <td>3273.3796</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>253</td>\n",
       "      <td>tooth abscess</td>\n",
       "      <td>clueweb12-0408wb-72-27626</td>\n",
       "      <td>3170.4084</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>253</td>\n",
       "      <td>tooth abscess</td>\n",
       "      <td>clueweb12-0005wb-17-11685</td>\n",
       "      <td>3164.1873</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>253</td>\n",
       "      <td>tooth abscess</td>\n",
       "      <td>clueweb12-0405wb-92-21058</td>\n",
       "      <td>3163.7288</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>253</td>\n",
       "      <td>tooth abscess</td>\n",
       "      <td>clueweb12-0509wb-42-19512</td>\n",
       "      <td>3163.6210</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>253</td>\n",
       "      <td>tooth abscess</td>\n",
       "      <td>clueweb12-0508wb-08-04588</td>\n",
       "      <td>3158.0037</td>\n",
       "      <td>6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>253</td>\n",
       "      <td>tooth abscess</td>\n",
       "      <td>clueweb12-0205wb-50-21510</td>\n",
       "      <td>3151.6716</td>\n",
       "      <td>7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>253</td>\n",
       "      <td>tooth abscess</td>\n",
       "      <td>clueweb12-0408wb-72-27679</td>\n",
       "      <td>3126.0925</td>\n",
       "      <td>8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>253</td>\n",
       "      <td>tooth abscess</td>\n",
       "      <td>clueweb12-0602wb-15-18498</td>\n",
       "      <td>3123.6830</td>\n",
       "      <td>9</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>30</th>\n",
       "      <td>254</td>\n",
       "      <td>barrett s esophagus</td>\n",
       "      <td>clueweb12-0918wb-43-20582</td>\n",
       "      <td>3563.4740</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31</th>\n",
       "      <td>254</td>\n",
       "      <td>barrett s esophagus</td>\n",
       "      <td>clueweb12-0918wb-43-20581</td>\n",
       "      <td>3316.5125</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32</th>\n",
       "      <td>254</td>\n",
       "      <td>barrett s esophagus</td>\n",
       "      <td>clueweb12-0918wb-43-20583</td>\n",
       "      <td>3143.4160</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>33</th>\n",
       "      <td>254</td>\n",
       "      <td>barrett s esophagus</td>\n",
       "      <td>clueweb12-0401wb-52-19569</td>\n",
       "      <td>3074.8723</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>34</th>\n",
       "      <td>254</td>\n",
       "      <td>barrett s esophagus</td>\n",
       "      <td>clueweb12-1204wb-51-23381</td>\n",
       "      <td>3068.7578</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35</th>\n",
       "      <td>254</td>\n",
       "      <td>barrett s esophagus</td>\n",
       "      <td>clueweb12-0311wb-46-17388</td>\n",
       "      <td>3067.5200</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>36</th>\n",
       "      <td>254</td>\n",
       "      <td>barrett s esophagus</td>\n",
       "      <td>clueweb12-0208wb-00-05232</td>\n",
       "      <td>3051.4680</td>\n",
       "      <td>6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>37</th>\n",
       "      <td>254</td>\n",
       "      <td>barrett s esophagus</td>\n",
       "      <td>clueweb12-0401wb-73-24231</td>\n",
       "      <td>3049.9412</td>\n",
       "      <td>7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>38</th>\n",
       "      <td>254</td>\n",
       "      <td>barrett s esophagus</td>\n",
       "      <td>clueweb12-1314wb-45-27565</td>\n",
       "      <td>3046.4268</td>\n",
       "      <td>8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>39</th>\n",
       "      <td>254</td>\n",
       "      <td>barrett s esophagus</td>\n",
       "      <td>clueweb12-0100wb-02-07629</td>\n",
       "      <td>3030.7449</td>\n",
       "      <td>9</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>40</th>\n",
       "      <td>255</td>\n",
       "      <td>teddy bears</td>\n",
       "      <td>clueweb12-1016wb-43-02417</td>\n",
       "      <td>2594.5708</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>41</th>\n",
       "      <td>255</td>\n",
       "      <td>teddy bears</td>\n",
       "      <td>clueweb12-0604wb-00-30165</td>\n",
       "      <td>2583.4824</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>42</th>\n",
       "      <td>255</td>\n",
       "      <td>teddy bears</td>\n",
       "      <td>clueweb12-0310wb-01-12983</td>\n",
       "      <td>2581.2803</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>43</th>\n",
       "      <td>255</td>\n",
       "      <td>teddy bears</td>\n",
       "      <td>clueweb12-1306wb-43-05988</td>\n",
       "      <td>2572.6614</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>44</th>\n",
       "      <td>255</td>\n",
       "      <td>teddy bears</td>\n",
       "      <td>clueweb12-0008wb-39-11217</td>\n",
       "      <td>2571.4140</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>45</th>\n",
       "      <td>255</td>\n",
       "      <td>teddy bears</td>\n",
       "      <td>clueweb12-1306wb-43-05985</td>\n",
       "      <td>2567.1462</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46</th>\n",
       "      <td>255</td>\n",
       "      <td>teddy bears</td>\n",
       "      <td>clueweb12-1306wb-43-05986</td>\n",
       "      <td>2563.7017</td>\n",
       "      <td>6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>47</th>\n",
       "      <td>255</td>\n",
       "      <td>teddy bears</td>\n",
       "      <td>clueweb12-1010wb-35-19378</td>\n",
       "      <td>2552.6548</td>\n",
       "      <td>7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>48</th>\n",
       "      <td>255</td>\n",
       "      <td>teddy bears</td>\n",
       "      <td>clueweb12-1010wb-41-09633</td>\n",
       "      <td>2551.4224</td>\n",
       "      <td>8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>49</th>\n",
       "      <td>255</td>\n",
       "      <td>teddy bears</td>\n",
       "      <td>clueweb12-1608wb-97-02139</td>\n",
       "      <td>2547.3118</td>\n",
       "      <td>9</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    qid                     query                      docno      score  rank\n",
       "0   251  identifying spider bites  clueweb12-0001wb-99-01299  2583.1420     0\n",
       "1   251  identifying spider bites  clueweb12-0604wb-92-22824  1913.1904     1\n",
       "2   251  identifying spider bites  clueweb12-0310wb-50-11456  1909.5555     2\n",
       "3   251  identifying spider bites  clueweb12-1716wb-96-27852  1909.4258     3\n",
       "4   251  identifying spider bites  clueweb12-0110wb-54-25957  1905.8689     4\n",
       "5   251  identifying spider bites  clueweb12-0308wb-28-03934  1891.4822     5\n",
       "6   251  identifying spider bites  clueweb12-0006wb-33-07815  1853.0745     6\n",
       "7   251  identifying spider bites  clueweb12-1701wb-90-31942  1807.2461     7\n",
       "8   251  identifying spider bites  clueweb12-0300wb-82-24885  1798.9708     8\n",
       "9   251  identifying spider bites  clueweb12-1910wb-43-12567  1740.1986     9\n",
       "10  252   history of orcas island  clueweb12-0302wb-83-05876  2384.5310     0\n",
       "11  252   history of orcas island  clueweb12-0911wb-12-05181  2134.3562     1\n",
       "12  252   history of orcas island  clueweb12-0714wb-74-26861  1926.7454     2\n",
       "13  252   history of orcas island  clueweb12-0900wb-33-02598  1922.7214     3\n",
       "14  252   history of orcas island  clueweb12-1206wb-26-29737  1912.8632     4\n",
       "15  252   history of orcas island  clueweb12-0709wb-23-21512  1909.8712     5\n",
       "16  252   history of orcas island  clueweb12-0713wb-63-28106  1905.2705     6\n",
       "17  252   history of orcas island  clueweb12-0713wb-77-24557  1884.2883     7\n",
       "18  252   history of orcas island  clueweb12-1206wb-40-25916  1877.0739     8\n",
       "19  252   history of orcas island  clueweb12-0710wb-97-10735  1852.9235     9\n",
       "20  253             tooth abscess  clueweb12-0701wb-49-32906  3359.6430     0\n",
       "21  253             tooth abscess  clueweb12-0006wb-91-28207  3273.3796     1\n",
       "22  253             tooth abscess  clueweb12-0408wb-72-27626  3170.4084     2\n",
       "23  253             tooth abscess  clueweb12-0005wb-17-11685  3164.1873     3\n",
       "24  253             tooth abscess  clueweb12-0405wb-92-21058  3163.7288     4\n",
       "25  253             tooth abscess  clueweb12-0509wb-42-19512  3163.6210     5\n",
       "26  253             tooth abscess  clueweb12-0508wb-08-04588  3158.0037     6\n",
       "27  253             tooth abscess  clueweb12-0205wb-50-21510  3151.6716     7\n",
       "28  253             tooth abscess  clueweb12-0408wb-72-27679  3126.0925     8\n",
       "29  253             tooth abscess  clueweb12-0602wb-15-18498  3123.6830     9\n",
       "30  254       barrett s esophagus  clueweb12-0918wb-43-20582  3563.4740     0\n",
       "31  254       barrett s esophagus  clueweb12-0918wb-43-20581  3316.5125     1\n",
       "32  254       barrett s esophagus  clueweb12-0918wb-43-20583  3143.4160     2\n",
       "33  254       barrett s esophagus  clueweb12-0401wb-52-19569  3074.8723     3\n",
       "34  254       barrett s esophagus  clueweb12-1204wb-51-23381  3068.7578     4\n",
       "35  254       barrett s esophagus  clueweb12-0311wb-46-17388  3067.5200     5\n",
       "36  254       barrett s esophagus  clueweb12-0208wb-00-05232  3051.4680     6\n",
       "37  254       barrett s esophagus  clueweb12-0401wb-73-24231  3049.9412     7\n",
       "38  254       barrett s esophagus  clueweb12-1314wb-45-27565  3046.4268     8\n",
       "39  254       barrett s esophagus  clueweb12-0100wb-02-07629  3030.7449     9\n",
       "40  255               teddy bears  clueweb12-1016wb-43-02417  2594.5708     0\n",
       "41  255               teddy bears  clueweb12-0604wb-00-30165  2583.4824     1\n",
       "42  255               teddy bears  clueweb12-0310wb-01-12983  2581.2803     2\n",
       "43  255               teddy bears  clueweb12-1306wb-43-05988  2572.6614     3\n",
       "44  255               teddy bears  clueweb12-0008wb-39-11217  2571.4140     4\n",
       "45  255               teddy bears  clueweb12-1306wb-43-05985  2567.1462     5\n",
       "46  255               teddy bears  clueweb12-1306wb-43-05986  2563.7017     6\n",
       "47  255               teddy bears  clueweb12-1010wb-35-19378  2552.6548     7\n",
       "48  255               teddy bears  clueweb12-1010wb-41-09633  2551.4224     8\n",
       "49  255               teddy bears  clueweb12-1608wb-97-02139  2547.3118     9"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "chatnoir_cw12.transform(topics)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": false
   },
   "source": [
    "Alternatively, we could compare the results with ChatNoir's phrase search.\n",
    "Let's define the phrase search pipeline."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "from chatnoir_pyterrier import ChatNoirRetrieve\n",
    "\n",
    "chatnoir_cw12_phrases = ChatNoirRetrieve(index=\"clueweb12\", phrases=True, verbose=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "[INFO] [starting] https://trec.nist.gov/data/web/2014/qrels.adhoc.txt\n",
      "[INFO] [finished] https://trec.nist.gov/data/web/2014/qrels.adhoc.txt: [00:01] [491kB] [480kB/s]\n",
      "Searching with ChatNoir: 100%|██████████| 5/5 [00:31<00:00,  6.38s/query]     \n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>name</th>\n",
       "      <th>nDCG@5</th>\n",
       "      <th>AP</th>\n",
       "      <th>RR</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>ChatNoir</td>\n",
       "      <td>0.311199</td>\n",
       "      <td>0.018777</td>\n",
       "      <td>0.450000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>ChatNoir phrases</td>\n",
       "      <td>0.195566</td>\n",
       "      <td>0.011439</td>\n",
       "      <td>0.366667</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "               name    nDCG@5        AP        RR\n",
       "0          ChatNoir  0.311199  0.018777  0.450000\n",
       "1  ChatNoir phrases  0.195566  0.011439  0.366667"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from ir_measures import nDCG, RR, MAP\n",
    "from pyterrier.pipelines import Experiment\n",
    "\n",
    "Experiment(\n",
    "    [chatnoir_cw12, chatnoir_cw12_phrases],\n",
    "    topics,\n",
    "    dataset.get_qrels(),\n",
    "    eval_metrics=[nDCG @ 5, MAP, RR],\n",
    "    names=[\"ChatNoir\", \"ChatNoir phrases\"],\n",
    ")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": false
   },
   "source": [
    "As you see, [ChatNoir](https://chatnoir.eu/) is a great way to experiment with the ClueWeb and CommonCrawl corpora!"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": false
   },
   "source": [
    "## Features\n",
    "Of course, we can also put all [features](https://chatnoir.eu/doc/api/#response-data) that are returned by ChatNoir into the result dataframe.\n",
    "Choose the features you need with the `Feature` flags or select `Feature.ALL` if you want to include all features.\n",
    "Especially the `Feature.PAGE_RANK` and `Feature.SPAM_RANK` features might prove useful in subsequent reranking steps."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Searching with ChatNoir: 100%|██████████| 1/1 [00:42<00:00, 42.52s/query]\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>qid</th>\n",
       "      <th>query</th>\n",
       "      <th>docno</th>\n",
       "      <th>score</th>\n",
       "      <th>uuid</th>\n",
       "      <th>trec_id</th>\n",
       "      <th>warc_id</th>\n",
       "      <th>index</th>\n",
       "      <th>crawl_date</th>\n",
       "      <th>target_hostname</th>\n",
       "      <th>...</th>\n",
       "      <th>spam_rank</th>\n",
       "      <th>title_highlighted</th>\n",
       "      <th>title_text</th>\n",
       "      <th>snippet_highlighted</th>\n",
       "      <th>snippet_text</th>\n",
       "      <th>explanation</th>\n",
       "      <th>html</th>\n",
       "      <th>html_plain</th>\n",
       "      <th>language</th>\n",
       "      <th>rank</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>hello world</td>\n",
       "      <td>clueweb09-en0008-79-32496</td>\n",
       "      <td>1796.4073</td>\n",
       "      <td>bb3fd98f-8d8a-5e40-99f0-1716cba4b8f6</td>\n",
       "      <td>clueweb09-en0008-79-32496</td>\n",
       "      <td>&lt;urn:uuid:01e34120-69c5-4d0d-ba00-5fb153faf434&gt;</td>\n",
       "      <td>clueweb09</td>\n",
       "      <td>None</td>\n",
       "      <td>www.knowledgerush.com</td>\n",
       "      <td>...</td>\n",
       "      <td>74.0</td>\n",
       "      <td>&lt;em&gt;Hello&lt;/em&gt; &lt;em&gt;World&lt;/em&gt;. Who is &lt;em&gt;Hell...</td>\n",
       "      <td>Hello World. Who is Hello World? What is Hello...</td>\n",
       "      <td>*&amp;#x2F;&lt;em&gt;Hello&lt;/em&gt;, &lt;em&gt;world&lt;/em&gt;!&amp;#x2F;p&amp;...</td>\n",
       "      <td>*/Hello, world!/p'\\n\\nSelf\\n\\n'Hello, World!' ...</td>\n",
       "      <td>ExplanationResponse(value=1796.4073, descripti...</td>\n",
       "      <td>\\n\\n\\n\\n\\n\\n\\n\\n\\n&lt;html&gt;\\n&lt;head&gt;\\n&lt;meta http-e...</td>\n",
       "      <td>text/html</td>\n",
       "      <td>en</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>hello world</td>\n",
       "      <td>clueweb09-en0002-41-30760</td>\n",
       "      <td>1742.4870</td>\n",
       "      <td>df90b151-92d7-5968-b11b-5fbd2a45400f</td>\n",
       "      <td>clueweb09-en0002-41-30760</td>\n",
       "      <td>&lt;urn:uuid:33b06517-adbb-4734-a6ed-4356e1831e87&gt;</td>\n",
       "      <td>clueweb09</td>\n",
       "      <td>None</td>\n",
       "      <td>ruby.about.com</td>\n",
       "      <td>...</td>\n",
       "      <td>97.0</td>\n",
       "      <td>&lt;em&gt;Hello&lt;/em&gt; &lt;em&gt;World&lt;/em&gt;</td>\n",
       "      <td>Hello World</td>\n",
       "      <td>Ruby\\n\\n  Home\\n  Computing &amp;amp; Technology\\n...</td>\n",
       "      <td>Ruby\\n\\n  Home\\n  Computing &amp; Technology\\n  Ru...</td>\n",
       "      <td>ExplanationResponse(value=1742.487, descriptio...</td>\n",
       "      <td>&lt;!DOCTYPE html PUBLIC \"-//W3C//DTD HTML 4.01 T...</td>\n",
       "      <td>text/html</td>\n",
       "      <td>en</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1</td>\n",
       "      <td>hello world</td>\n",
       "      <td>clueweb09-en0049-23-18105</td>\n",
       "      <td>1741.3336</td>\n",
       "      <td>70846a1d-9ae8-52f9-9263-ed48bf3bbac0</td>\n",
       "      <td>clueweb09-en0049-23-18105</td>\n",
       "      <td>&lt;urn:uuid:15a9e3e8-5a91-49fd-8272-aeb87b86a699&gt;</td>\n",
       "      <td>clueweb09</td>\n",
       "      <td>None</td>\n",
       "      <td>www.csse.monash.edu.au</td>\n",
       "      <td>...</td>\n",
       "      <td>86.0</td>\n",
       "      <td>&lt;em&gt;Hello&lt;/em&gt; &lt;em&gt;world&lt;/em&gt;</td>\n",
       "      <td>Hello world</td>\n",
       "      <td>&lt;em&gt;Hello&lt;/em&gt; &lt;em&gt;world&lt;/em&gt;\\n\\nLA home\\nFP\\n...</td>\n",
       "      <td>Hello world\\n\\nLA home\\nFP\\n Haskell\\n  Haskel...</td>\n",
       "      <td>ExplanationResponse(value=1741.3336, descripti...</td>\n",
       "      <td>&lt;!DOCTYPE HTML PUBLIC \"-//W3C//DTD HTML 3.2//E...</td>\n",
       "      <td>text/html</td>\n",
       "      <td>en</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>hello world</td>\n",
       "      <td>clueweb09-en0077-14-04758</td>\n",
       "      <td>1736.9447</td>\n",
       "      <td>64644656-27d4-51d8-8cba-2fdbd9f6bec4</td>\n",
       "      <td>clueweb09-en0077-14-04758</td>\n",
       "      <td>&lt;urn:uuid:b0d9c3ea-6faf-4fd9-aa66-5ca01d6436d4&gt;</td>\n",
       "      <td>clueweb09</td>\n",
       "      <td>None</td>\n",
       "      <td>www.allisons.org</td>\n",
       "      <td>...</td>\n",
       "      <td>88.0</td>\n",
       "      <td>&lt;em&gt;Hello&lt;/em&gt; &lt;em&gt;world&lt;/em&gt;</td>\n",
       "      <td>Hello world</td>\n",
       "      <td>&lt;em&gt;Hello&lt;/em&gt; &lt;em&gt;world&lt;/em&gt;\\n\\nLA home\\nComp...</td>\n",
       "      <td>Hello world\\n\\nLA home\\nComputing\\nFP\\n Haskel...</td>\n",
       "      <td>ExplanationResponse(value=1736.9447, descripti...</td>\n",
       "      <td>&lt;!DOCTYPE HTML PUBLIC \"-//W3C//DTD HTML 3.2//E...</td>\n",
       "      <td>text/html</td>\n",
       "      <td>en</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1</td>\n",
       "      <td>hello world</td>\n",
       "      <td>clueweb09-en0031-56-17080</td>\n",
       "      <td>1724.4045</td>\n",
       "      <td>f3db927d-db79-59d9-a72d-fd0dabb1c7fe</td>\n",
       "      <td>clueweb09-en0031-56-17080</td>\n",
       "      <td>&lt;urn:uuid:fdefa2c1-5377-4c6b-bec7-43726d6560e6&gt;</td>\n",
       "      <td>clueweb09</td>\n",
       "      <td>None</td>\n",
       "      <td>jist.ece.cornell.edu</td>\n",
       "      <td>...</td>\n",
       "      <td>89.0</td>\n",
       "      <td>&lt;em&gt;Hello&lt;/em&gt; &lt;em&gt;world&lt;/em&gt;</td>\n",
       "      <td>Hello world</td>\n",
       "      <td>However, executing the same application under ...</td>\n",
       "      <td>However, executing the same application under ...</td>\n",
       "      <td>ExplanationResponse(value=1724.4045, descripti...</td>\n",
       "      <td>&lt;!DOCTYPE HTML PUBLIC \"-//W3C//DTD HTML 3.2 Fi...</td>\n",
       "      <td>text/html</td>\n",
       "      <td>en</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>1</td>\n",
       "      <td>hello world</td>\n",
       "      <td>clueweb09-en0131-21-45225</td>\n",
       "      <td>1723.9354</td>\n",
       "      <td>498047a3-c208-559b-b401-b7a49b5591f2</td>\n",
       "      <td>clueweb09-en0131-21-45225</td>\n",
       "      <td>&lt;urn:uuid:4e03d0c8-1bab-49de-996b-800a824bfa35&gt;</td>\n",
       "      <td>clueweb09</td>\n",
       "      <td>None</td>\n",
       "      <td>www.hello-world.com</td>\n",
       "      <td>...</td>\n",
       "      <td>89.0</td>\n",
       "      <td>&lt;em&gt;Hello&lt;/em&gt;-&lt;em&gt;World&lt;/em&gt;</td>\n",
       "      <td>Hello-World</td>\n",
       "      <td>&lt;em&gt;hello&lt;/em&gt;-world.com\\nPrivacy\\nPolicy\\n\\nS...</td>\n",
       "      <td>hello-world.com\\nPrivacy\\nPolicy\\n\\nSite map\\n...</td>\n",
       "      <td>ExplanationResponse(value=1723.9354, descripti...</td>\n",
       "      <td>&lt;script language=\"JavaScript\" type=\"text/javas...</td>\n",
       "      <td>text/html</td>\n",
       "      <td>en</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>1</td>\n",
       "      <td>hello world</td>\n",
       "      <td>clueweb09-en0093-86-02663</td>\n",
       "      <td>1723.9124</td>\n",
       "      <td>a680f847-1341-50ea-8ec0-247003ddf4f1</td>\n",
       "      <td>clueweb09-en0093-86-02663</td>\n",
       "      <td>&lt;urn:uuid:8587d135-17e6-47fb-bf56-c11123a84ce5&gt;</td>\n",
       "      <td>clueweb09</td>\n",
       "      <td>None</td>\n",
       "      <td>www.hello-world.com</td>\n",
       "      <td>...</td>\n",
       "      <td>90.0</td>\n",
       "      <td>&lt;em&gt;Hello&lt;/em&gt;-&lt;em&gt;World&lt;/em&gt;</td>\n",
       "      <td>Hello-World</td>\n",
       "      <td>&lt;em&gt;hello&lt;/em&gt;-world.com\\nPrivacy\\nPolicy\\n\\nS...</td>\n",
       "      <td>hello-world.com\\nPrivacy\\nPolicy\\n\\nSite map\\n...</td>\n",
       "      <td>ExplanationResponse(value=1723.9124, descripti...</td>\n",
       "      <td>&lt;script language=\"JavaScript\" type=\"text/javas...</td>\n",
       "      <td>text/html</td>\n",
       "      <td>en</td>\n",
       "      <td>6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>1</td>\n",
       "      <td>hello world</td>\n",
       "      <td>clueweb09-en0065-57-00437</td>\n",
       "      <td>1723.5857</td>\n",
       "      <td>31503fe7-6d31-5882-b527-ed80ec4c965f</td>\n",
       "      <td>clueweb09-en0065-57-00437</td>\n",
       "      <td>&lt;urn:uuid:3e0e1b2c-5dbc-40f5-893c-402af83d5680&gt;</td>\n",
       "      <td>clueweb09</td>\n",
       "      <td>None</td>\n",
       "      <td>www.hello-world.com</td>\n",
       "      <td>...</td>\n",
       "      <td>90.0</td>\n",
       "      <td>&lt;em&gt;Hello&lt;/em&gt;-&lt;em&gt;World&lt;/em&gt;</td>\n",
       "      <td>Hello-World</td>\n",
       "      <td>&lt;em&gt;hello&lt;/em&gt;-world.com\\nPrivacy\\nPolicy\\n\\nS...</td>\n",
       "      <td>hello-world.com\\nPrivacy\\nPolicy\\n\\nSite map\\n...</td>\n",
       "      <td>ExplanationResponse(value=1723.5857, descripti...</td>\n",
       "      <td>&lt;script language=\"JavaScript\" type=\"text/javas...</td>\n",
       "      <td>text/html</td>\n",
       "      <td>en</td>\n",
       "      <td>7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>1</td>\n",
       "      <td>hello world</td>\n",
       "      <td>clueweb09-en0079-85-26381</td>\n",
       "      <td>1722.1890</td>\n",
       "      <td>4bcb4eb7-daf8-5c19-af77-a965cb4b6336</td>\n",
       "      <td>clueweb09-en0079-85-26381</td>\n",
       "      <td>&lt;urn:uuid:a14a84ff-788b-4b7b-8489-c5900d3789b3&gt;</td>\n",
       "      <td>clueweb09</td>\n",
       "      <td>None</td>\n",
       "      <td>www.hello-world.com</td>\n",
       "      <td>...</td>\n",
       "      <td>91.0</td>\n",
       "      <td>&lt;em&gt;Hello&lt;/em&gt;-&lt;em&gt;World&lt;/em&gt;</td>\n",
       "      <td>Hello-World</td>\n",
       "      <td>&lt;em&gt;hello&lt;/em&gt;-world.com\\nPrivacy\\nPolicy\\n\\nS...</td>\n",
       "      <td>hello-world.com\\nPrivacy\\nPolicy\\n\\nSite map\\n...</td>\n",
       "      <td>ExplanationResponse(value=1722.189, descriptio...</td>\n",
       "      <td>&lt;script language=\"JavaScript\" type=\"text/javas...</td>\n",
       "      <td>text/html</td>\n",
       "      <td>en</td>\n",
       "      <td>8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>1</td>\n",
       "      <td>hello world</td>\n",
       "      <td>clueweb09-en0085-23-19833</td>\n",
       "      <td>1721.4601</td>\n",
       "      <td>8339cebc-7197-5058-ad45-f4ca6b719f57</td>\n",
       "      <td>clueweb09-en0085-23-19833</td>\n",
       "      <td>&lt;urn:uuid:f10b0cd7-c20d-4373-b140-37a2bf0e6d1c&gt;</td>\n",
       "      <td>clueweb09</td>\n",
       "      <td>None</td>\n",
       "      <td>beige.ucs.indiana.edu</td>\n",
       "      <td>...</td>\n",
       "      <td>69.0</td>\n",
       "      <td>&lt;em&gt;Hello&lt;/em&gt; &lt;em&gt;World&lt;/em&gt;</td>\n",
       "      <td>Hello World</td>\n",
       "      <td>: &lt;em&gt;hello&lt;/em&gt; &lt;em&gt;world&lt;/em&gt; from process 3...</td>\n",
       "      <td>: hello world from process 3 of 8\\n       bc34...</td>\n",
       "      <td>ExplanationResponse(value=1721.4601, descripti...</td>\n",
       "      <td>&lt;!DOCTYPE HTML PUBLIC \"-//W3C//DTD HTML 3.2 Fi...</td>\n",
       "      <td>text/html</td>\n",
       "      <td>en</td>\n",
       "      <td>9</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>10 rows × 23 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "  qid        query                      docno      score  \\\n",
       "0   1  hello world  clueweb09-en0008-79-32496  1796.4073   \n",
       "1   1  hello world  clueweb09-en0002-41-30760  1742.4870   \n",
       "2   1  hello world  clueweb09-en0049-23-18105  1741.3336   \n",
       "3   1  hello world  clueweb09-en0077-14-04758  1736.9447   \n",
       "4   1  hello world  clueweb09-en0031-56-17080  1724.4045   \n",
       "5   1  hello world  clueweb09-en0131-21-45225  1723.9354   \n",
       "6   1  hello world  clueweb09-en0093-86-02663  1723.9124   \n",
       "7   1  hello world  clueweb09-en0065-57-00437  1723.5857   \n",
       "8   1  hello world  clueweb09-en0079-85-26381  1722.1890   \n",
       "9   1  hello world  clueweb09-en0085-23-19833  1721.4601   \n",
       "\n",
       "                                   uuid                    trec_id  \\\n",
       "0  bb3fd98f-8d8a-5e40-99f0-1716cba4b8f6  clueweb09-en0008-79-32496   \n",
       "1  df90b151-92d7-5968-b11b-5fbd2a45400f  clueweb09-en0002-41-30760   \n",
       "2  70846a1d-9ae8-52f9-9263-ed48bf3bbac0  clueweb09-en0049-23-18105   \n",
       "3  64644656-27d4-51d8-8cba-2fdbd9f6bec4  clueweb09-en0077-14-04758   \n",
       "4  f3db927d-db79-59d9-a72d-fd0dabb1c7fe  clueweb09-en0031-56-17080   \n",
       "5  498047a3-c208-559b-b401-b7a49b5591f2  clueweb09-en0131-21-45225   \n",
       "6  a680f847-1341-50ea-8ec0-247003ddf4f1  clueweb09-en0093-86-02663   \n",
       "7  31503fe7-6d31-5882-b527-ed80ec4c965f  clueweb09-en0065-57-00437   \n",
       "8  4bcb4eb7-daf8-5c19-af77-a965cb4b6336  clueweb09-en0079-85-26381   \n",
       "9  8339cebc-7197-5058-ad45-f4ca6b719f57  clueweb09-en0085-23-19833   \n",
       "\n",
       "                                           warc_id      index crawl_date  \\\n",
       "0  <urn:uuid:01e34120-69c5-4d0d-ba00-5fb153faf434>  clueweb09       None   \n",
       "1  <urn:uuid:33b06517-adbb-4734-a6ed-4356e1831e87>  clueweb09       None   \n",
       "2  <urn:uuid:15a9e3e8-5a91-49fd-8272-aeb87b86a699>  clueweb09       None   \n",
       "3  <urn:uuid:b0d9c3ea-6faf-4fd9-aa66-5ca01d6436d4>  clueweb09       None   \n",
       "4  <urn:uuid:fdefa2c1-5377-4c6b-bec7-43726d6560e6>  clueweb09       None   \n",
       "5  <urn:uuid:4e03d0c8-1bab-49de-996b-800a824bfa35>  clueweb09       None   \n",
       "6  <urn:uuid:8587d135-17e6-47fb-bf56-c11123a84ce5>  clueweb09       None   \n",
       "7  <urn:uuid:3e0e1b2c-5dbc-40f5-893c-402af83d5680>  clueweb09       None   \n",
       "8  <urn:uuid:a14a84ff-788b-4b7b-8489-c5900d3789b3>  clueweb09       None   \n",
       "9  <urn:uuid:f10b0cd7-c20d-4373-b140-37a2bf0e6d1c>  clueweb09       None   \n",
       "\n",
       "          target_hostname  ... spam_rank  \\\n",
       "0   www.knowledgerush.com  ...      74.0   \n",
       "1          ruby.about.com  ...      97.0   \n",
       "2  www.csse.monash.edu.au  ...      86.0   \n",
       "3        www.allisons.org  ...      88.0   \n",
       "4    jist.ece.cornell.edu  ...      89.0   \n",
       "5     www.hello-world.com  ...      89.0   \n",
       "6     www.hello-world.com  ...      90.0   \n",
       "7     www.hello-world.com  ...      90.0   \n",
       "8     www.hello-world.com  ...      91.0   \n",
       "9   beige.ucs.indiana.edu  ...      69.0   \n",
       "\n",
       "                                   title_highlighted  \\\n",
       "0  <em>Hello</em> <em>World</em>. Who is <em>Hell...   \n",
       "1                      <em>Hello</em> <em>World</em>   \n",
       "2                      <em>Hello</em> <em>world</em>   \n",
       "3                      <em>Hello</em> <em>world</em>   \n",
       "4                      <em>Hello</em> <em>world</em>   \n",
       "5                      <em>Hello</em>-<em>World</em>   \n",
       "6                      <em>Hello</em>-<em>World</em>   \n",
       "7                      <em>Hello</em>-<em>World</em>   \n",
       "8                      <em>Hello</em>-<em>World</em>   \n",
       "9                      <em>Hello</em> <em>World</em>   \n",
       "\n",
       "                                          title_text  \\\n",
       "0  Hello World. Who is Hello World? What is Hello...   \n",
       "1                                        Hello World   \n",
       "2                                        Hello world   \n",
       "3                                        Hello world   \n",
       "4                                        Hello world   \n",
       "5                                        Hello-World   \n",
       "6                                        Hello-World   \n",
       "7                                        Hello-World   \n",
       "8                                        Hello-World   \n",
       "9                                        Hello World   \n",
       "\n",
       "                                 snippet_highlighted  \\\n",
       "0  *&#x2F;<em>Hello</em>, <em>world</em>!&#x2F;p&...   \n",
       "1  Ruby\\n\\n  Home\\n  Computing &amp; Technology\\n...   \n",
       "2  <em>Hello</em> <em>world</em>\\n\\nLA home\\nFP\\n...   \n",
       "3  <em>Hello</em> <em>world</em>\\n\\nLA home\\nComp...   \n",
       "4  However, executing the same application under ...   \n",
       "5  <em>hello</em>-world.com\\nPrivacy\\nPolicy\\n\\nS...   \n",
       "6  <em>hello</em>-world.com\\nPrivacy\\nPolicy\\n\\nS...   \n",
       "7  <em>hello</em>-world.com\\nPrivacy\\nPolicy\\n\\nS...   \n",
       "8  <em>hello</em>-world.com\\nPrivacy\\nPolicy\\n\\nS...   \n",
       "9  : <em>hello</em> <em>world</em> from process 3...   \n",
       "\n",
       "                                        snippet_text  \\\n",
       "0  */Hello, world!/p'\\n\\nSelf\\n\\n'Hello, World!' ...   \n",
       "1  Ruby\\n\\n  Home\\n  Computing & Technology\\n  Ru...   \n",
       "2  Hello world\\n\\nLA home\\nFP\\n Haskell\\n  Haskel...   \n",
       "3  Hello world\\n\\nLA home\\nComputing\\nFP\\n Haskel...   \n",
       "4  However, executing the same application under ...   \n",
       "5  hello-world.com\\nPrivacy\\nPolicy\\n\\nSite map\\n...   \n",
       "6  hello-world.com\\nPrivacy\\nPolicy\\n\\nSite map\\n...   \n",
       "7  hello-world.com\\nPrivacy\\nPolicy\\n\\nSite map\\n...   \n",
       "8  hello-world.com\\nPrivacy\\nPolicy\\n\\nSite map\\n...   \n",
       "9  : hello world from process 3 of 8\\n       bc34...   \n",
       "\n",
       "                                         explanation  \\\n",
       "0  ExplanationResponse(value=1796.4073, descripti...   \n",
       "1  ExplanationResponse(value=1742.487, descriptio...   \n",
       "2  ExplanationResponse(value=1741.3336, descripti...   \n",
       "3  ExplanationResponse(value=1736.9447, descripti...   \n",
       "4  ExplanationResponse(value=1724.4045, descripti...   \n",
       "5  ExplanationResponse(value=1723.9354, descripti...   \n",
       "6  ExplanationResponse(value=1723.9124, descripti...   \n",
       "7  ExplanationResponse(value=1723.5857, descripti...   \n",
       "8  ExplanationResponse(value=1722.189, descriptio...   \n",
       "9  ExplanationResponse(value=1721.4601, descripti...   \n",
       "\n",
       "                                                html html_plain language rank  \n",
       "0  \\n\\n\\n\\n\\n\\n\\n\\n\\n<html>\\n<head>\\n<meta http-e...  text/html       en    0  \n",
       "1  <!DOCTYPE html PUBLIC \"-//W3C//DTD HTML 4.01 T...  text/html       en    1  \n",
       "2  <!DOCTYPE HTML PUBLIC \"-//W3C//DTD HTML 3.2//E...  text/html       en    2  \n",
       "3  <!DOCTYPE HTML PUBLIC \"-//W3C//DTD HTML 3.2//E...  text/html       en    3  \n",
       "4  <!DOCTYPE HTML PUBLIC \"-//W3C//DTD HTML 3.2 Fi...  text/html       en    4  \n",
       "5  <script language=\"JavaScript\" type=\"text/javas...  text/html       en    5  \n",
       "6  <script language=\"JavaScript\" type=\"text/javas...  text/html       en    6  \n",
       "7  <script language=\"JavaScript\" type=\"text/javas...  text/html       en    7  \n",
       "8  <script language=\"JavaScript\" type=\"text/javas...  text/html       en    8  \n",
       "9  <!DOCTYPE HTML PUBLIC \"-//W3C//DTD HTML 3.2 Fi...  text/html       en    9  \n",
       "\n",
       "[10 rows x 23 columns]"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from chatnoir_pyterrier.retrieve import ChatNoirRetrieve, Feature\n",
    "\n",
    "chatnoir_all = ChatNoirRetrieve(features=Feature.ALL, verbose=True)\n",
    "chatnoir_all.search(\"hello world\")"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": ".venv",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.12.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}