2_GoldstandardDataPreparation.ipynb

{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "strip_number_digits = True"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Goldstandard and Data Preparation"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Swissbib's goldstandard is a set of pre-defined records used for testing their implemented logic of identifying duplicate and unique records, see [[JudACaps](./A_References.ipynb#judacaps)]. The Swissbib project team has processed the goldstandard data into a data extract with the help of a scala implementation [[ScalRepo](./A_References.ipynb#scala_repo)]. This chapter of the capstone project loads the data records of the goldstandard and processes it with the goal to make it ready for its transformation into the feature matrix for the machine learning models."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The goal of this chapter will be achieved, when having a DataFrame with rows of pairs of records of the goldstandard that represent pairs of duplicates or pairs of uniques, respectively. Each row has to be marked with a flag indicating whether the row is a pair of duplicates or a pair of uniques. This flag will be separated to the target for training and performance testing of the machine learning models. See [[JudACaps](./A_References.ipynb#judacaps)] for the basic explanation of the process."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Table of Contents\n",
    "\n",
    "- [Metadata Takeover](#Metadata-Takeover)\n",
    "- [Description of Swissbib's Goldstandard](#Description-of-Swissbib's-Goldstandard)\n",
    "    - [Sample Records of a Goldstandard Example](#Sample-Records-of-a-Goldstandard-Example)\n",
    "    - [Generating Pairs of Duplicates](#Generating-Pairs-of-Duplicates)\n",
    "    - [Generating Pairs of Uniques](#Generating-Pairs-of-Uniques)\n",
    "- [Transform Attributes for Similarity Comparison](#Transform-Attributes-for-Similarity-Comparison)\n",
    "    - [ismn](#ismn)\n",
    "- [Build Pairs of Duplicates](#Build-Pairs-of-Duplicates)\n",
    "    - [Slaves Masters Relationships](#Slaves-Masters-Relationships)\n",
    "    - [Duplicates Rows Generation](#Duplicates-Rows-Generation)\n",
    "- [Build Pairs of Uniques](#Build-Pairs-of-Uniques)\n",
    "    - [Masters Uniques Relationships](#Masters-Uniques-Relationships)\n",
    "    - [Uniques Rows Generation](#Uniques-Rows-Generation)\n",
    "- [Build Feature Base](#Build-Feature-Base)\n",
    "- [Summary](#Summary)\n",
    "    - [Goldstandard DataFrame Handover](#Goldstandard-DataFrame-Handover)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Metadata Takeover"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The analysis of Swissbib's raw data has led to a decision on each attribute, whether to process it into the feature matrix. The decision has been consolidated into a dictionary of metadata as a result of chapter [Data Analysis](./1_DataAnalysis.ipynb). This metadata is needed for processing the goldstandard and will be loaded as a first step."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "import os\n",
    "import pickle as pk\n",
    "\n",
    "path_goldstandard = './daten_goldstandard'\n",
    "\n",
    "# Restore metadata so far\n",
    "with open(os.path.join(path_goldstandard, 'columns_metadata.pkl'), 'rb') as handle:\n",
    "    columns_metadata_dict = pk.load(handle)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "data_analysis_columns \n",
      " ['coordinate_E', 'coordinate_N', 'corporate_full', 'doi', 'edition', 'exactDate', 'format_prefix', 'format_postfix', 'isbn', 'ismn', 'musicid', 'part', 'person_100', 'person_700', 'person_245c', 'pubinit', 'scale', 'ttlfull_245', 'ttlfull_246', 'volumes'] \n",
      "\n"
     ]
    }
   ],
   "source": [
    "for k in columns_metadata_dict.keys():\n",
    "    print(k, '\\n', columns_metadata_dict[k], '\\n')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Description of Swissbib's Goldstandard"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Swissbib's goldstandard is a fix set of pre-defined data that has been processed into three distinct .json files [[ScalRepo](./A_References.ipynb#scala_repo)].\n",
    "\n",
    "- $\\texttt{slave.json}$ - This data file holds the original duplicated records that are being merged into a master record.\n",
    "- $\\texttt{master.json}$ - This data file holds the unique master records that are formed out of its records in file $\\texttt{slave.json}$.\n",
    "- $\\texttt{unique.json}$ - This data file holds records with similar data as in $\\texttt{slave.json}$ and $\\texttt{master.json}$, but records that are correctly being identified as unique records and not as a duplicate record of any record in $\\texttt{slave.json}$.\n",
    "\n",
    "This section starts with loading the goldstandard data into a separate DataFrame for each set. Afterwards, the data will be analysed and explained."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Number of records in data file slave.json\t435\n",
      "Number of records in data file master.json\t159\n",
      "Number of records in data file unique.json\t596\n"
     ]
    }
   ],
   "source": [
    "import json\n",
    "\n",
    "records_slave, records_master, records_unique = [], [], []\n",
    "file_slave, file_master, file_unique = 'slave.json', 'master.json', 'unique.json'\n",
    "\n",
    "for line in open(os.path.join(path_goldstandard, file_slave), 'r'):\n",
    "    records_slave.append(json.loads(line))\n",
    "for line in open(os.path.join(path_goldstandard, file_master), 'r'):\n",
    "    records_master.append(json.loads(line))\n",
    "for line in open(os.path.join(path_goldstandard, file_unique), 'r'):\n",
    "    records_unique.append(json.loads(line))\n",
    "\n",
    "print('Number of records in data file {:s}\\t{:d}'.format(file_slave, len(records_slave)))\n",
    "print('Number of records in data file {:s}\\t{:d}'.format(file_master, len(records_master)))\n",
    "print('Number of records in data file {:s}\\t{:d}'.format(file_unique, len(records_unique)))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>docid</th>\n",
       "      <th>035liste</th>\n",
       "      <th>isbn</th>\n",
       "      <th>ttlfull</th>\n",
       "      <th>ttlpart</th>\n",
       "      <th>person</th>\n",
       "      <th>corporate</th>\n",
       "      <th>pubyear</th>\n",
       "      <th>decade</th>\n",
       "      <th>century</th>\n",
       "      <th>exactDate</th>\n",
       "      <th>edition</th>\n",
       "      <th>part</th>\n",
       "      <th>pages</th>\n",
       "      <th>volumes</th>\n",
       "      <th>pubinit</th>\n",
       "      <th>pubword</th>\n",
       "      <th>scale</th>\n",
       "      <th>coordinate</th>\n",
       "      <th>doi</th>\n",
       "      <th>ismn</th>\n",
       "      <th>musicid</th>\n",
       "      <th>format</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>000311049</td>\n",
       "      <td>[(OCoLC)731635279, (ABN)000539983]</td>\n",
       "      <td>[978-3-15-020008-7]</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['GraweChristia...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td></td>\n",
       "      <td>[20008]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[Reclam jun.]</td>\n",
       "      <td>[Reclam jun.]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>00130724X</td>\n",
       "      <td>[(OCoLC)808324878, (ABN)000155059]</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Die Zauberflöte', 'Oper in zwei Aufz...</td>\n",
       "      <td>{'245': ['Die Zauberflöte', 'Oper in zwei Aufz...</td>\n",
       "      <td>{'100': ['LevineJamesDir.'], '700': ['MozartWo...</td>\n",
       "      <td>{'110': [], '710': ['Metropolitan Opera Orches...</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[1 DVD-Video, DVD Region 0, 169 Min., farb.]</td>\n",
       "      <td>[1 DVD-Video, DVD Region 0, 169 Min., farb.]</td>\n",
       "      <td>[Deutsche Grammophon]</td>\n",
       "      <td>[Deutsche Grammophon]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[VM010300]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>001817272</td>\n",
       "      <td>[(OCoLC)231772550, (ABN)000096920]</td>\n",
       "      <td>[3-495-47879-5]</td>\n",
       "      <td>{'245': ['Der moralische Status der Tiere', 'H...</td>\n",
       "      <td>{'245': ['Der moralische Status der Tiere', 'H...</td>\n",
       "      <td>{'100': ['FluryAndreas'], '700': [], '800': []...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1999</td>\n",
       "      <td>1999</td>\n",
       "      <td>1999</td>\n",
       "      <td>1999</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[316 S.]</td>\n",
       "      <td>[316 S.]</td>\n",
       "      <td>[Alber]</td>\n",
       "      <td>[Alber]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>00236865X</td>\n",
       "      <td>[(OCoLC)887157168, (ABN)000223912]</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Die Zauberflöte']}</td>\n",
       "      <td>{'245': ['Die Zauberflöte']}</td>\n",
       "      <td>{'100': ['MozartWolfgang Amadeus'], '700': [],...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>uuuuuuuu</td>\n",
       "      <td>uuuu</td>\n",
       "      <td>uuuu</td>\n",
       "      <td>uuuuuuuu</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[412 S.]</td>\n",
       "      <td>[412 S.]</td>\n",
       "      <td>[Ernst Eulenburg]</td>\n",
       "      <td>[Ernst Eulenburg]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>00351031X</td>\n",
       "      <td>[(OCoLC)887324690, (ABN)000548154]</td>\n",
       "      <td>[978-1-4058-8214-9]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['StrangeJoanna...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[64 S.]</td>\n",
       "      <td>[64 S.]</td>\n",
       "      <td>[Pearson Education]</td>\n",
       "      <td>[Pearson Education]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "       docid                            035liste                 isbn  \\\n",
       "0  000311049  [(OCoLC)731635279, (ABN)000539983]  [978-3-15-020008-7]   \n",
       "1  00130724X  [(OCoLC)808324878, (ABN)000155059]                   []   \n",
       "2  001817272  [(OCoLC)231772550, (ABN)000096920]      [3-495-47879-5]   \n",
       "3  00236865X  [(OCoLC)887157168, (ABN)000223912]                   []   \n",
       "4  00351031X  [(OCoLC)887324690, (ABN)000548154]  [978-1-4058-8214-9]   \n",
       "\n",
       "                                             ttlfull  \\\n",
       "0                         {'245': ['Emma', 'Roman']}   \n",
       "1  {'245': ['Die Zauberflöte', 'Oper in zwei Aufz...   \n",
       "2  {'245': ['Der moralische Status der Tiere', 'H...   \n",
       "3                       {'245': ['Die Zauberflöte']}   \n",
       "4                                  {'245': ['Emma']}   \n",
       "\n",
       "                                             ttlpart  \\\n",
       "0                         {'245': ['Emma', 'Roman']}   \n",
       "1  {'245': ['Die Zauberflöte', 'Oper in zwei Aufz...   \n",
       "2  {'245': ['Der moralische Status der Tiere', 'H...   \n",
       "3                       {'245': ['Die Zauberflöte']}   \n",
       "4                                  {'245': ['Emma']}   \n",
       "\n",
       "                                              person  \\\n",
       "0  {'100': ['AustenJane'], '700': ['GraweChristia...   \n",
       "1  {'100': ['LevineJamesDir.'], '700': ['MozartWo...   \n",
       "2  {'100': ['FluryAndreas'], '700': [], '800': []...   \n",
       "3  {'100': ['MozartWolfgang Amadeus'], '700': [],...   \n",
       "4  {'100': ['AustenJane'], '700': ['StrangeJoanna...   \n",
       "\n",
       "                                           corporate   pubyear decade century  \\\n",
       "0                  {'110': [], '710': [], '810': []}  2009       2009    2009   \n",
       "1  {'110': [], '710': ['Metropolitan Opera Orches...  2000       2000    2000   \n",
       "2                  {'110': [], '710': [], '810': []}  1999       1999    1999   \n",
       "3                  {'110': [], '710': [], '810': []}  uuuuuuuu   uuuu    uuuu   \n",
       "4                  {'110': [], '710': [], '810': []}  2008       2008    2008   \n",
       "\n",
       "  exactDate edition     part                                         pages  \\\n",
       "0  2009              [20008]                                      [600 S.]   \n",
       "1  2000                   []  [1 DVD-Video, DVD Region 0, 169 Min., farb.]   \n",
       "2  1999                   []                                      [316 S.]   \n",
       "3  uuuuuuuu               []                                      [412 S.]   \n",
       "4  2008                   []                                       [64 S.]   \n",
       "\n",
       "                                        volumes                pubinit  \\\n",
       "0                                      [600 S.]          [Reclam jun.]   \n",
       "1  [1 DVD-Video, DVD Region 0, 169 Min., farb.]  [Deutsche Grammophon]   \n",
       "2                                      [316 S.]                [Alber]   \n",
       "3                                      [412 S.]      [Ernst Eulenburg]   \n",
       "4                                       [64 S.]    [Pearson Education]   \n",
       "\n",
       "                 pubword scale coordinate doi ismn musicid      format  \n",
       "0          [Reclam jun.]               []  []   []          [BK020000]  \n",
       "1  [Deutsche Grammophon]               []  []   []          [VM010300]  \n",
       "2                [Alber]               []  []   []          [BK020000]  \n",
       "3      [Ernst Eulenburg]               []  []   []          [BK020000]  \n",
       "4    [Pearson Education]               []  []   []          [BK020000]  "
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import pandas as pd\n",
    "\n",
    "goldstandard = {}\n",
    "\n",
    "goldstandard['slaves'] = pd.DataFrame(records_slave)\n",
    "goldstandard['masters'] = pd.DataFrame(records_master)\n",
    "goldstandard['uniques'] = pd.DataFrame(records_unique)\n",
    "\n",
    "# Extend display to number of columns of DataFrame\n",
    "pd.options.display.max_columns = len(goldstandard['slaves'].columns)\n",
    "\n",
    "goldstandard['slaves'].head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The three files of the goldstandard will be used for training and testing the performance of the machine learning models of the capstone project. Combining the records of file $\\texttt{slave.json}$ into pairs will generate a set of duplicate pair records that will be used for training data. Combining the records of file $\\texttt{slave.json}$ with file $\\texttt{unique.json}$ will generate a set of unique pair records that will be used for training data."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Sample Records of a Goldstandard Example"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's have a rough look at an example in the goldstandard data. All records of all three $\\texttt{.json}$ files with string 'Emma' in attribute $\\texttt{ttlfull}$ shall be taken as example."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>docid</th>\n",
       "      <th>035liste</th>\n",
       "      <th>isbn</th>\n",
       "      <th>ttlfull</th>\n",
       "      <th>ttlpart</th>\n",
       "      <th>person</th>\n",
       "      <th>corporate</th>\n",
       "      <th>pubyear</th>\n",
       "      <th>decade</th>\n",
       "      <th>century</th>\n",
       "      <th>exactDate</th>\n",
       "      <th>edition</th>\n",
       "      <th>part</th>\n",
       "      <th>pages</th>\n",
       "      <th>volumes</th>\n",
       "      <th>pubinit</th>\n",
       "      <th>pubword</th>\n",
       "      <th>scale</th>\n",
       "      <th>coordinate</th>\n",
       "      <th>doi</th>\n",
       "      <th>ismn</th>\n",
       "      <th>musicid</th>\n",
       "      <th>format</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>000311049</td>\n",
       "      <td>[(OCoLC)731635279, (ABN)000539983]</td>\n",
       "      <td>[978-3-15-020008-7]</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['GraweChristia...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td></td>\n",
       "      <td>[20008]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[Reclam jun.]</td>\n",
       "      <td>[Reclam jun.]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>00351031X</td>\n",
       "      <td>[(OCoLC)887324690, (ABN)000548154]</td>\n",
       "      <td>[978-1-4058-8214-9]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['StrangeJoanna...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[64 S.]</td>\n",
       "      <td>[64 S.]</td>\n",
       "      <td>[Pearson Education]</td>\n",
       "      <td>[Pearson Education]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>017959411</td>\n",
       "      <td>[(OCoLC)636062037, (BGR)000409509]</td>\n",
       "      <td>[978-1-4058-7953-8 (CD Pack), 978-1-4058-8214-...</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['BarnesAnnette...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[64 S.]</td>\n",
       "      <td>[64 S.]</td>\n",
       "      <td>[Pearson Education Ltd.]</td>\n",
       "      <td>[Pearson Education Ltd.]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>020155182</td>\n",
       "      <td>[(OCoLC)218626148, (BGR)000463276]</td>\n",
       "      <td>[978-0-521-82437-8, 0-521-82437-0]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['CroninRichard...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[Cambridge University Press]</td>\n",
       "      <td>[Cambridge University Press]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>022315098</td>\n",
       "      <td>[(OCoLC)218626148, (IDSLU)000449481]</td>\n",
       "      <td>[0-521-82437-0]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[599 S.]</td>\n",
       "      <td>[599 S.]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>51</th>\n",
       "      <td>035554215</td>\n",
       "      <td>[(OCoLC)218626148, (IDSSG)000338145]</td>\n",
       "      <td>[978-0-521-82437-8, 0-521-82437-0]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['CroninRichard...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>77</th>\n",
       "      <td>055836801</td>\n",
       "      <td>[(OCoLC)495204467, (SGBN)001068279, (OCoLC)495...</td>\n",
       "      <td>[978-1-4058-8214-9 (br), 1-4058-8214-X (br)]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['BarnesAnnette...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[64 S.]</td>\n",
       "      <td>[64 S.]</td>\n",
       "      <td>[Pearson Education]</td>\n",
       "      <td>[Pearson Education]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>109</th>\n",
       "      <td>103342699</td>\n",
       "      <td>[(OCoLC)263554860, (IDSBB)001470548]</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1979</td>\n",
       "      <td>1979</td>\n",
       "      <td>1979</td>\n",
       "      <td>1979</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[549 S.]</td>\n",
       "      <td>[549 S.]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>130</th>\n",
       "      <td>117574562</td>\n",
       "      <td>[(OCoLC)218626148, (IDSBB)003781869]</td>\n",
       "      <td>[0-521-82437-0]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['CroninRichard...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>160</th>\n",
       "      <td>161169244</td>\n",
       "      <td>[(OCoLC)218626148, (NEBIS)004930649]</td>\n",
       "      <td>[978-0-521-82437-8, 0-521-82437-0]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['CroninRichard...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[Cambridge University Press]</td>\n",
       "      <td>[Cambridge University Press]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>170</th>\n",
       "      <td>167723502</td>\n",
       "      <td>[(OCoLC)636062037, (NEBIS)005724810]</td>\n",
       "      <td>[978-1-4058-8214-9]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': [], '700': ['AustenJane', 'BarnesAnnet...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[64 S.]</td>\n",
       "      <td>[64 S.]</td>\n",
       "      <td>[Pearson Education]</td>\n",
       "      <td>[Pearson Education]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>179</th>\n",
       "      <td>190194553</td>\n",
       "      <td>[(OCoLC)632335304, (NEBIS)008647887]</td>\n",
       "      <td>[0-375-75742-2]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2001</td>\n",
       "      <td>2001</td>\n",
       "      <td>2001</td>\n",
       "      <td>2001</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[359 S.]</td>\n",
       "      <td>[359 S.]</td>\n",
       "      <td>[Modern Library]</td>\n",
       "      <td>[Modern Library]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>187</th>\n",
       "      <td>196506476</td>\n",
       "      <td>[(OCoLC)731635279, (NEBIS)009587153]</td>\n",
       "      <td>[978-3-15-020008-7]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td></td>\n",
       "      <td>[20008]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[Reclam]</td>\n",
       "      <td>[Reclam]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>229</th>\n",
       "      <td>233497366</td>\n",
       "      <td>[(RERO)R003971490]</td>\n",
       "      <td>[0-521-82437-0]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['CroninRichard...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[LXXVII, 600 p.]</td>\n",
       "      <td>[LXXVII, 600 p.]</td>\n",
       "      <td>[Cambridge Univ. Press]</td>\n",
       "      <td>[Cambridge Univ. Press]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>276</th>\n",
       "      <td>323173349</td>\n",
       "      <td>[(OCoLC)731635279, (LIBIB)000315536]</td>\n",
       "      <td>[978-3-15-020008-7]</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td></td>\n",
       "      <td>[20008]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[Reclam]</td>\n",
       "      <td>[Reclam]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>311</th>\n",
       "      <td>356992772</td>\n",
       "      <td>[(SGBN)001344510]</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1979</td>\n",
       "      <td>1979</td>\n",
       "      <td>1979</td>\n",
       "      <td>1979</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[549 S.]</td>\n",
       "      <td>[549 S.]</td>\n",
       "      <td>[Insel Verlag]</td>\n",
       "      <td>[Insel Verlag]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>373</th>\n",
       "      <td>414925408</td>\n",
       "      <td>[(VAUD)991010949619702852, (RNV)003971490-41bc...</td>\n",
       "      <td>[0-521-82437-0]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['CroninRichard...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[LXXVII, 600 p.]</td>\n",
       "      <td>[LXXVII, 600 p.]</td>\n",
       "      <td>[Cambridge Univ. Press]</td>\n",
       "      <td>[Cambridge Univ. Press]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>378</th>\n",
       "      <td>415447542</td>\n",
       "      <td>[(VAUD)991001434509702852, (RNV)003104061-41bc...</td>\n",
       "      <td>[0-375-75742-2]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2001</td>\n",
       "      <td>2001</td>\n",
       "      <td>2001</td>\n",
       "      <td>2001</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[XXII, 359 p.]</td>\n",
       "      <td>[XXII, 359 p.]</td>\n",
       "      <td>[The Modern Library]</td>\n",
       "      <td>[The Modern Library]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "         docid                                           035liste  \\\n",
       "0    000311049                 [(OCoLC)731635279, (ABN)000539983]   \n",
       "4    00351031X                 [(OCoLC)887324690, (ABN)000548154]   \n",
       "17   017959411                 [(OCoLC)636062037, (BGR)000409509]   \n",
       "19   020155182                 [(OCoLC)218626148, (BGR)000463276]   \n",
       "29   022315098               [(OCoLC)218626148, (IDSLU)000449481]   \n",
       "51   035554215               [(OCoLC)218626148, (IDSSG)000338145]   \n",
       "77   055836801  [(OCoLC)495204467, (SGBN)001068279, (OCoLC)495...   \n",
       "109  103342699               [(OCoLC)263554860, (IDSBB)001470548]   \n",
       "130  117574562               [(OCoLC)218626148, (IDSBB)003781869]   \n",
       "160  161169244               [(OCoLC)218626148, (NEBIS)004930649]   \n",
       "170  167723502               [(OCoLC)636062037, (NEBIS)005724810]   \n",
       "179  190194553               [(OCoLC)632335304, (NEBIS)008647887]   \n",
       "187  196506476               [(OCoLC)731635279, (NEBIS)009587153]   \n",
       "229  233497366                                 [(RERO)R003971490]   \n",
       "276  323173349               [(OCoLC)731635279, (LIBIB)000315536]   \n",
       "311  356992772                                  [(SGBN)001344510]   \n",
       "373  414925408  [(VAUD)991010949619702852, (RNV)003971490-41bc...   \n",
       "378  415447542  [(VAUD)991001434509702852, (RNV)003104061-41bc...   \n",
       "\n",
       "                                                  isbn  \\\n",
       "0                                  [978-3-15-020008-7]   \n",
       "4                                  [978-1-4058-8214-9]   \n",
       "17   [978-1-4058-7953-8 (CD Pack), 978-1-4058-8214-...   \n",
       "19                  [978-0-521-82437-8, 0-521-82437-0]   \n",
       "29                                     [0-521-82437-0]   \n",
       "51                  [978-0-521-82437-8, 0-521-82437-0]   \n",
       "77        [978-1-4058-8214-9 (br), 1-4058-8214-X (br)]   \n",
       "109                                                 []   \n",
       "130                                    [0-521-82437-0]   \n",
       "160                 [978-0-521-82437-8, 0-521-82437-0]   \n",
       "170                                [978-1-4058-8214-9]   \n",
       "179                                    [0-375-75742-2]   \n",
       "187                                [978-3-15-020008-7]   \n",
       "229                                    [0-521-82437-0]   \n",
       "276                                [978-3-15-020008-7]   \n",
       "311                                                 []   \n",
       "373                                    [0-521-82437-0]   \n",
       "378                                    [0-375-75742-2]   \n",
       "\n",
       "                        ttlfull                     ttlpart  \\\n",
       "0    {'245': ['Emma', 'Roman']}  {'245': ['Emma', 'Roman']}   \n",
       "4             {'245': ['Emma']}           {'245': ['Emma']}   \n",
       "17            {'245': ['Emma']}           {'245': ['Emma']}   \n",
       "19            {'245': ['Emma']}           {'245': ['Emma']}   \n",
       "29            {'245': ['Emma']}           {'245': ['Emma']}   \n",
       "51            {'245': ['Emma']}           {'245': ['Emma']}   \n",
       "77            {'245': ['Emma']}           {'245': ['Emma']}   \n",
       "109           {'245': ['Emma']}           {'245': ['Emma']}   \n",
       "130           {'245': ['Emma']}           {'245': ['Emma']}   \n",
       "160           {'245': ['Emma']}           {'245': ['Emma']}   \n",
       "170           {'245': ['Emma']}           {'245': ['Emma']}   \n",
       "179           {'245': ['Emma']}           {'245': ['Emma']}   \n",
       "187           {'245': ['Emma']}           {'245': ['Emma']}   \n",
       "229           {'245': ['Emma']}           {'245': ['Emma']}   \n",
       "276  {'245': ['Emma', 'Roman']}  {'245': ['Emma', 'Roman']}   \n",
       "311           {'245': ['Emma']}           {'245': ['Emma']}   \n",
       "373           {'245': ['Emma']}           {'245': ['Emma']}   \n",
       "378           {'245': ['Emma']}           {'245': ['Emma']}   \n",
       "\n",
       "                                                person  \\\n",
       "0    {'100': ['AustenJane'], '700': ['GraweChristia...   \n",
       "4    {'100': ['AustenJane'], '700': ['StrangeJoanna...   \n",
       "17   {'100': ['AustenJane'], '700': ['BarnesAnnette...   \n",
       "19   {'100': ['AustenJane'], '700': ['CroninRichard...   \n",
       "29   {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "51   {'100': ['AustenJane'], '700': ['CroninRichard...   \n",
       "77   {'100': ['AustenJane'], '700': ['BarnesAnnette...   \n",
       "109  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "130  {'100': ['AustenJane'], '700': ['CroninRichard...   \n",
       "160  {'100': ['AustenJane'], '700': ['CroninRichard...   \n",
       "170  {'100': [], '700': ['AustenJane', 'BarnesAnnet...   \n",
       "179  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "187  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "229  {'100': ['AustenJane'], '700': ['CroninRichard...   \n",
       "276  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "311  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "373  {'100': ['AustenJane'], '700': ['CroninRichard...   \n",
       "378  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "\n",
       "                             corporate   pubyear decade century exactDate  \\\n",
       "0    {'110': [], '710': [], '810': []}  2009       2009    2009  2009       \n",
       "4    {'110': [], '710': [], '810': []}  2008       2008    2008  2008       \n",
       "17   {'110': [], '710': [], '810': []}  2008       2008    2008  2008       \n",
       "19   {'110': [], '710': [], '810': []}  2005       2005    2005  2005       \n",
       "29   {'110': [], '710': [], '810': []}  2005       2005    2005  2005       \n",
       "51   {'110': [], '710': [], '810': []}  2005       2005    2005  2005       \n",
       "77   {'110': [], '710': [], '810': []}  2008       2008    2008  2008       \n",
       "109  {'110': [], '710': [], '810': []}  1979       1979    1979  1979       \n",
       "130  {'110': [], '710': [], '810': []}  2005       2005    2005  2005       \n",
       "160  {'110': [], '710': [], '810': []}  2005       2005    2005  2005       \n",
       "170  {'110': [], '710': [], '810': []}  2008       2008    2008  2008       \n",
       "179  {'110': [], '710': [], '810': []}  2001       2001    2001  2001       \n",
       "187  {'110': [], '710': [], '810': []}  2009       2009    2009  2009       \n",
       "229  {'110': [], '710': [], '810': []}  2005       2005    2005  2005       \n",
       "276  {'110': [], '710': [], '810': []}  2009       2009    2009  2009       \n",
       "311  {'110': [], '710': [], '810': []}  1979       1979    1979  1979       \n",
       "373  {'110': [], '710': [], '810': []}  2005       2005    2005  2005       \n",
       "378  {'110': [], '710': [], '810': []}  2001       2001    2001  2001       \n",
       "\n",
       "    edition     part             pages           volumes  \\\n",
       "0            [20008]          [600 S.]          [600 S.]   \n",
       "4                 []           [64 S.]           [64 S.]   \n",
       "17                []           [64 S.]           [64 S.]   \n",
       "19                []          [600 S.]          [600 S.]   \n",
       "29                []          [599 S.]          [599 S.]   \n",
       "51                []          [600 S.]          [600 S.]   \n",
       "77                []           [64 S.]           [64 S.]   \n",
       "109               []          [549 S.]          [549 S.]   \n",
       "130               []          [600 S.]          [600 S.]   \n",
       "160               []          [600 S.]          [600 S.]   \n",
       "170               []           [64 S.]           [64 S.]   \n",
       "179               []          [359 S.]          [359 S.]   \n",
       "187          [20008]          [600 S.]          [600 S.]   \n",
       "229               []  [LXXVII, 600 p.]  [LXXVII, 600 p.]   \n",
       "276          [20008]          [600 S.]          [600 S.]   \n",
       "311               []          [549 S.]          [549 S.]   \n",
       "373               []  [LXXVII, 600 p.]  [LXXVII, 600 p.]   \n",
       "378               []    [XXII, 359 p.]    [XXII, 359 p.]   \n",
       "\n",
       "                          pubinit                       pubword scale  \\\n",
       "0                   [Reclam jun.]                 [Reclam jun.]         \n",
       "4             [Pearson Education]           [Pearson Education]         \n",
       "17       [Pearson Education Ltd.]      [Pearson Education Ltd.]         \n",
       "19   [Cambridge University Press]  [Cambridge University Press]         \n",
       "29                             []                            []         \n",
       "51                             []                            []         \n",
       "77            [Pearson Education]           [Pearson Education]         \n",
       "109                            []                            []         \n",
       "130                            []                            []         \n",
       "160  [Cambridge University Press]  [Cambridge University Press]         \n",
       "170           [Pearson Education]           [Pearson Education]         \n",
       "179              [Modern Library]              [Modern Library]         \n",
       "187                      [Reclam]                      [Reclam]         \n",
       "229       [Cambridge Univ. Press]       [Cambridge Univ. Press]         \n",
       "276                      [Reclam]                      [Reclam]         \n",
       "311                [Insel Verlag]                [Insel Verlag]         \n",
       "373       [Cambridge Univ. Press]       [Cambridge Univ. Press]         \n",
       "378          [The Modern Library]          [The Modern Library]         \n",
       "\n",
       "    coordinate doi ismn musicid      format  \n",
       "0           []  []   []          [BK020000]  \n",
       "4           []  []   []          [BK020000]  \n",
       "17          []  []   []          [BK020000]  \n",
       "19          []  []   []          [BK020000]  \n",
       "29          []  []   []          [BK020000]  \n",
       "51          []  []   []          [BK020000]  \n",
       "77          []  []   []          [BK020000]  \n",
       "109         []  []   []          [BK020000]  \n",
       "130         []  []   []          [BK020000]  \n",
       "160         []  []   []          [BK020000]  \n",
       "170         []  []   []          [BK020000]  \n",
       "179         []  []   []          [BK020000]  \n",
       "187         []  []   []          [BK020000]  \n",
       "229         []  []   []          [BK020000]  \n",
       "276         []  []   []          [BK020000]  \n",
       "311         []  []   []          [BK020000]  \n",
       "373         []  []   []          [BK020000]  \n",
       "378         []  []   []          [BK020000]  "
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "goldstandard['slaves'][\n",
    "    goldstandard['slaves'].ttlfull.apply(lambda x : x['245'][0]).str.contains('Emma')\n",
    "]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Number of records in slave.json with string 'Emma' : 18\n"
     ]
    }
   ],
   "source": [
    "print('Number of records in slave.json with string \\'Emma\\' :', len(\n",
    "    goldstandard['slaves'][\n",
    "        goldstandard['slaves'].ttlfull.apply(lambda x : x['245'][0]).str.contains('Emma')])\n",
    "     )"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "A number of 18 records in $\\texttt{slave.json}$ contain the string 'Emma' in attribute $\\texttt{ttlfull}$. Some of these records are duplicates. File $\\texttt{master.json}$ knows the amount of uniques out of the 18 records."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>docid</th>\n",
       "      <th>035liste</th>\n",
       "      <th>isbn</th>\n",
       "      <th>ttlfull</th>\n",
       "      <th>ttlpart</th>\n",
       "      <th>person</th>\n",
       "      <th>corporate</th>\n",
       "      <th>pubyear</th>\n",
       "      <th>decade</th>\n",
       "      <th>century</th>\n",
       "      <th>exactDate</th>\n",
       "      <th>edition</th>\n",
       "      <th>part</th>\n",
       "      <th>pages</th>\n",
       "      <th>volumes</th>\n",
       "      <th>pubinit</th>\n",
       "      <th>pubword</th>\n",
       "      <th>scale</th>\n",
       "      <th>coordinate</th>\n",
       "      <th>doi</th>\n",
       "      <th>ismn</th>\n",
       "      <th>musicid</th>\n",
       "      <th>format</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>85</th>\n",
       "      <td>504389793</td>\n",
       "      <td>[(NEBIS)009587153, (LIBIB)000315536, (ABN)0005...</td>\n",
       "      <td>[978-3-15-020008-7]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td></td>\n",
       "      <td>[20008]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[Reclam]</td>\n",
       "      <td>[Reclam]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>86</th>\n",
       "      <td>504389807</td>\n",
       "      <td>[(NEBIS)008647887, (VAUD)991001434509702852, (...</td>\n",
       "      <td>[0-375-75742-2]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2001</td>\n",
       "      <td>2001</td>\n",
       "      <td>2001</td>\n",
       "      <td>2001</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[359 S.]</td>\n",
       "      <td>[359 S.]</td>\n",
       "      <td>[Modern Library]</td>\n",
       "      <td>[Modern Library]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>87</th>\n",
       "      <td>504389815</td>\n",
       "      <td>[(IDSLU)000449481, (IDSBB)003781869, (NEBIS)00...</td>\n",
       "      <td>[0-521-82437-0]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': ['Au...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[599 S.]</td>\n",
       "      <td>[599 S.]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>88</th>\n",
       "      <td>504389823</td>\n",
       "      <td>[(SGBN)001068279, (ABN)000548154, (BGR)0004095...</td>\n",
       "      <td>[978-1-4058-8214-9 (br), 1-4058-8214-X (br)]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['BarnesAnnette...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[64 S.]</td>\n",
       "      <td>[64 S.]</td>\n",
       "      <td>[Pearson Education]</td>\n",
       "      <td>[Pearson Education]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>89</th>\n",
       "      <td>504389831</td>\n",
       "      <td>[(IDSBB)001470548, (SGBN)001344510]</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1979</td>\n",
       "      <td>1979</td>\n",
       "      <td>1979</td>\n",
       "      <td>1979</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[549 S.]</td>\n",
       "      <td>[549 S.]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "        docid                                           035liste  \\\n",
       "85  504389793  [(NEBIS)009587153, (LIBIB)000315536, (ABN)0005...   \n",
       "86  504389807  [(NEBIS)008647887, (VAUD)991001434509702852, (...   \n",
       "87  504389815  [(IDSLU)000449481, (IDSBB)003781869, (NEBIS)00...   \n",
       "88  504389823  [(SGBN)001068279, (ABN)000548154, (BGR)0004095...   \n",
       "89  504389831                [(IDSBB)001470548, (SGBN)001344510]   \n",
       "\n",
       "                                            isbn            ttlfull  \\\n",
       "85                           [978-3-15-020008-7]  {'245': ['Emma']}   \n",
       "86                               [0-375-75742-2]  {'245': ['Emma']}   \n",
       "87                               [0-521-82437-0]  {'245': ['Emma']}   \n",
       "88  [978-1-4058-8214-9 (br), 1-4058-8214-X (br)]  {'245': ['Emma']}   \n",
       "89                                            []  {'245': ['Emma']}   \n",
       "\n",
       "              ttlpart                                             person  \\\n",
       "85  {'245': ['Emma']}  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "86  {'245': ['Emma']}  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "87  {'245': ['Emma']}  {'100': ['AustenJane'], '700': [], '800': ['Au...   \n",
       "88  {'245': ['Emma']}  {'100': ['AustenJane'], '700': ['BarnesAnnette...   \n",
       "89  {'245': ['Emma']}  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "\n",
       "                            corporate   pubyear decade century exactDate  \\\n",
       "85  {'110': [], '710': [], '810': []}  2009       2009    2009  2009       \n",
       "86  {'110': [], '710': [], '810': []}  2001       2001    2001  2001       \n",
       "87  {'110': [], '710': [], '810': []}  2005       2005    2005  2005       \n",
       "88  {'110': [], '710': [], '810': []}  2008       2008    2008  2008       \n",
       "89  {'110': [], '710': [], '810': []}  1979       1979    1979  1979       \n",
       "\n",
       "   edition     part     pages   volumes              pubinit  \\\n",
       "85          [20008]  [600 S.]  [600 S.]             [Reclam]   \n",
       "86               []  [359 S.]  [359 S.]     [Modern Library]   \n",
       "87               []  [599 S.]  [599 S.]                   []   \n",
       "88               []   [64 S.]   [64 S.]  [Pearson Education]   \n",
       "89               []  [549 S.]  [549 S.]                   []   \n",
       "\n",
       "                pubword scale coordinate doi ismn musicid      format  \n",
       "85             [Reclam]               []  []   []          [BK020000]  \n",
       "86     [Modern Library]               []  []   []          [BK020000]  \n",
       "87                   []               []  []   []          [BK020000]  \n",
       "88  [Pearson Education]               []  []   []          [BK020000]  \n",
       "89                   []               []  []   []          [BK020000]  "
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "goldstandard['masters'][\n",
    "    goldstandard['masters'].ttlfull.apply(lambda x : x['245'][0]).str.contains('Emma')\n",
    "]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Number of records in master.json with string 'Emma' : 5\n"
     ]
    }
   ],
   "source": [
    "print('Number of records in master.json with string \\'Emma\\' :', len(\n",
    "    goldstandard['masters'][\n",
    "        goldstandard['masters'].ttlfull.apply(lambda x : x['245'][0]).str.contains('Emma')])\n",
    "     )"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The number of deduplicated records of file $\\texttt{slave.json}$ containing string 'Emma' is 5. This is the number of unique records that are built in Swissbib's deduplication step out of the original 18 records above.\n",
    "\n",
    "There may be some minor differences in some fields of the deduplicated master file records compared to their original data in the duplicated original slave file records. Nevertheless, it is possible to identify the slave file records as duplicates of their associated master file records, looking at the details of the values of each attribute.\n",
    "\n",
    "In a final step, let's have a look at the 'Emma' string data of $\\texttt{unique.json}$."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>docid</th>\n",
       "      <th>035liste</th>\n",
       "      <th>isbn</th>\n",
       "      <th>ttlfull</th>\n",
       "      <th>ttlpart</th>\n",
       "      <th>person</th>\n",
       "      <th>corporate</th>\n",
       "      <th>pubyear</th>\n",
       "      <th>decade</th>\n",
       "      <th>century</th>\n",
       "      <th>exactDate</th>\n",
       "      <th>edition</th>\n",
       "      <th>part</th>\n",
       "      <th>pages</th>\n",
       "      <th>volumes</th>\n",
       "      <th>pubinit</th>\n",
       "      <th>pubword</th>\n",
       "      <th>scale</th>\n",
       "      <th>coordinate</th>\n",
       "      <th>doi</th>\n",
       "      <th>ismn</th>\n",
       "      <th>musicid</th>\n",
       "      <th>format</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>000143235</td>\n",
       "      <td>[(OCoLC)362722306, (ABN)000551177]</td>\n",
       "      <td>[978-3-7466-6120-9]</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td></td>\n",
       "      <td>[6120]</td>\n",
       "      <td>[575 S.]</td>\n",
       "      <td>[575 S.]</td>\n",
       "      <td>[Aufbau Taschenbuch]</td>\n",
       "      <td>[Aufbau Taschenbuch]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>002410559</td>\n",
       "      <td>[(OCoLC)777853583, (ABN)000243260]</td>\n",
       "      <td>[0-19-282756-1]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1990</td>\n",
       "      <td>1990</td>\n",
       "      <td>1990</td>\n",
       "      <td>1990</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[445 p.]</td>\n",
       "      <td>[445 p.]</td>\n",
       "      <td>[Oxford University Press]</td>\n",
       "      <td>[Oxford University Press]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>004130235</td>\n",
       "      <td>[(OCoLC)887396789, (ABN)000628911]</td>\n",
       "      <td>[978-0-307-38684-7]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2007</td>\n",
       "      <td>2007</td>\n",
       "      <td>2007</td>\n",
       "      <td>2007</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[495 S.]</td>\n",
       "      <td>[495 S.]</td>\n",
       "      <td>[Vintage Books]</td>\n",
       "      <td>[Vintage Books]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>017204097</td>\n",
       "      <td>[(OCoLC)759250730, (BGR)000090407]</td>\n",
       "      <td>[3-596-22191-9]</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1996</td>\n",
       "      <td>1996</td>\n",
       "      <td>1996</td>\n",
       "      <td>1996</td>\n",
       "      <td>[87.-88. Tsd.]</td>\n",
       "      <td>[2191]</td>\n",
       "      <td>[414 S.]</td>\n",
       "      <td>[414 S.]</td>\n",
       "      <td>[Fischer-Taschenbuch-Verlag]</td>\n",
       "      <td>[Fischer-Taschenbuch-Verlag]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>017738490</td>\n",
       "      <td>[(OCoLC)76214484, (BGR)000281870]</td>\n",
       "      <td>[3-7466-5105-0]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2001</td>\n",
       "      <td>2001</td>\n",
       "      <td>2001</td>\n",
       "      <td>2001</td>\n",
       "      <td>3. Aufl</td>\n",
       "      <td>[5105]</td>\n",
       "      <td>[553 S.]</td>\n",
       "      <td>[553 S.]</td>\n",
       "      <td>[Aufbau Taschenbuch-Verlag]</td>\n",
       "      <td>[Aufbau Taschenbuch-Verlag]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>01843486X</td>\n",
       "      <td>[(OCoLC)759471685, (BGR)000212474]</td>\n",
       "      <td>[0-582-41794-5]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['BarnesAnnette...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000</td>\n",
       "      <td>[new ed., 2nd impression]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[59 S.]</td>\n",
       "      <td>[59 S.]</td>\n",
       "      <td>[Pearson Education Ltd]</td>\n",
       "      <td>[Pearson Education Ltd]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>021868816</td>\n",
       "      <td>[(OCoLC)610677900, (IDSLU)000093923]</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1996</td>\n",
       "      <td>1996</td>\n",
       "      <td>1996</td>\n",
       "      <td>1996</td>\n",
       "      <td></td>\n",
       "      <td>[[1]]</td>\n",
       "      <td>[560 S.]</td>\n",
       "      <td>[560 S.]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>42</th>\n",
       "      <td>038872498</td>\n",
       "      <td>[(OCoLC)614721683, (SBT)000133903]</td>\n",
       "      <td>[0-14-043010-5]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['BlytheRonald'...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1983</td>\n",
       "      <td>1983</td>\n",
       "      <td>1983</td>\n",
       "      <td>1983</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[471 p.]</td>\n",
       "      <td>[471 p.]</td>\n",
       "      <td>[Penguin Books]</td>\n",
       "      <td>[Penguin Books]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>53</th>\n",
       "      <td>043085075</td>\n",
       "      <td>[(OCoLC)882111340, (SBT)000463076]</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Emma', 'mobbing']}</td>\n",
       "      <td>{'245': ['Emma', 'mobbing']}</td>\n",
       "      <td>{'100': [], '700': [], '800': [], '245c': ['Ca...</td>\n",
       "      <td>{'110': [], '710': ['Caritas (Ticino)'], '810'...</td>\n",
       "      <td>2002</td>\n",
       "      <td>2002</td>\n",
       "      <td>2002</td>\n",
       "      <td>2002</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[1 Videocassetta]</td>\n",
       "      <td>[1 Videocassetta]</td>\n",
       "      <td>[Caritas Ticino]</td>\n",
       "      <td>[Caritas Ticino]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[VM010200]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>62</th>\n",
       "      <td>051168871</td>\n",
       "      <td>[(OCoLC)759052846, (SGBN)001050098]</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1953</td>\n",
       "      <td>1953</td>\n",
       "      <td>1953</td>\n",
       "      <td>1953</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[377 S.]</td>\n",
       "      <td>[377 S.]</td>\n",
       "      <td>[Collins]</td>\n",
       "      <td>[Collins]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>64</th>\n",
       "      <td>051572184</td>\n",
       "      <td>[(OCoLC)759058296, (SGBN)001060390]</td>\n",
       "      <td>[978-3-491-96266-8]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[450 S.]</td>\n",
       "      <td>[450 S.]</td>\n",
       "      <td>[Albatros]</td>\n",
       "      <td>[Albatros]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>68</th>\n",
       "      <td>053149580</td>\n",
       "      <td>[(OCoLC)759082968, (SGBN)001121235]</td>\n",
       "      <td>[978-3-596-90041-1]</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>Ungekürzte Ausgabe, 2. Aufl</td>\n",
       "      <td>[90041]</td>\n",
       "      <td>[509 S.]</td>\n",
       "      <td>[509 S.]</td>\n",
       "      <td>[Fischer-Taschenbuch-Verlag]</td>\n",
       "      <td>[Fischer-Taschenbuch-Verlag]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>75</th>\n",
       "      <td>055275540</td>\n",
       "      <td>[(OCoLC)196459920, (SGBN)001234498]</td>\n",
       "      <td>[978-3-15-020008-7]</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['GraweChristia...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2007</td>\n",
       "      <td>2007</td>\n",
       "      <td>2007</td>\n",
       "      <td>2007</td>\n",
       "      <td></td>\n",
       "      <td>[Nr. 20008]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[Reclam]</td>\n",
       "      <td>[Reclam]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>78</th>\n",
       "      <td>055721753</td>\n",
       "      <td>[(OCoLC)732622324, (SGBN)001210208]</td>\n",
       "      <td>[978-0-14-062010-8]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>200u</td>\n",
       "      <td>200u</td>\n",
       "      <td>200u</td>\n",
       "      <td>200u</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[367 S.]</td>\n",
       "      <td>[367 S.]</td>\n",
       "      <td>[Penguin Books]</td>\n",
       "      <td>[Penguin Books]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>79</th>\n",
       "      <td>055836534</td>\n",
       "      <td>[(OCoLC)758069343, (SGBN)000458718]</td>\n",
       "      <td>[0-582-41794-5]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['BarnesAnnette...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1999</td>\n",
       "      <td>1999</td>\n",
       "      <td>1999</td>\n",
       "      <td>1999</td>\n",
       "      <td>6th impr</td>\n",
       "      <td>[]</td>\n",
       "      <td>[59 S.]</td>\n",
       "      <td>[59 S.]</td>\n",
       "      <td>[Pearson]</td>\n",
       "      <td>[Pearson]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>103</th>\n",
       "      <td>077891678</td>\n",
       "      <td>[(OCoLC)605624983, (IDSBB)002184876]</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['An Emma']}</td>\n",
       "      <td>{'245': ['An Emma']}</td>\n",
       "      <td>{'100': ['SchubertFranz'], '700': [], '800': [...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>uuuuuuuu</td>\n",
       "      <td>uuuu</td>\n",
       "      <td>uuuu</td>\n",
       "      <td>uuuuuuuu</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[MU040100]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>115</th>\n",
       "      <td>09251703X</td>\n",
       "      <td>[(OCoLC)601005765, (IDSBB)004397615]</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1955</td>\n",
       "      <td>1955</td>\n",
       "      <td>1955</td>\n",
       "      <td>1955</td>\n",
       "      <td></td>\n",
       "      <td>[129]</td>\n",
       "      <td>[XIV, 432 S.]</td>\n",
       "      <td>[XIV, 432 S.]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>119</th>\n",
       "      <td>096258241</td>\n",
       "      <td>[(OCoLC)256364940, (IDSBB)001122030]</td>\n",
       "      <td>[3-15-007633-1, 3-15-027633-0]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1985</td>\n",
       "      <td>1985</td>\n",
       "      <td>1985</td>\n",
       "      <td>1985</td>\n",
       "      <td></td>\n",
       "      <td>[Nr. 7633]</td>\n",
       "      <td>[560 S.]</td>\n",
       "      <td>[560 S.]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>123</th>\n",
       "      <td>099169584</td>\n",
       "      <td>[(OCoLC)602806516, (IDSBB)004856135]</td>\n",
       "      <td>[3-15-027633-0]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['AustenJane'],...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1980</td>\n",
       "      <td>1980</td>\n",
       "      <td>1980</td>\n",
       "      <td>1980</td>\n",
       "      <td></td>\n",
       "      <td>[Nr. 7633]</td>\n",
       "      <td>[560 S.]</td>\n",
       "      <td>[560 S.]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>150</th>\n",
       "      <td>118839071</td>\n",
       "      <td>[(OCoLC)884533340, (IDSBB)000869415]</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1988</td>\n",
       "      <td>1988</td>\n",
       "      <td>1988</td>\n",
       "      <td>1988</td>\n",
       "      <td>[11th impression]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[367 S.]</td>\n",
       "      <td>[367 S.]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>164</th>\n",
       "      <td>13863632X</td>\n",
       "      <td>[(OCoLC)636864378, (NEBIS)001455894]</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1994</td>\n",
       "      <td>1994</td>\n",
       "      <td>1994</td>\n",
       "      <td>1994</td>\n",
       "      <td>[Reprint]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[3 vol.]</td>\n",
       "      <td>[3 vol.]</td>\n",
       "      <td>[Routledge/Thoemmes Press]</td>\n",
       "      <td>[Routledge/Thoemmes Press]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>181</th>\n",
       "      <td>160959055</td>\n",
       "      <td>[(OCoLC)635958140, (NEBIS)004952065]</td>\n",
       "      <td>[1-904633-00-5]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2003</td>\n",
       "      <td>2003</td>\n",
       "      <td>2003</td>\n",
       "      <td>2003</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[590 S.]</td>\n",
       "      <td>[590 S.]</td>\n",
       "      <td>[CRW]</td>\n",
       "      <td>[CRW]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>190</th>\n",
       "      <td>169215628</td>\n",
       "      <td>[(OCoLC)729952995, (NEBIS)005884357]</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1963</td>\n",
       "      <td>1963</td>\n",
       "      <td>1963</td>\n",
       "      <td>1963</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[127 p.]</td>\n",
       "      <td>[127 p.]</td>\n",
       "      <td>[Peninsula press]</td>\n",
       "      <td>[Peninsula press]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>192</th>\n",
       "      <td>183110714</td>\n",
       "      <td>[(OCoLC)800585351, (NEBIS)007344139, (OCoLC)80...</td>\n",
       "      <td>[978-3-596-51207-2, 3-596-51207-7]</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['HenzeHelene']...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2012</td>\n",
       "      <td>2012</td>\n",
       "      <td>2012</td>\n",
       "      <td>2012</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[735 S.]</td>\n",
       "      <td>[735 S.]</td>\n",
       "      <td>[Fischer Taschenbuch Verl.]</td>\n",
       "      <td>[Fischer Taschenbuch Verl.]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>219</th>\n",
       "      <td>215675983</td>\n",
       "      <td>[(RERO)1878056]</td>\n",
       "      <td>[0-19-254704-6]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': ['Au...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1988</td>\n",
       "      <td>1988</td>\n",
       "      <td>1988</td>\n",
       "      <td>1988</td>\n",
       "      <td>3rd ed. repr</td>\n",
       "      <td>[vol. 4]</td>\n",
       "      <td>[XI, 521 p.]</td>\n",
       "      <td>[XI, 521 p.]</td>\n",
       "      <td>[Oxford University Press]</td>\n",
       "      <td>[Oxford University Press]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>220</th>\n",
       "      <td>216012872</td>\n",
       "      <td>[(RERO)1918154]</td>\n",
       "      <td>[0-14-043010-5]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['BlytheRonald'...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1975</td>\n",
       "      <td>1975</td>\n",
       "      <td>1975</td>\n",
       "      <td>1975</td>\n",
       "      <td>[Repr.]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[471 p.]</td>\n",
       "      <td>[471 p.]</td>\n",
       "      <td>[Penguin Books]</td>\n",
       "      <td>[Penguin Books]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>312</th>\n",
       "      <td>250735768</td>\n",
       "      <td>[(RERO)R006432641]</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1931</td>\n",
       "      <td>1931</td>\n",
       "      <td>1931</td>\n",
       "      <td>1931</td>\n",
       "      <td></td>\n",
       "      <td>[24]</td>\n",
       "      <td>[395 p.]</td>\n",
       "      <td>[395 p.]</td>\n",
       "      <td>[J.M. Dent and Sons]</td>\n",
       "      <td>[J.M. Dent and Sons]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>313</th>\n",
       "      <td>250896974</td>\n",
       "      <td>[(RERO)R006450838]</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1960</td>\n",
       "      <td>1960</td>\n",
       "      <td>1960</td>\n",
       "      <td>1960</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[521 p.]</td>\n",
       "      <td>[521 p.]</td>\n",
       "      <td>[Oxford University Press]</td>\n",
       "      <td>[Oxford University Press]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>348</th>\n",
       "      <td>315048913</td>\n",
       "      <td>[(RERO)R005339099]</td>\n",
       "      <td>[978-2-253-15933-9]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2012</td>\n",
       "      <td>2012</td>\n",
       "      <td>2012</td>\n",
       "      <td>2012</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[1 livre électronique (e-book)]</td>\n",
       "      <td>[1 livre électronique (e-book)]</td>\n",
       "      <td>[Le Livre de Poche]</td>\n",
       "      <td>[Le Livre de Poche]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020053]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>349</th>\n",
       "      <td>315858133</td>\n",
       "      <td>[(OCoLC)887524935, (ABN)000748108, (ZDB-22-CAN...</td>\n",
       "      <td>[3-95418-379-X, 978-3-95418-379-1, 3-95418-379...</td>\n",
       "      <td>{'245': ['Emma', 'Vollständige Fassung']}</td>\n",
       "      <td>{'245': ['Emma', 'Vollständige Fassung']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['SchulzeJürgen...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2013</td>\n",
       "      <td>2013</td>\n",
       "      <td>2013</td>\n",
       "      <td>2013</td>\n",
       "      <td>1. Aufl</td>\n",
       "      <td>[]</td>\n",
       "      <td>[Online Ressource]</td>\n",
       "      <td>[Online Ressource]</td>\n",
       "      <td>[Null Papier Verlag]</td>\n",
       "      <td>[Null Papier Verlag]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020053]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>383</th>\n",
       "      <td>32197798X</td>\n",
       "      <td>[(OCoLC)237893744, (LIBIB)000188548]</td>\n",
       "      <td>[0-14-062010-9]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1994</td>\n",
       "      <td>1994</td>\n",
       "      <td>1994</td>\n",
       "      <td>1994</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[367 S.]</td>\n",
       "      <td>[367 S.]</td>\n",
       "      <td>[Penguin]</td>\n",
       "      <td>[Penguin]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>384</th>\n",
       "      <td>322647916</td>\n",
       "      <td>[(OCoLC)836605224, (LIBIB)000224043]</td>\n",
       "      <td>[0-14-043010-5]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': [], '700': ['AustenJane'], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1985</td>\n",
       "      <td>1985</td>\n",
       "      <td>1985</td>\n",
       "      <td>1985</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[471 S.]</td>\n",
       "      <td>[471 S.]</td>\n",
       "      <td>[Penguin]</td>\n",
       "      <td>[Penguin]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>385</th>\n",
       "      <td>322663563</td>\n",
       "      <td>[(OCoLC)759250730, (LIBIB)000224988]</td>\n",
       "      <td>[3-596-22191-9]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': [], '700': ['AustenJane'], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1996</td>\n",
       "      <td>1996</td>\n",
       "      <td>1996</td>\n",
       "      <td>1996</td>\n",
       "      <td></td>\n",
       "      <td>[2191]</td>\n",
       "      <td>[414 S.]</td>\n",
       "      <td>[414 S.]</td>\n",
       "      <td>[Fischer]</td>\n",
       "      <td>[Fischer]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>392</th>\n",
       "      <td>337635617</td>\n",
       "      <td>[(OCoLC)919233036, (IDSLU)001203491]</td>\n",
       "      <td>[978-1-4058-8214-9]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1996</td>\n",
       "      <td>1996</td>\n",
       "      <td>1996</td>\n",
       "      <td>1996</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[64 S.]</td>\n",
       "      <td>[64 S.]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>393</th>\n",
       "      <td>337918651</td>\n",
       "      <td>[(OCoLC)918992241, (ABN)000777750]</td>\n",
       "      <td>[978-3-526-52644-5]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2010</td>\n",
       "      <td>2010</td>\n",
       "      <td>2010</td>\n",
       "      <td>2010</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[144 S.]</td>\n",
       "      <td>[144 S.]</td>\n",
       "      <td>[Black Cat Publishing]</td>\n",
       "      <td>[Black Cat Publishing]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>396</th>\n",
       "      <td>339410671</td>\n",
       "      <td>[(OCoLC)922663046, (SGBN)001329749]</td>\n",
       "      <td>[978-3-15-010955-7]</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2015</td>\n",
       "      <td>2015</td>\n",
       "      <td>2015</td>\n",
       "      <td>2015</td>\n",
       "      <td>Durchgesehene Ausgabe</td>\n",
       "      <td>[]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>[Reclam]</td>\n",
       "      <td>[Reclam]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>440</th>\n",
       "      <td>353526452</td>\n",
       "      <td>[(OCoLC)912508004, (NEBIS)010476406, (OCoLC)91...</td>\n",
       "      <td>[978-0-14-310771-2 (paperback), 0-14-310771-2 ...</td>\n",
       "      <td>{'245': ['Emma', '200th-anniversary annotated ...</td>\n",
       "      <td>{'245': ['Emma', '200th-anniversary annotated ...</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['WellsJuliette...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2015</td>\n",
       "      <td>2015</td>\n",
       "      <td>2015</td>\n",
       "      <td>2015</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[459 p.]</td>\n",
       "      <td>[459 p.]</td>\n",
       "      <td>[Penguin Books]</td>\n",
       "      <td>[Penguin Books]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>444</th>\n",
       "      <td>357508726</td>\n",
       "      <td>[(RERO)R008372350]</td>\n",
       "      <td>[978-1-107-62046-9]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': ['CroninRichard...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2013</td>\n",
       "      <td>2013</td>\n",
       "      <td>2013</td>\n",
       "      <td>2013</td>\n",
       "      <td>Pbk. ed.</td>\n",
       "      <td>[]</td>\n",
       "      <td>[600 p.]</td>\n",
       "      <td>[600 p.]</td>\n",
       "      <td>[Cambridge University Press]</td>\n",
       "      <td>[Cambridge University Press]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>448</th>\n",
       "      <td>360500676</td>\n",
       "      <td>[(OCoLC)823820017, (SGBN)001341883, (OCoLC)823...</td>\n",
       "      <td>[978-0-14-119952-8, 0-14-119952-0]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2012</td>\n",
       "      <td>2012</td>\n",
       "      <td>2012</td>\n",
       "      <td>2012</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[485 S]</td>\n",
       "      <td>[485 S]</td>\n",
       "      <td>[Penguin]</td>\n",
       "      <td>[Penguin]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>479</th>\n",
       "      <td>414025806</td>\n",
       "      <td>[(VAUD)991009408689702852, (RNV)000183309-41bc...</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1901</td>\n",
       "      <td>1901</td>\n",
       "      <td>1901</td>\n",
       "      <td>1901</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[XVIII, 436 p.]</td>\n",
       "      <td>[XVIII, 436 p.]</td>\n",
       "      <td>[Macmillan]</td>\n",
       "      <td>[Macmillan]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>482</th>\n",
       "      <td>418402930</td>\n",
       "      <td>[(VAUD)991000009909702852, (RNV)000000022-41bc...</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': ['Au...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>1922</td>\n",
       "      <td>1922</td>\n",
       "      <td>1922</td>\n",
       "      <td>1922</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[V, 395 p.]</td>\n",
       "      <td>[V, 395 p.]</td>\n",
       "      <td>[J.M. Dent and sons]</td>\n",
       "      <td>[J.M. Dent and sons]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>489</th>\n",
       "      <td>42968391X</td>\n",
       "      <td>[(VAUD)991000934389702853, (RNV)008255353-41bc...</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[3 disque compact ( env. 213 min)]</td>\n",
       "      <td>[3 disque compact ( env. 213 min)]</td>\n",
       "      <td>[Macmilian]</td>\n",
       "      <td>[Macmilian]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[MU040000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>590</th>\n",
       "      <td>502974850</td>\n",
       "      <td>[(VAUD)991021133696002852, (EXLNZ-41BCULAUSA_N...</td>\n",
       "      <td>[978-1-63106-070-0, 1-63106-070-8]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2015</td>\n",
       "      <td>2015</td>\n",
       "      <td>2015</td>\n",
       "      <td>2015</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[448 p.]</td>\n",
       "      <td>[448 p.]</td>\n",
       "      <td>[Race Point Publishing]</td>\n",
       "      <td>[Race Point Publishing]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>591</th>\n",
       "      <td>503037281</td>\n",
       "      <td>[(OCoLC)190777025, (ABN)000816378, (OCoLC)1907...</td>\n",
       "      <td>[978-0-19-953552-1, 0-19-953552-3]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>{'100': ['AustenJane'], '700': [], '800': [], ...</td>\n",
       "      <td>{'110': [], '710': [], '810': []}</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td>Reissued</td>\n",
       "      <td>[]</td>\n",
       "      <td>[402 Seiten]</td>\n",
       "      <td>[402 Seiten]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[BK020000]</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "         docid                                           035liste  \\\n",
       "0    000143235                 [(OCoLC)362722306, (ABN)000551177]   \n",
       "4    002410559                 [(OCoLC)777853583, (ABN)000243260]   \n",
       "8    004130235                 [(OCoLC)887396789, (ABN)000628911]   \n",
       "13   017204097                 [(OCoLC)759250730, (BGR)000090407]   \n",
       "16   017738490                  [(OCoLC)76214484, (BGR)000281870]   \n",
       "20   01843486X                 [(OCoLC)759471685, (BGR)000212474]   \n",
       "26   021868816               [(OCoLC)610677900, (IDSLU)000093923]   \n",
       "42   038872498                 [(OCoLC)614721683, (SBT)000133903]   \n",
       "53   043085075                 [(OCoLC)882111340, (SBT)000463076]   \n",
       "62   051168871                [(OCoLC)759052846, (SGBN)001050098]   \n",
       "64   051572184                [(OCoLC)759058296, (SGBN)001060390]   \n",
       "68   053149580                [(OCoLC)759082968, (SGBN)001121235]   \n",
       "75   055275540                [(OCoLC)196459920, (SGBN)001234498]   \n",
       "78   055721753                [(OCoLC)732622324, (SGBN)001210208]   \n",
       "79   055836534                [(OCoLC)758069343, (SGBN)000458718]   \n",
       "103  077891678               [(OCoLC)605624983, (IDSBB)002184876]   \n",
       "115  09251703X               [(OCoLC)601005765, (IDSBB)004397615]   \n",
       "119  096258241               [(OCoLC)256364940, (IDSBB)001122030]   \n",
       "123  099169584               [(OCoLC)602806516, (IDSBB)004856135]   \n",
       "150  118839071               [(OCoLC)884533340, (IDSBB)000869415]   \n",
       "164  13863632X               [(OCoLC)636864378, (NEBIS)001455894]   \n",
       "181  160959055               [(OCoLC)635958140, (NEBIS)004952065]   \n",
       "190  169215628               [(OCoLC)729952995, (NEBIS)005884357]   \n",
       "192  183110714  [(OCoLC)800585351, (NEBIS)007344139, (OCoLC)80...   \n",
       "219  215675983                                    [(RERO)1878056]   \n",
       "220  216012872                                    [(RERO)1918154]   \n",
       "312  250735768                                 [(RERO)R006432641]   \n",
       "313  250896974                                 [(RERO)R006450838]   \n",
       "348  315048913                                 [(RERO)R005339099]   \n",
       "349  315858133  [(OCoLC)887524935, (ABN)000748108, (ZDB-22-CAN...   \n",
       "383  32197798X               [(OCoLC)237893744, (LIBIB)000188548]   \n",
       "384  322647916               [(OCoLC)836605224, (LIBIB)000224043]   \n",
       "385  322663563               [(OCoLC)759250730, (LIBIB)000224988]   \n",
       "392  337635617               [(OCoLC)919233036, (IDSLU)001203491]   \n",
       "393  337918651                 [(OCoLC)918992241, (ABN)000777750]   \n",
       "396  339410671                [(OCoLC)922663046, (SGBN)001329749]   \n",
       "440  353526452  [(OCoLC)912508004, (NEBIS)010476406, (OCoLC)91...   \n",
       "444  357508726                                 [(RERO)R008372350]   \n",
       "448  360500676  [(OCoLC)823820017, (SGBN)001341883, (OCoLC)823...   \n",
       "479  414025806  [(VAUD)991009408689702852, (RNV)000183309-41bc...   \n",
       "482  418402930  [(VAUD)991000009909702852, (RNV)000000022-41bc...   \n",
       "489  42968391X  [(VAUD)991000934389702853, (RNV)008255353-41bc...   \n",
       "590  502974850  [(VAUD)991021133696002852, (EXLNZ-41BCULAUSA_N...   \n",
       "591  503037281  [(OCoLC)190777025, (ABN)000816378, (OCoLC)1907...   \n",
       "\n",
       "                                                  isbn  \\\n",
       "0                                  [978-3-7466-6120-9]   \n",
       "4                                      [0-19-282756-1]   \n",
       "8                                  [978-0-307-38684-7]   \n",
       "13                                     [3-596-22191-9]   \n",
       "16                                     [3-7466-5105-0]   \n",
       "20                                     [0-582-41794-5]   \n",
       "26                                                  []   \n",
       "42                                     [0-14-043010-5]   \n",
       "53                                                  []   \n",
       "62                                                  []   \n",
       "64                                 [978-3-491-96266-8]   \n",
       "68                                 [978-3-596-90041-1]   \n",
       "75                                 [978-3-15-020008-7]   \n",
       "78                                 [978-0-14-062010-8]   \n",
       "79                                     [0-582-41794-5]   \n",
       "103                                                 []   \n",
       "115                                                 []   \n",
       "119                     [3-15-007633-1, 3-15-027633-0]   \n",
       "123                                    [3-15-027633-0]   \n",
       "150                                                 []   \n",
       "164                                                 []   \n",
       "181                                    [1-904633-00-5]   \n",
       "190                                                 []   \n",
       "192                 [978-3-596-51207-2, 3-596-51207-7]   \n",
       "219                                    [0-19-254704-6]   \n",
       "220                                    [0-14-043010-5]   \n",
       "312                                                 []   \n",
       "313                                                 []   \n",
       "348                                [978-2-253-15933-9]   \n",
       "349  [3-95418-379-X, 978-3-95418-379-1, 3-95418-379...   \n",
       "383                                    [0-14-062010-9]   \n",
       "384                                    [0-14-043010-5]   \n",
       "385                                    [3-596-22191-9]   \n",
       "392                                [978-1-4058-8214-9]   \n",
       "393                                [978-3-526-52644-5]   \n",
       "396                                [978-3-15-010955-7]   \n",
       "440  [978-0-14-310771-2 (paperback), 0-14-310771-2 ...   \n",
       "444                                [978-1-107-62046-9]   \n",
       "448                 [978-0-14-119952-8, 0-14-119952-0]   \n",
       "479                                                 []   \n",
       "482                                                 []   \n",
       "489                                                 []   \n",
       "590                 [978-1-63106-070-0, 1-63106-070-8]   \n",
       "591                 [978-0-19-953552-1, 0-19-953552-3]   \n",
       "\n",
       "                                               ttlfull  \\\n",
       "0                           {'245': ['Emma', 'Roman']}   \n",
       "4                                    {'245': ['Emma']}   \n",
       "8                                    {'245': ['Emma']}   \n",
       "13                          {'245': ['Emma', 'Roman']}   \n",
       "16                                   {'245': ['Emma']}   \n",
       "20                                   {'245': ['Emma']}   \n",
       "26                                   {'245': ['Emma']}   \n",
       "42                                   {'245': ['Emma']}   \n",
       "53                        {'245': ['Emma', 'mobbing']}   \n",
       "62                                   {'245': ['Emma']}   \n",
       "64                                   {'245': ['Emma']}   \n",
       "68                          {'245': ['Emma', 'Roman']}   \n",
       "75                          {'245': ['Emma', 'Roman']}   \n",
       "78                                   {'245': ['Emma']}   \n",
       "79                                   {'245': ['Emma']}   \n",
       "103                               {'245': ['An Emma']}   \n",
       "115                                  {'245': ['Emma']}   \n",
       "119                                  {'245': ['Emma']}   \n",
       "123                                  {'245': ['Emma']}   \n",
       "150                                  {'245': ['Emma']}   \n",
       "164                                  {'245': ['Emma']}   \n",
       "181                                  {'245': ['Emma']}   \n",
       "190                                  {'245': ['Emma']}   \n",
       "192                         {'245': ['Emma', 'Roman']}   \n",
       "219                                  {'245': ['Emma']}   \n",
       "220                                  {'245': ['Emma']}   \n",
       "312                                  {'245': ['Emma']}   \n",
       "313                                  {'245': ['Emma']}   \n",
       "348                                  {'245': ['Emma']}   \n",
       "349          {'245': ['Emma', 'Vollständige Fassung']}   \n",
       "383                                  {'245': ['Emma']}   \n",
       "384                                  {'245': ['Emma']}   \n",
       "385                                  {'245': ['Emma']}   \n",
       "392                                  {'245': ['Emma']}   \n",
       "393                                  {'245': ['Emma']}   \n",
       "396                         {'245': ['Emma', 'Roman']}   \n",
       "440  {'245': ['Emma', '200th-anniversary annotated ...   \n",
       "444                                  {'245': ['Emma']}   \n",
       "448                                  {'245': ['Emma']}   \n",
       "479                                  {'245': ['Emma']}   \n",
       "482                                  {'245': ['Emma']}   \n",
       "489                                  {'245': ['Emma']}   \n",
       "590                                  {'245': ['Emma']}   \n",
       "591                                  {'245': ['Emma']}   \n",
       "\n",
       "                                               ttlpart  \\\n",
       "0                           {'245': ['Emma', 'Roman']}   \n",
       "4                                    {'245': ['Emma']}   \n",
       "8                                    {'245': ['Emma']}   \n",
       "13                          {'245': ['Emma', 'Roman']}   \n",
       "16                                   {'245': ['Emma']}   \n",
       "20                                   {'245': ['Emma']}   \n",
       "26                                   {'245': ['Emma']}   \n",
       "42                                   {'245': ['Emma']}   \n",
       "53                        {'245': ['Emma', 'mobbing']}   \n",
       "62                                   {'245': ['Emma']}   \n",
       "64                                   {'245': ['Emma']}   \n",
       "68                          {'245': ['Emma', 'Roman']}   \n",
       "75                          {'245': ['Emma', 'Roman']}   \n",
       "78                                   {'245': ['Emma']}   \n",
       "79                                   {'245': ['Emma']}   \n",
       "103                               {'245': ['An Emma']}   \n",
       "115                                  {'245': ['Emma']}   \n",
       "119                                  {'245': ['Emma']}   \n",
       "123                                  {'245': ['Emma']}   \n",
       "150                                  {'245': ['Emma']}   \n",
       "164                                  {'245': ['Emma']}   \n",
       "181                                  {'245': ['Emma']}   \n",
       "190                                  {'245': ['Emma']}   \n",
       "192                         {'245': ['Emma', 'Roman']}   \n",
       "219                                  {'245': ['Emma']}   \n",
       "220                                  {'245': ['Emma']}   \n",
       "312                                  {'245': ['Emma']}   \n",
       "313                                  {'245': ['Emma']}   \n",
       "348                                  {'245': ['Emma']}   \n",
       "349          {'245': ['Emma', 'Vollständige Fassung']}   \n",
       "383                                  {'245': ['Emma']}   \n",
       "384                                  {'245': ['Emma']}   \n",
       "385                                  {'245': ['Emma']}   \n",
       "392                                  {'245': ['Emma']}   \n",
       "393                                  {'245': ['Emma']}   \n",
       "396                         {'245': ['Emma', 'Roman']}   \n",
       "440  {'245': ['Emma', '200th-anniversary annotated ...   \n",
       "444                                  {'245': ['Emma']}   \n",
       "448                                  {'245': ['Emma']}   \n",
       "479                                  {'245': ['Emma']}   \n",
       "482                                  {'245': ['Emma']}   \n",
       "489                                  {'245': ['Emma']}   \n",
       "590                                  {'245': ['Emma']}   \n",
       "591                                  {'245': ['Emma']}   \n",
       "\n",
       "                                                person  \\\n",
       "0    {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "4    {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "8    {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "13   {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "16   {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "20   {'100': ['AustenJane'], '700': ['BarnesAnnette...   \n",
       "26   {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "42   {'100': ['AustenJane'], '700': ['BlytheRonald'...   \n",
       "53   {'100': [], '700': [], '800': [], '245c': ['Ca...   \n",
       "62   {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "64   {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "68   {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "75   {'100': ['AustenJane'], '700': ['GraweChristia...   \n",
       "78   {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "79   {'100': ['AustenJane'], '700': ['BarnesAnnette...   \n",
       "103  {'100': ['SchubertFranz'], '700': [], '800': [...   \n",
       "115  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "119  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "123  {'100': ['AustenJane'], '700': ['AustenJane'],...   \n",
       "150  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "164  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "181  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "190  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "192  {'100': ['AustenJane'], '700': ['HenzeHelene']...   \n",
       "219  {'100': ['AustenJane'], '700': [], '800': ['Au...   \n",
       "220  {'100': ['AustenJane'], '700': ['BlytheRonald'...   \n",
       "312  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "313  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "348  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "349  {'100': ['AustenJane'], '700': ['SchulzeJürgen...   \n",
       "383  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "384  {'100': [], '700': ['AustenJane'], '800': [], ...   \n",
       "385  {'100': [], '700': ['AustenJane'], '800': [], ...   \n",
       "392  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "393  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "396  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "440  {'100': ['AustenJane'], '700': ['WellsJuliette...   \n",
       "444  {'100': ['AustenJane'], '700': ['CroninRichard...   \n",
       "448  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "479  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "482  {'100': ['AustenJane'], '700': [], '800': ['Au...   \n",
       "489  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "590  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "591  {'100': ['AustenJane'], '700': [], '800': [], ...   \n",
       "\n",
       "                                             corporate   pubyear decade  \\\n",
       "0                    {'110': [], '710': [], '810': []}  2009       2009   \n",
       "4                    {'110': [], '710': [], '810': []}  1990       1990   \n",
       "8                    {'110': [], '710': [], '810': []}  2007       2007   \n",
       "13                   {'110': [], '710': [], '810': []}  1996       1996   \n",
       "16                   {'110': [], '710': [], '810': []}  2001       2001   \n",
       "20                   {'110': [], '710': [], '810': []}  2000       2000   \n",
       "26                   {'110': [], '710': [], '810': []}  1996       1996   \n",
       "42                   {'110': [], '710': [], '810': []}  1983       1983   \n",
       "53   {'110': [], '710': ['Caritas (Ticino)'], '810'...  2002       2002   \n",
       "62                   {'110': [], '710': [], '810': []}  1953       1953   \n",
       "64                   {'110': [], '710': [], '810': []}  2009       2009   \n",
       "68                   {'110': [], '710': [], '810': []}  2009       2009   \n",
       "75                   {'110': [], '710': [], '810': []}  2007       2007   \n",
       "78                   {'110': [], '710': [], '810': []}  200u       200u   \n",
       "79                   {'110': [], '710': [], '810': []}  1999       1999   \n",
       "103                  {'110': [], '710': [], '810': []}  uuuuuuuu   uuuu   \n",
       "115                  {'110': [], '710': [], '810': []}  1955       1955   \n",
       "119                  {'110': [], '710': [], '810': []}  1985       1985   \n",
       "123                  {'110': [], '710': [], '810': []}  1980       1980   \n",
       "150                  {'110': [], '710': [], '810': []}  1988       1988   \n",
       "164                  {'110': [], '710': [], '810': []}  1994       1994   \n",
       "181                  {'110': [], '710': [], '810': []}  2003       2003   \n",
       "190                  {'110': [], '710': [], '810': []}  1963       1963   \n",
       "192                  {'110': [], '710': [], '810': []}  2012       2012   \n",
       "219                  {'110': [], '710': [], '810': []}  1988       1988   \n",
       "220                  {'110': [], '710': [], '810': []}  1975       1975   \n",
       "312                  {'110': [], '710': [], '810': []}  1931       1931   \n",
       "313                  {'110': [], '710': [], '810': []}  1960       1960   \n",
       "348                  {'110': [], '710': [], '810': []}  2012       2012   \n",
       "349                  {'110': [], '710': [], '810': []}  2013       2013   \n",
       "383                  {'110': [], '710': [], '810': []}  1994       1994   \n",
       "384                  {'110': [], '710': [], '810': []}  1985       1985   \n",
       "385                  {'110': [], '710': [], '810': []}  1996       1996   \n",
       "392                  {'110': [], '710': [], '810': []}  1996       1996   \n",
       "393                  {'110': [], '710': [], '810': []}  2010       2010   \n",
       "396                  {'110': [], '710': [], '810': []}  2015       2015   \n",
       "440                  {'110': [], '710': [], '810': []}  2015       2015   \n",
       "444                  {'110': [], '710': [], '810': []}  2013       2013   \n",
       "448                  {'110': [], '710': [], '810': []}  2012       2012   \n",
       "479                  {'110': [], '710': [], '810': []}  1901       1901   \n",
       "482                  {'110': [], '710': [], '810': []}  1922       1922   \n",
       "489                  {'110': [], '710': [], '810': []}  2005       2005   \n",
       "590                  {'110': [], '710': [], '810': []}  2015       2015   \n",
       "591                  {'110': [], '710': [], '810': []}  2008       2008   \n",
       "\n",
       "    century exactDate                      edition         part  \\\n",
       "0      2009  2009                                        [6120]   \n",
       "4      1990  1990                                            []   \n",
       "8      2007  2007                                            []   \n",
       "13     1996  1996                   [87.-88. Tsd.]       [2191]   \n",
       "16     2001  2001                          3. Aufl       [5105]   \n",
       "20     2000  2000        [new ed., 2nd impression]           []   \n",
       "26     1996  1996                                         [[1]]   \n",
       "42     1983  1983                                            []   \n",
       "53     2002  2002                                            []   \n",
       "62     1953  1953                                            []   \n",
       "64     2009  2009                                            []   \n",
       "68     2009  2009      Ungekürzte Ausgabe, 2. Aufl      [90041]   \n",
       "75     2007  2007                                   [Nr. 20008]   \n",
       "78     200u  200u                                            []   \n",
       "79     1999  1999                         6th impr           []   \n",
       "103    uuuu  uuuuuuuu                                        []   \n",
       "115    1955  1955                                         [129]   \n",
       "119    1985  1985                                    [Nr. 7633]   \n",
       "123    1980  1980                                    [Nr. 7633]   \n",
       "150    1988  1988                [11th impression]           []   \n",
       "164    1994  1994                        [Reprint]           []   \n",
       "181    2003  2003                                            []   \n",
       "190    1963  1963                                            []   \n",
       "192    2012  2012                                            []   \n",
       "219    1988  1988                     3rd ed. repr     [vol. 4]   \n",
       "220    1975  1975                          [Repr.]           []   \n",
       "312    1931  1931                                          [24]   \n",
       "313    1960  1960                                            []   \n",
       "348    2012  2012                                            []   \n",
       "349    2013  2013                          1. Aufl           []   \n",
       "383    1994  1994                                            []   \n",
       "384    1985  1985                                            []   \n",
       "385    1996  1996                                        [2191]   \n",
       "392    1996  1996                                            []   \n",
       "393    2010  2010                                            []   \n",
       "396    2015  2015            Durchgesehene Ausgabe           []   \n",
       "440    2015  2015                                            []   \n",
       "444    2013  2013                         Pbk. ed.           []   \n",
       "448    2012  2012                                            []   \n",
       "479    1901  1901                                            []   \n",
       "482    1922  1922                                            []   \n",
       "489    2005  2005                                            []   \n",
       "590    2015  2015                                            []   \n",
       "591    2008  2008                         Reissued           []   \n",
       "\n",
       "                                  pages                             volumes  \\\n",
       "0                              [575 S.]                            [575 S.]   \n",
       "4                              [445 p.]                            [445 p.]   \n",
       "8                              [495 S.]                            [495 S.]   \n",
       "13                             [414 S.]                            [414 S.]   \n",
       "16                             [553 S.]                            [553 S.]   \n",
       "20                              [59 S.]                             [59 S.]   \n",
       "26                             [560 S.]                            [560 S.]   \n",
       "42                             [471 p.]                            [471 p.]   \n",
       "53                    [1 Videocassetta]                   [1 Videocassetta]   \n",
       "62                             [377 S.]                            [377 S.]   \n",
       "64                             [450 S.]                            [450 S.]   \n",
       "68                             [509 S.]                            [509 S.]   \n",
       "75                             [600 S.]                            [600 S.]   \n",
       "78                             [367 S.]                            [367 S.]   \n",
       "79                              [59 S.]                             [59 S.]   \n",
       "103                                  []                                  []   \n",
       "115                       [XIV, 432 S.]                       [XIV, 432 S.]   \n",
       "119                            [560 S.]                            [560 S.]   \n",
       "123                            [560 S.]                            [560 S.]   \n",
       "150                            [367 S.]                            [367 S.]   \n",
       "164                            [3 vol.]                            [3 vol.]   \n",
       "181                            [590 S.]                            [590 S.]   \n",
       "190                            [127 p.]                            [127 p.]   \n",
       "192                            [735 S.]                            [735 S.]   \n",
       "219                        [XI, 521 p.]                        [XI, 521 p.]   \n",
       "220                            [471 p.]                            [471 p.]   \n",
       "312                            [395 p.]                            [395 p.]   \n",
       "313                            [521 p.]                            [521 p.]   \n",
       "348     [1 livre électronique (e-book)]     [1 livre électronique (e-book)]   \n",
       "349                  [Online Ressource]                  [Online Ressource]   \n",
       "383                            [367 S.]                            [367 S.]   \n",
       "384                            [471 S.]                            [471 S.]   \n",
       "385                            [414 S.]                            [414 S.]   \n",
       "392                             [64 S.]                             [64 S.]   \n",
       "393                            [144 S.]                            [144 S.]   \n",
       "396                            [600 S.]                            [600 S.]   \n",
       "440                            [459 p.]                            [459 p.]   \n",
       "444                            [600 p.]                            [600 p.]   \n",
       "448                             [485 S]                             [485 S]   \n",
       "479                     [XVIII, 436 p.]                     [XVIII, 436 p.]   \n",
       "482                         [V, 395 p.]                         [V, 395 p.]   \n",
       "489  [3 disque compact ( env. 213 min)]  [3 disque compact ( env. 213 min)]   \n",
       "590                            [448 p.]                            [448 p.]   \n",
       "591                        [402 Seiten]                        [402 Seiten]   \n",
       "\n",
       "                          pubinit                       pubword scale  \\\n",
       "0            [Aufbau Taschenbuch]          [Aufbau Taschenbuch]         \n",
       "4       [Oxford University Press]     [Oxford University Press]         \n",
       "8                 [Vintage Books]               [Vintage Books]         \n",
       "13   [Fischer-Taschenbuch-Verlag]  [Fischer-Taschenbuch-Verlag]         \n",
       "16    [Aufbau Taschenbuch-Verlag]   [Aufbau Taschenbuch-Verlag]         \n",
       "20        [Pearson Education Ltd]       [Pearson Education Ltd]         \n",
       "26                             []                            []         \n",
       "42                [Penguin Books]               [Penguin Books]         \n",
       "53               [Caritas Ticino]              [Caritas Ticino]         \n",
       "62                      [Collins]                     [Collins]         \n",
       "64                     [Albatros]                    [Albatros]         \n",
       "68   [Fischer-Taschenbuch-Verlag]  [Fischer-Taschenbuch-Verlag]         \n",
       "75                       [Reclam]                      [Reclam]         \n",
       "78                [Penguin Books]               [Penguin Books]         \n",
       "79                      [Pearson]                     [Pearson]         \n",
       "103                            []                            []         \n",
       "115                            []                            []         \n",
       "119                            []                            []         \n",
       "123                            []                            []         \n",
       "150                            []                            []         \n",
       "164    [Routledge/Thoemmes Press]    [Routledge/Thoemmes Press]         \n",
       "181                         [CRW]                         [CRW]         \n",
       "190             [Peninsula press]             [Peninsula press]         \n",
       "192   [Fischer Taschenbuch Verl.]   [Fischer Taschenbuch Verl.]         \n",
       "219     [Oxford University Press]     [Oxford University Press]         \n",
       "220               [Penguin Books]               [Penguin Books]         \n",
       "312          [J.M. Dent and Sons]          [J.M. Dent and Sons]         \n",
       "313     [Oxford University Press]     [Oxford University Press]         \n",
       "348           [Le Livre de Poche]           [Le Livre de Poche]         \n",
       "349          [Null Papier Verlag]          [Null Papier Verlag]         \n",
       "383                     [Penguin]                     [Penguin]         \n",
       "384                     [Penguin]                     [Penguin]         \n",
       "385                     [Fischer]                     [Fischer]         \n",
       "392                            []                            []         \n",
       "393        [Black Cat Publishing]        [Black Cat Publishing]         \n",
       "396                      [Reclam]                      [Reclam]         \n",
       "440               [Penguin Books]               [Penguin Books]         \n",
       "444  [Cambridge University Press]  [Cambridge University Press]         \n",
       "448                     [Penguin]                     [Penguin]         \n",
       "479                   [Macmillan]                   [Macmillan]         \n",
       "482          [J.M. Dent and sons]          [J.M. Dent and sons]         \n",
       "489                   [Macmilian]                   [Macmilian]         \n",
       "590       [Race Point Publishing]       [Race Point Publishing]         \n",
       "591                            []                            []         \n",
       "\n",
       "    coordinate doi ismn musicid      format  \n",
       "0           []  []   []          [BK020000]  \n",
       "4           []  []   []          [BK020000]  \n",
       "8           []  []   []          [BK020000]  \n",
       "13          []  []   []          [BK020000]  \n",
       "16          []  []   []          [BK020000]  \n",
       "20          []  []   []          [BK020000]  \n",
       "26          []  []   []          [BK020000]  \n",
       "42          []  []   []          [BK020000]  \n",
       "53          []  []   []          [VM010200]  \n",
       "62          []  []   []          [BK020000]  \n",
       "64          []  []   []          [BK020000]  \n",
       "68          []  []   []          [BK020000]  \n",
       "75          []  []   []          [BK020000]  \n",
       "78          []  []   []          [BK020000]  \n",
       "79          []  []   []          [BK020000]  \n",
       "103         []  []   []          [MU040100]  \n",
       "115         []  []   []          [BK020000]  \n",
       "119         []  []   []          [BK020000]  \n",
       "123         []  []   []          [BK020000]  \n",
       "150         []  []   []          [BK020000]  \n",
       "164         []  []   []          [BK020000]  \n",
       "181         []  []   []          [BK020000]  \n",
       "190         []  []   []          [BK020000]  \n",
       "192         []  []   []          [BK020000]  \n",
       "219         []  []   []          [BK020000]  \n",
       "220         []  []   []          [BK020000]  \n",
       "312         []  []   []          [BK020000]  \n",
       "313         []  []   []          [BK020000]  \n",
       "348         []  []   []          [BK020053]  \n",
       "349         []  []   []          [BK020053]  \n",
       "383         []  []   []          [BK020000]  \n",
       "384         []  []   []          [BK020000]  \n",
       "385         []  []   []          [BK020000]  \n",
       "392         []  []   []          [BK020000]  \n",
       "393         []  []   []          [BK020000]  \n",
       "396         []  []   []          [BK020000]  \n",
       "440         []  []   []          [BK020000]  \n",
       "444         []  []   []          [BK020000]  \n",
       "448         []  []   []          [BK020000]  \n",
       "479         []  []   []          [BK020000]  \n",
       "482         []  []   []          [BK020000]  \n",
       "489         []  []   []          [MU040000]  \n",
       "590         []  []   []          [BK020000]  \n",
       "591         []  []   []          [BK020000]  "
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "goldstandard['uniques'][\n",
    "    goldstandard['uniques'].ttlfull.apply(lambda x : x['245'][0]).str.contains('Emma')\n",
    "]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Number of records in unique.json with string 'Emma' : 44\n"
     ]
    }
   ],
   "source": [
    "print('Number of records in unique.json with string \\'Emma\\' :', len(\n",
    "    goldstandard['uniques'][\n",
    "        goldstandard['uniques'].ttlfull.apply(lambda x : x['245'][0]).str.contains('Emma')])\n",
    "     )"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The number of unique records of file $\\texttt{unique.json}$ is 44. The data of the records reveal that none of them can be associated as duplicate of a record in $\\texttt{master.json}$. These unique records are excellent training data for deduplication as they can be used for training of similar but non-duplicate, thus unique record pairs."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The goal of generating training and test data with the help of the goldstandard is to generate two categories of training data.\n",
    "\n",
    "- The first category consists of records of pairs of the original records out of file $\\texttt{slave.json}$ that have a label 'duplicates'. This will be accomplished with the help of the records of file $\\texttt{master.json}$, see subsection [Generating Pairs of Duplicates](#Generating-Pairs-of-Duplicates).\n",
    "- The second category consists of records of pairs of the original records out of files $\\texttt{slave.json}$ and $\\texttt{unique.json}$ that have a label 'uniques', see subsection [Generating Pairs of Uniques](#Generating-Pairs-of-Uniques)."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "To calculate the number of possible duplicate pairs the formula\n",
    "$$Tot_{duplicate\\ pairs} = \\sum_{i=1}^{M} \\frac{1}{2}S_i \\cdot \\left(S_i-1\\right)$$\n",
    "where $M$ is the number of records in file $\\texttt{master.json}$ and $S_i$ are the number of records in file $\\texttt{slave.json}$ that are associated with master record $m_i$. As the number of slave records must be counted for each master record and as this number can only be deduced out of the goldstandard data, it is not possible to calculate the number of expected duplicate pair records in advance."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Generating Pairs of Duplicates"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The central attribute for retrieving duplicates in the goldstandard data is attribute $\\texttt{035liste}$, see chapter [Data Analysis](./1_DataAnalysis.ipynb). It helps to identify the associated master record for a given record of file $\\texttt{slave.json}$. The process implemented below parses the list of identifiers in attribute $\\texttt{035liste}$ of each record in file $\\texttt{slave.json}$ and searches the value of the identifier in the attribute $\\texttt{035liste}$ of all records of file $\\texttt{master.json}$. When the identifier is found in file $\\texttt{master.json}$, the master record's attribute $\\texttt{docid}$ is stored as a new column in the slave DataFrame, see figure [Slave/master relationship](#slave_master_relationship). The new attribute in the slave record has the meaning of a foreign key to the related master record. This process is repeated for each list element of one slave record and for each record in the data file $\\texttt{slave.json}$."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<center>\n",
    "    <b>Figure</b><a id='slave_master_relationship'></a> Slave/master relationship.\n",
    "    <img src=\"./documentation/training_data.png\" style=\"width: 600px;\"/></p>\n",
    "</center>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As will be shown below, the relationship of a slave record to its master record is unique. Even if there is more than one entry in the list of attribute $\\texttt{035liste}$ of a slave record it will be shown that all distinct entries of a $\\texttt{035liste}$ attribute list of one slave record point to one and the same master record."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Attribute $\\texttt{035liste}$ will not be used in training nore in perfomance testing of the models. The column will be removed before model training."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Generating Pairs of Uniques"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "File $\\texttt{unique.json}$ holds data of unique records. For training and testing purposes, pairs of records could be generated exclusively with the records out of this file. This would generate record pairs with label 'uniques' which can be clearly distinguished and therefore clearly be recognized as non-duplicate pairs. A more interesting pairing of records can be generated with records out of $\\texttt{slave.json}$ and records out of $\\texttt{unique.json}$. Pairs of records that are produced in a mixture of both sources, may reveal similarities in their attributes pairing that make these pairs more difficult for classifying clearly as uniques.\n",
    "\n",
    "A mixture of both pairing sources will be implemented for the generation of training and testing data. The pairing combinations of all available unique records with all available slave records is done with a Cartesian product and its number calculates to the following value."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Total expected number of pairs of uniques for training and testing : 259,260\n"
     ]
    }
   ],
   "source": [
    "print('Total expected number of pairs of uniques for training and testing : {:,d}'.format(\n",
    "    len(goldstandard['uniques'])*len(goldstandard['slaves'])))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Of course, this estimated amount only holds true, if the records of slaves do not have any duplicates in the records of uniques. Whether this is the case in the goldstandard data, will be investigated below."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Transform Attributes for Similarity Comparison"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Before pairing the records into a DataFrame that will be used for the feature matrix, the attributes of the goldstandard data will be processed into their form to be used for generating the similarity matrix. This step could be done after the pairing step. Doing it before building pairs, avoids transformation of the same attributes several times and reduces the amount of transformation to the amount of raw data in the goldstandard instead of the multiplied data of the paired records."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As the data preparation of the attributes will be reused in chapter [Data Synthesizing](./3_DataSynthesizing.ipynb), it has been encapsulated into a separate function of library [data_preparation_funcs.py](./data_preparation_funcs.py), which handles the processing of all relevant attributes. This function will be called below."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [],
   "source": [
    "import data_preparation_funcs as dpf\n",
    "\n",
    "for i in ['slaves', 'masters', 'uniques']:\n",
    "    goldstandard[i] = dpf.attribute_preprocessing(\n",
    "        goldstandard[i],\n",
    "        columns_metadata_dict['data_analysis_columns'], strip_number_digits)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### ismn"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "31                                  m006450510\n",
       "132                                 m006546756\n",
       "164                                 m006546749\n",
       "171                                 m006450510\n",
       "191    m006546756 (kritischer bericht, leinen)\n",
       "225                                 m006450510\n",
       "228                                 m006204687\n",
       "418                              9790006450510\n",
       "419                                 m200205343\n",
       "420                                 m006204687\n",
       "429    m006546756 (kritischer bericht, leinen)\n",
       "Name: ismn, dtype: object"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "35                                  m200205343\n",
       "37                                  m006450510\n",
       "123    m006546756 (kritischer bericht, leinen)\n",
       "149                                 m006204687\n",
       "150                                 m006450510\n",
       "157                                 m006546749\n",
       "Name: ismn, dtype: object"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "34        m700241001\n",
       "151    9790200207781\n",
       "193    9790006450510\n",
       "282       m006450510\n",
       "340       m008060205\n",
       "342       m006450510\n",
       "388    9790006201334\n",
       "498    9790006201334\n",
       "589    9790006450510\n",
       "Name: ismn, dtype: object"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "for i in ['slaves', 'masters', 'uniques']:\n",
    "    display(goldstandard[i].ismn[goldstandard[i].ismn.apply(lambda x : len(x)>0)])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "A vanishingly small number of rows with real ismn identifyers had been found in the data of chapter [Data Analysis](./1_DataAnalysis.ipynb). In the goldstandard data, the amount of real ismn identifyers found is fair. As there will be training data with filled attribute $\\texttt{ismn}$, the attribute will be kept for the feature matrix."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [],
   "source": [
    "#columns_metadata_dict['data_analysis_columns'].remove('ismn')\n",
    "#columns_metadata_dict['columns_to_use'].remove('ismn_x')\n",
    "#columns_metadata_dict['columns_to_use'].remove('ismn_y')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Build Pairs of Duplicates"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As a first step, the relationship between slaves records and masters records is investigated. Thereafter, the records of pairs of duplicates will be generated."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [],
   "source": [
    "for i in range(len(goldstandard['slaves'])):\n",
    "    if len(goldstandard['masters'][goldstandard['masters'].docid == goldstandard['slaves'].docid.loc[i]]) > 0 :\n",
    "        print('STOP!')\n",
    "        break"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The silence of the code cell above shows that there is no record in file $\\texttt{slaves.json}$ that has the same $\\texttt{docid}$ like any record in file $\\texttt{masters.json}$. Attribute $\\texttt{docid}$ is irrelevant for identifying pairs of duplicates."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Slaves Masters Relationships"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "To understand, how to build pairs of duplicates, let's have a look at some sample data."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "slaves\n",
      "157    [(OCoLC)611272989, (NEBIS)004327684]\n",
      "344     [(SNL)vtls001852009, (Sz)001852009]\n",
      "283    [(OCoLC)828659420, (IDSLU)001183923]\n",
      "100    [(OCoLC)604626760, (IDSBB)002888099]\n",
      "7        [(OCoLC)887393628, (ABN)000218626]\n",
      "Name: 035liste, dtype: object\n",
      "\n",
      "masters\n",
      "8      [(SBT)000762391, (VAUD)991001881179702852, (RN...\n",
      "155                      [(SGBN)000610425, (KBTG)131754]\n",
      "38     [(IDSLU)000489765, (BGR)000119170, (IDSBB)0059...\n",
      "45                   [(RERO)R008100270, (SGBN)000329876]\n",
      "123    [(RERO)0209667, (VAUD)991010321879702852, (RNV...\n",
      "Name: 035liste, dtype: object\n",
      "\n",
      "uniques\n",
      "458    [(OCoLC)951113986, (IDSBB)006619280, (OCoLC)95...\n",
      "56                   [(OCoLC)821092445, (SGBN)000463693]\n",
      "488    [(VAUD)991002318329702853, (RNV)007231843-41bc...\n",
      "442                  [(OCoLC)85326008, (IDSBB)006471858]\n",
      "475                                   [(RERO)R008583666]\n",
      "Name: 035liste, dtype: object\n"
     ]
    }
   ],
   "source": [
    "for i in ['slaves', 'masters', 'uniques']:\n",
    "    print(f'\\n{i}')\n",
    "    print(goldstandard[i]['035liste'].sample(n=5))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "slaves record 0 holds in 035liste position 1 a reference to masters record 85\n",
      "slaves record 1 holds in 035liste position 1 a reference to masters record 145\n",
      "slaves record 2 holds in 035liste position 1 a reference to masters record 119\n",
      "slaves record 3 holds in 035liste position 1 a reference to masters record 57\n",
      "etc.\n"
     ]
    }
   ],
   "source": [
    "for i in range(len(goldstandard['slaves'])):\n",
    "    if i < 4:\n",
    "        for j in range(len(goldstandard['slaves']['035liste'][i])):\n",
    "            for k in range(len(goldstandard['masters'])):\n",
    "                if goldstandard['slaves']['035liste'][i][j] in goldstandard['masters']['035liste'][k]:\n",
    "                    print('slaves record', i, 'holds in 035liste position', j, 'a reference to masters record', k)\n",
    "print('etc.')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The code above shows a relationship between records out of $\\texttt{slaves.json}$ and records out of $\\texttt{masters.json}$. This relationship is established with the entries in attribute $\\texttt{035liste}$. The next step is to look at record pairs that have this relationship."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Example pair 1\n",
      "slaves record ['(OCoLC)731635279', '(ABN)000539983'] \n",
      "masters record ['(NEBIS)009587153', '(LIBIB)000315536', '(ABN)000539983']\n",
      "\n",
      "Example pair 2\n",
      "slaves record ['(OCoLC)808324878', '(ABN)000155059'] \n",
      "masters record ['(IDSBB)003690925', '(NEBIS)005645758', '(RERO)R003034172', '(ABN)000155059']\n",
      "\n",
      "Example pair 3\n",
      "slaves record ['(OCoLC)231772550', '(ABN)000096920'] \n",
      "masters record ['(IDSBB)001651899', '(NEBIS)001974886', '(IDSSG)000177847', '(SGBN)000249023', '(SNL)vtls001203051', '(IDSLU)000164505', '(RERO)R243599160', '(VAUD)991016630449702852', '(ABN)000096920', '(Sz)001203051', '(RNV)002435991-41bculausa_network', '(RERO)002435991', 'R243599160', '(EXLNZ-41BCULAUSA_NETWORK)991020678209702851']\n",
      "\n",
      "Example pair 4\n",
      "slaves record ['(OCoLC)887157168', '(ABN)000223912'] \n",
      "masters record ['(IDSBB)004654810', '(ABN)000223912']\n"
     ]
    }
   ],
   "source": [
    "sample_pair_1 = [0, 85]\n",
    "sample_pair_2 = [1, 145]\n",
    "sample_pair_3 = [2, 119]\n",
    "sample_pair_4 = [3, 57]\n",
    "\n",
    "print('Example pair 1')\n",
    "print('slaves record', goldstandard['slaves']['035liste'][sample_pair_1[0]], '\\nmasters record', goldstandard['masters']['035liste'][sample_pair_1[1]])\n",
    "print('\\nExample pair 2')\n",
    "print('slaves record', goldstandard['slaves']['035liste'][sample_pair_2[0]], '\\nmasters record', goldstandard['masters']['035liste'][sample_pair_2[1]])\n",
    "print('\\nExample pair 3')\n",
    "print('slaves record', goldstandard['slaves']['035liste'][sample_pair_3[0]], '\\nmasters record', goldstandard['masters']['035liste'][sample_pair_3[1]])\n",
    "print('\\nExample pair 4')\n",
    "print('slaves record', goldstandard['slaves']['035liste'][sample_pair_4[0]], '\\nmasters record', goldstandard['masters']['035liste'][sample_pair_4[1]])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "pair-------------------------------------> [0, 85]\n",
      "docid                                                     000311049\n",
      "035liste                         [(OCoLC)731635279, (ABN)000539983]\n",
      "isbn                                            [978-3-15-020008-7]\n",
      "ttlpart                                  {'245': ['Emma', 'Roman']}\n",
      "pubyear                                                    2009    \n",
      "decade                                                         2009\n",
      "century                                                        2009\n",
      "exactDate                                                  2009uuuu\n",
      "edition                                                            \n",
      "part                                                          20008\n",
      "pages                                                      [600 S.]\n",
      "volumes                                                         600\n",
      "pubinit                                                 reclam jun.\n",
      "pubword                                               [Reclam jun.]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                               austenjane\n",
      "person_700                              grawechristian, graweursula\n",
      "person_245c       jane austen ; aus dem englischen übersetzt von...\n",
      "ttlfull_245                                             emma, roman\n",
      "ttlfull_246                                                        \n",
      "Name: 0, dtype: object \n",
      "\n",
      "docid                                                     504389793\n",
      "035liste          [(NEBIS)009587153, (LIBIB)000315536, (ABN)0005...\n",
      "isbn                                            [978-3-15-020008-7]\n",
      "ttlpart                                           {'245': ['Emma']}\n",
      "pubyear                                                    2009    \n",
      "decade                                                         2009\n",
      "century                                                        2009\n",
      "exactDate                                                  2009uuuu\n",
      "edition                                                            \n",
      "part                                                          20008\n",
      "pages                                                      [600 S.]\n",
      "volumes                                                         600\n",
      "pubinit                                                      reclam\n",
      "pubword                                                    [Reclam]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                               austenjane\n",
      "person_700                                                         \n",
      "person_245c       jane austen ; aus dem engl. übers. von ursula ...\n",
      "ttlfull_245                                                    emma\n",
      "ttlfull_246                                                        \n",
      "Name: 85, dtype: object\n",
      "\n",
      "pair-------------------------------------> [1, 145]\n",
      "docid                                                     00130724X\n",
      "035liste                         [(OCoLC)808324878, (ABN)000155059]\n",
      "isbn                                                             []\n",
      "ttlpart           {'245': ['Die Zauberflöte', 'Oper in zwei Aufz...\n",
      "pubyear                                                    2000    \n",
      "decade                                                         2000\n",
      "century                                                        2000\n",
      "exactDate                                                  2000uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                  [1 DVD-Video, DVD Region 0, 169 Min., farb.]\n",
      "volumes                                                     1 0 169\n",
      "pubinit                                         deutsche grammophon\n",
      "pubword                                       [Deutsche Grammophon]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710     metropolitan opera orchestra, metropolitan ope...\n",
      "corporate_full    metropolitan opera orchestra, metropolitan ope...\n",
      "format_prefix                                                    vm\n",
      "format_postfix                                               010300\n",
      "person_100                                          levinejamesdir.\n",
      "person_700        mozartwolfgang amadeus, levinejames, schikaned...\n",
      "person_245c       w. a. mozart ; libretto: emanuel schikaneder ;...\n",
      "ttlfull_245                  die zauberflöte, oper in zwei aufzügen\n",
      "ttlfull_246                                                        \n",
      "Name: 1, dtype: object \n",
      "\n",
      "docid                                                     504390597\n",
      "035liste          [(IDSBB)003690925, (NEBIS)005645758, (RERO)R00...\n",
      "isbn                                                             []\n",
      "ttlpart           {'245': ['Die Zauberflöte', 'Oper in zwei Aufz...\n",
      "pubyear                                                    2000    \n",
      "decade                                                         2000\n",
      "century                                                        2000\n",
      "exactDate                                                  2000uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                      [1 DVD-Video (169 Min.)]\n",
      "volumes                                                       1 169\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                         073\n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710     metropolitan operaorchestra, metropolitan oper...\n",
      "corporate_full    metropolitan operaorchestra, metropolitan oper...\n",
      "format_prefix                                                    vm\n",
      "format_postfix                                               010300\n",
      "person_100                                   mozartwolfgang amadeus\n",
      "person_700            schikanederemanuel, hockneydavid, levinejames\n",
      "person_245c            w. a. mozart ; libretto: emanuel schikaneder\n",
      "ttlfull_245         die zauberflöte, oper in zwei aufzügen : kv 620\n",
      "ttlfull_246                                                        \n",
      "Name: 145, dtype: object\n",
      "\n",
      "pair-------------------------------------> [2, 119]\n",
      "docid                                                     001817272\n",
      "035liste                         [(OCoLC)231772550, (ABN)000096920]\n",
      "isbn                                                [3-495-47879-5]\n",
      "ttlpart           {'245': ['Der moralische Status der Tiere', 'H...\n",
      "pubyear                                                    1999    \n",
      "decade                                                         1999\n",
      "century                                                        1999\n",
      "exactDate                                                  1999uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                      [316 S.]\n",
      "volumes                                                         316\n",
      "pubinit                                                       alber\n",
      "pubword                                                     [Alber]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                             fluryandreas\n",
      "person_700                                                         \n",
      "person_245c                                           andreas flury\n",
      "ttlfull_245       der moralische status der tiere, henry salt, p...\n",
      "ttlfull_246                                                        \n",
      "Name: 2, dtype: object \n",
      "\n",
      "docid                                                     50439018X\n",
      "035liste          [(IDSBB)001651899, (NEBIS)001974886, (IDSSG)00...\n",
      "isbn                                                [3-495-47879-5]\n",
      "ttlpart           {'245': ['Der moralische Status der Tiere', 'H...\n",
      "pubyear                                                    1999    \n",
      "decade                                                         1999\n",
      "century                                                        1999\n",
      "exactDate                                                  1999uuuu\n",
      "edition                                                            \n",
      "part                                                          57 57\n",
      "pages                                                      [316 S.]\n",
      "volumes                                                         316\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                             fluryandreas\n",
      "person_700                                                         \n",
      "person_245c                                           andreas flury\n",
      "ttlfull_245       der moralische status der tiere, henry salt, p...\n",
      "ttlfull_246                                                        \n",
      "Name: 119, dtype: object\n",
      "\n",
      "pair-------------------------------------> [3, 57]\n",
      "docid                                      00236865X\n",
      "035liste          [(OCoLC)887157168, (ABN)000223912]\n",
      "isbn                                              []\n",
      "ttlpart                 {'245': ['Die Zauberflöte']}\n",
      "pubyear                                     uuuuuuuu\n",
      "decade                                          uuuu\n",
      "century                                         uuuu\n",
      "exactDate                                   uuuuuuuu\n",
      "edition                                             \n",
      "part                                                \n",
      "pages                                       [412 S.]\n",
      "volumes                                          412\n",
      "pubinit                              ernst eulenburg\n",
      "pubword                            [Ernst Eulenburg]\n",
      "scale                                               \n",
      "coordinate                                        []\n",
      "doi                                                 \n",
      "ismn                                                \n",
      "musicid                                             \n",
      "coordinate_E                                        \n",
      "coordinate_N                                        \n",
      "corporate_110                                       \n",
      "corporate_710                                       \n",
      "corporate_full                                      \n",
      "format_prefix                                     bk\n",
      "format_postfix                                020000\n",
      "person_100                    mozartwolfgang amadeus\n",
      "person_700                                          \n",
      "person_245c                                         \n",
      "ttlfull_245                          die zauberflöte\n",
      "ttlfull_246                                         \n",
      "Name: 3, dtype: object \n",
      "\n",
      "docid                                                     504389513\n",
      "035liste                         [(IDSBB)004654810, (ABN)000223912]\n",
      "isbn                                                             []\n",
      "ttlpart                                {'245': ['Die Zauberflöte']}\n",
      "pubyear                                                    1920    \n",
      "decade                                                         1920\n",
      "century                                                        1920\n",
      "exactDate                                                  1920uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                       [1 Bd.]\n",
      "volumes                                                           1\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                   mozartwolfgang amadeus\n",
      "person_700                                       schikanederemanuel\n",
      "person_245c       w. a. mozart ; oper in 2 akten v. emanuel schi...\n",
      "ttlfull_245                                         die zauberflöte\n",
      "ttlfull_246                                                        \n",
      "Name: 57, dtype: object\n"
     ]
    }
   ],
   "source": [
    "for i in [sample_pair_1, sample_pair_2, sample_pair_3, sample_pair_4]:\n",
    "    print('\\npair------------------------------------->', i)\n",
    "    print(goldstandard['slaves'].loc[i[0]], '\\n')\n",
    "    print(goldstandard['masters'].loc[i[1]])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Record pairs with a relationship are pairs of duplicates of a bibliographic unit. This is according to the description in the first part of this chapter. To identify explicitly which slave record belongs to which master record, attribute $\\texttt{035liste}$ will be used. The following function implements an algorithm that searches for each $\\texttt{035liste}$ value of a slave record its same value in $\\texttt{035liste}$ in the master records. If the record is found in one of the master records, the $\\texttt{docid}$ of this master is stored in a new attribute $\\texttt{masters}\\_\\texttt{docid}$ of the slave record. As there can be more than one element in attribute $\\texttt{035liste}$, there may be several master relationships on a slave record. Therefore, attribute $\\texttt{masters}\\_\\texttt{docid}$ is of type of a list."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {
    "scrolled": true
   },
   "outputs": [],
   "source": [
    "def add_master_docid_to_slave (df_s, df_m):\n",
    "    \"\"\"Determine docid of master and store on slave.\"\"\"\n",
    "    # Initialize Foreign Key list\n",
    "    df_s['masters_docid'] = [list() for x in range(len(df_s.index))]\n",
    "\n",
    "    # Search for master of slave\n",
    "    for i in range(len(df_s)):\n",
    "        loc_li = list()\n",
    "        for j in range(len(df_s['035liste'].loc[i])):\n",
    "            master_index = df_m[df_m['035liste'].str.contains(\n",
    "                df_s['035liste'].loc[i][j], regex=False\n",
    "            )].index\n",
    "            if len(master_index) > 0 : # Skip empty Series\n",
    "                loc_li.append(df_m.docid[master_index].values[0])\n",
    "\n",
    "        df_s['masters_docid'].loc[i] = loc_li\n",
    "    \n",
    "    return df_s"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "250                                     [504389319]\n",
       "404    [504390457, 504390457, 504390457, 504390457]\n",
       "204                                     [504389602]\n",
       "128                          [504389785, 504389785]\n",
       "345                                     [504390201]\n",
       "388                          [504389963, 504389963]\n",
       "323                                     [504389874]\n",
       "288                                     [504388908]\n",
       "61                                      [50438984X]\n",
       "148                                     [504389955]\n",
       "Name: masters_docid, dtype: object"
      ]
     },
     "execution_count": 22,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "goldstandard['slaves'] = add_master_docid_to_slave(goldstandard['slaves'], goldstandard['masters'])\n",
    "\n",
    "goldstandard['slaves'].masters_docid.sample(n=10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Looking at the same samples as above, shows a new attribute $\\texttt{masters}\\_\\texttt{docid}$ in the slaves record, which holds the docid value of its related master record. This is true for each pair of records, see below."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "pair-------------------------------------> [0, 85]\n",
      "docid                                                     000311049\n",
      "035liste                         [(OCoLC)731635279, (ABN)000539983]\n",
      "isbn                                            [978-3-15-020008-7]\n",
      "ttlpart                                  {'245': ['Emma', 'Roman']}\n",
      "pubyear                                                    2009    \n",
      "decade                                                         2009\n",
      "century                                                        2009\n",
      "exactDate                                                  2009uuuu\n",
      "edition                                                            \n",
      "part                                                          20008\n",
      "pages                                                      [600 S.]\n",
      "volumes                                                         600\n",
      "pubinit                                                 reclam jun.\n",
      "pubword                                               [Reclam jun.]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                               austenjane\n",
      "person_700                              grawechristian, graweursula\n",
      "person_245c       jane austen ; aus dem englischen übersetzt von...\n",
      "ttlfull_245                                             emma, roman\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                           [504389793]\n",
      "Name: 0, dtype: object \n",
      "\n",
      "docid                                                     504389793\n",
      "035liste          [(NEBIS)009587153, (LIBIB)000315536, (ABN)0005...\n",
      "isbn                                            [978-3-15-020008-7]\n",
      "ttlpart                                           {'245': ['Emma']}\n",
      "pubyear                                                    2009    \n",
      "decade                                                         2009\n",
      "century                                                        2009\n",
      "exactDate                                                  2009uuuu\n",
      "edition                                                            \n",
      "part                                                          20008\n",
      "pages                                                      [600 S.]\n",
      "volumes                                                         600\n",
      "pubinit                                                      reclam\n",
      "pubword                                                    [Reclam]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                               austenjane\n",
      "person_700                                                         \n",
      "person_245c       jane austen ; aus dem engl. übers. von ursula ...\n",
      "ttlfull_245                                                    emma\n",
      "ttlfull_246                                                        \n",
      "Name: 85, dtype: object\n",
      "\n",
      "pair-------------------------------------> [1, 145]\n",
      "docid                                                     00130724X\n",
      "035liste                         [(OCoLC)808324878, (ABN)000155059]\n",
      "isbn                                                             []\n",
      "ttlpart           {'245': ['Die Zauberflöte', 'Oper in zwei Aufz...\n",
      "pubyear                                                    2000    \n",
      "decade                                                         2000\n",
      "century                                                        2000\n",
      "exactDate                                                  2000uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                  [1 DVD-Video, DVD Region 0, 169 Min., farb.]\n",
      "volumes                                                     1 0 169\n",
      "pubinit                                         deutsche grammophon\n",
      "pubword                                       [Deutsche Grammophon]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710     metropolitan opera orchestra, metropolitan ope...\n",
      "corporate_full    metropolitan opera orchestra, metropolitan ope...\n",
      "format_prefix                                                    vm\n",
      "format_postfix                                               010300\n",
      "person_100                                          levinejamesdir.\n",
      "person_700        mozartwolfgang amadeus, levinejames, schikaned...\n",
      "person_245c       w. a. mozart ; libretto: emanuel schikaneder ;...\n",
      "ttlfull_245                  die zauberflöte, oper in zwei aufzügen\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                           [504390597]\n",
      "Name: 1, dtype: object \n",
      "\n",
      "docid                                                     504390597\n",
      "035liste          [(IDSBB)003690925, (NEBIS)005645758, (RERO)R00...\n",
      "isbn                                                             []\n",
      "ttlpart           {'245': ['Die Zauberflöte', 'Oper in zwei Aufz...\n",
      "pubyear                                                    2000    \n",
      "decade                                                         2000\n",
      "century                                                        2000\n",
      "exactDate                                                  2000uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                      [1 DVD-Video (169 Min.)]\n",
      "volumes                                                       1 169\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                         073\n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710     metropolitan operaorchestra, metropolitan oper...\n",
      "corporate_full    metropolitan operaorchestra, metropolitan oper...\n",
      "format_prefix                                                    vm\n",
      "format_postfix                                               010300\n",
      "person_100                                   mozartwolfgang amadeus\n",
      "person_700            schikanederemanuel, hockneydavid, levinejames\n",
      "person_245c            w. a. mozart ; libretto: emanuel schikaneder\n",
      "ttlfull_245         die zauberflöte, oper in zwei aufzügen : kv 620\n",
      "ttlfull_246                                                        \n",
      "Name: 145, dtype: object\n",
      "\n",
      "pair-------------------------------------> [2, 119]\n",
      "docid                                                     001817272\n",
      "035liste                         [(OCoLC)231772550, (ABN)000096920]\n",
      "isbn                                                [3-495-47879-5]\n",
      "ttlpart           {'245': ['Der moralische Status der Tiere', 'H...\n",
      "pubyear                                                    1999    \n",
      "decade                                                         1999\n",
      "century                                                        1999\n",
      "exactDate                                                  1999uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                      [316 S.]\n",
      "volumes                                                         316\n",
      "pubinit                                                       alber\n",
      "pubword                                                     [Alber]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                             fluryandreas\n",
      "person_700                                                         \n",
      "person_245c                                           andreas flury\n",
      "ttlfull_245       der moralische status der tiere, henry salt, p...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                           [50439018X]\n",
      "Name: 2, dtype: object \n",
      "\n",
      "docid                                                     50439018X\n",
      "035liste          [(IDSBB)001651899, (NEBIS)001974886, (IDSSG)00...\n",
      "isbn                                                [3-495-47879-5]\n",
      "ttlpart           {'245': ['Der moralische Status der Tiere', 'H...\n",
      "pubyear                                                    1999    \n",
      "decade                                                         1999\n",
      "century                                                        1999\n",
      "exactDate                                                  1999uuuu\n",
      "edition                                                            \n",
      "part                                                          57 57\n",
      "pages                                                      [316 S.]\n",
      "volumes                                                         316\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                             fluryandreas\n",
      "person_700                                                         \n",
      "person_245c                                           andreas flury\n",
      "ttlfull_245       der moralische status der tiere, henry salt, p...\n",
      "ttlfull_246                                                        \n",
      "Name: 119, dtype: object\n",
      "\n",
      "pair-------------------------------------> [3, 57]\n",
      "docid                                      00236865X\n",
      "035liste          [(OCoLC)887157168, (ABN)000223912]\n",
      "isbn                                              []\n",
      "ttlpart                 {'245': ['Die Zauberflöte']}\n",
      "pubyear                                     uuuuuuuu\n",
      "decade                                          uuuu\n",
      "century                                         uuuu\n",
      "exactDate                                   uuuuuuuu\n",
      "edition                                             \n",
      "part                                                \n",
      "pages                                       [412 S.]\n",
      "volumes                                          412\n",
      "pubinit                              ernst eulenburg\n",
      "pubword                            [Ernst Eulenburg]\n",
      "scale                                               \n",
      "coordinate                                        []\n",
      "doi                                                 \n",
      "ismn                                                \n",
      "musicid                                             \n",
      "coordinate_E                                        \n",
      "coordinate_N                                        \n",
      "corporate_110                                       \n",
      "corporate_710                                       \n",
      "corporate_full                                      \n",
      "format_prefix                                     bk\n",
      "format_postfix                                020000\n",
      "person_100                    mozartwolfgang amadeus\n",
      "person_700                                          \n",
      "person_245c                                         \n",
      "ttlfull_245                          die zauberflöte\n",
      "ttlfull_246                                         \n",
      "masters_docid                            [504389513]\n",
      "Name: 3, dtype: object \n",
      "\n",
      "docid                                                     504389513\n",
      "035liste                         [(IDSBB)004654810, (ABN)000223912]\n",
      "isbn                                                             []\n",
      "ttlpart                                {'245': ['Die Zauberflöte']}\n",
      "pubyear                                                    1920    \n",
      "decade                                                         1920\n",
      "century                                                        1920\n",
      "exactDate                                                  1920uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                       [1 Bd.]\n",
      "volumes                                                           1\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                   mozartwolfgang amadeus\n",
      "person_700                                       schikanederemanuel\n",
      "person_245c       w. a. mozart ; oper in 2 akten v. emanuel schi...\n",
      "ttlfull_245                                         die zauberflöte\n",
      "ttlfull_246                                                        \n",
      "Name: 57, dtype: object\n"
     ]
    }
   ],
   "source": [
    "for i in [sample_pair_1, sample_pair_2, sample_pair_3, sample_pair_4]:\n",
    "    print('\\npair------------------------------------->', i)\n",
    "    print(goldstandard['slaves'].loc[i[0]], '\\n')\n",
    "    print(goldstandard['masters'].loc[i[1]])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "29                                           [504389815]\n",
       "125                                          [504389009]\n",
       "265                                          [504389580]\n",
       "255                                          [504389114]\n",
       "396                               [504390279, 504390279]\n",
       "375    [504390376, 504390376, 504390376, 504390376, 5...\n",
       "414                               [504390872, 504390872]\n",
       "28                                           [504389076]\n",
       "49                                           [504390694]\n",
       "35                                [504389491, 504389491]\n",
       "Name: masters_docid, dtype: object"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "goldstandard['slaves']['masters_docid'].sample(n=10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As the records in the master file are uniques by themselves, for distinctly identifying whether a pair of slave records is a duplicate, the keys in $\\texttt{masters}\\_\\texttt{docid}$ must be unique. In the samples shown above, some cases with more than one entry can be detected. On the other hand, the visual check reveals that they hold identical values. As a next step, all identical values in attribute $\\texttt{masters}\\_\\texttt{docid}$ will be reduced to one distinct entry. This will lead to a list of distinct values."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Proof that all docid_masters are unique...\n",
    "goldstandard['slaves']['masters_docid'] = goldstandard['slaves']['masters_docid'].apply(lambda x : set(x))\n",
    "goldstandard['slaves']['masters_docid'] = goldstandard['slaves']['masters_docid'].apply(lambda x : list(x))\n",
    "\n",
    "for i in range(len(goldstandard['slaves'])):\n",
    "    if len(goldstandard['slaves'].masters_docid.loc[i]) != 1 :\n",
    "        print('STOP!', i)\n",
    "        break"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The silence of the code cell above demonstrates that after reducing the list of $\\texttt{masters}\\_\\texttt{docid}$ to distinct entries, all slave records hold exactly one key reference to a master. This is the basis for joining the data.\n",
    "\n",
    "The list attribute $\\texttt{masters}\\_\\texttt{docid}$ now holds exactly one single element. To remove the list data type and extract its contents to a single string value, the following line of code is executed."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>docid</th>\n",
       "      <th>035liste</th>\n",
       "      <th>isbn</th>\n",
       "      <th>ttlpart</th>\n",
       "      <th>pubyear</th>\n",
       "      <th>decade</th>\n",
       "      <th>century</th>\n",
       "      <th>exactDate</th>\n",
       "      <th>edition</th>\n",
       "      <th>part</th>\n",
       "      <th>pages</th>\n",
       "      <th>...</th>\n",
       "      <th>corporate_110</th>\n",
       "      <th>corporate_710</th>\n",
       "      <th>corporate_full</th>\n",
       "      <th>format_prefix</th>\n",
       "      <th>format_postfix</th>\n",
       "      <th>person_100</th>\n",
       "      <th>person_700</th>\n",
       "      <th>person_245c</th>\n",
       "      <th>ttlfull_245</th>\n",
       "      <th>ttlfull_246</th>\n",
       "      <th>masters_docid</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>000311049</td>\n",
       "      <td>[(OCoLC)731635279, (ABN)000539983]</td>\n",
       "      <td>[978-3-15-020008-7]</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009uuuu</td>\n",
       "      <td></td>\n",
       "      <td>20008</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>...</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>bk</td>\n",
       "      <td>020000</td>\n",
       "      <td>austenjane</td>\n",
       "      <td>grawechristian, graweursula</td>\n",
       "      <td>jane austen ; aus dem englischen übersetzt von...</td>\n",
       "      <td>emma, roman</td>\n",
       "      <td></td>\n",
       "      <td>504389793</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>00130724X</td>\n",
       "      <td>[(OCoLC)808324878, (ABN)000155059]</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Die Zauberflöte', 'Oper in zwei Aufz...</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000uuuu</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>[1 DVD-Video, DVD Region 0, 169 Min., farb.]</td>\n",
       "      <td>...</td>\n",
       "      <td></td>\n",
       "      <td>metropolitan opera orchestra, metropolitan ope...</td>\n",
       "      <td>metropolitan opera orchestra, metropolitan ope...</td>\n",
       "      <td>vm</td>\n",
       "      <td>010300</td>\n",
       "      <td>levinejamesdir.</td>\n",
       "      <td>mozartwolfgang amadeus, levinejames, schikaned...</td>\n",
       "      <td>w. a. mozart ; libretto: emanuel schikaneder ;...</td>\n",
       "      <td>die zauberflöte, oper in zwei aufzügen</td>\n",
       "      <td></td>\n",
       "      <td>504390597</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>001817272</td>\n",
       "      <td>[(OCoLC)231772550, (ABN)000096920]</td>\n",
       "      <td>[3-495-47879-5]</td>\n",
       "      <td>{'245': ['Der moralische Status der Tiere', 'H...</td>\n",
       "      <td>1999</td>\n",
       "      <td>1999</td>\n",
       "      <td>1999</td>\n",
       "      <td>1999uuuu</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>[316 S.]</td>\n",
       "      <td>...</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>bk</td>\n",
       "      <td>020000</td>\n",
       "      <td>fluryandreas</td>\n",
       "      <td></td>\n",
       "      <td>andreas flury</td>\n",
       "      <td>der moralische status der tiere, henry salt, p...</td>\n",
       "      <td></td>\n",
       "      <td>50439018X</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>00236865X</td>\n",
       "      <td>[(OCoLC)887157168, (ABN)000223912]</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Die Zauberflöte']}</td>\n",
       "      <td>uuuuuuuu</td>\n",
       "      <td>uuuu</td>\n",
       "      <td>uuuu</td>\n",
       "      <td>uuuuuuuu</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>[412 S.]</td>\n",
       "      <td>...</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>bk</td>\n",
       "      <td>020000</td>\n",
       "      <td>mozartwolfgang amadeus</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>die zauberflöte</td>\n",
       "      <td></td>\n",
       "      <td>504389513</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>00351031X</td>\n",
       "      <td>[(OCoLC)887324690, (ABN)000548154]</td>\n",
       "      <td>[978-1-4058-8214-9]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008</td>\n",
       "      <td>2008uuuu</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>[64 S.]</td>\n",
       "      <td>...</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>bk</td>\n",
       "      <td>020000</td>\n",
       "      <td>austenjane</td>\n",
       "      <td>strangejoanna</td>\n",
       "      <td>jane austen ; retold by joanna strange</td>\n",
       "      <td>emma</td>\n",
       "      <td></td>\n",
       "      <td>504389823</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 32 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "       docid                            035liste                 isbn  \\\n",
       "0  000311049  [(OCoLC)731635279, (ABN)000539983]  [978-3-15-020008-7]   \n",
       "1  00130724X  [(OCoLC)808324878, (ABN)000155059]                   []   \n",
       "2  001817272  [(OCoLC)231772550, (ABN)000096920]      [3-495-47879-5]   \n",
       "3  00236865X  [(OCoLC)887157168, (ABN)000223912]                   []   \n",
       "4  00351031X  [(OCoLC)887324690, (ABN)000548154]  [978-1-4058-8214-9]   \n",
       "\n",
       "                                             ttlpart   pubyear decade century  \\\n",
       "0                         {'245': ['Emma', 'Roman']}  2009       2009    2009   \n",
       "1  {'245': ['Die Zauberflöte', 'Oper in zwei Aufz...  2000       2000    2000   \n",
       "2  {'245': ['Der moralische Status der Tiere', 'H...  1999       1999    1999   \n",
       "3                       {'245': ['Die Zauberflöte']}  uuuuuuuu   uuuu    uuuu   \n",
       "4                                  {'245': ['Emma']}  2008       2008    2008   \n",
       "\n",
       "  exactDate edition   part                                         pages  ...  \\\n",
       "0  2009uuuu          20008                                      [600 S.]  ...   \n",
       "1  2000uuuu                 [1 DVD-Video, DVD Region 0, 169 Min., farb.]  ...   \n",
       "2  1999uuuu                                                     [316 S.]  ...   \n",
       "3  uuuuuuuu                                                     [412 S.]  ...   \n",
       "4  2008uuuu                                                      [64 S.]  ...   \n",
       "\n",
       "  corporate_110                                      corporate_710  \\\n",
       "0                                                                    \n",
       "1                metropolitan opera orchestra, metropolitan ope...   \n",
       "2                                                                    \n",
       "3                                                                    \n",
       "4                                                                    \n",
       "\n",
       "                                      corporate_full format_prefix  \\\n",
       "0                                                               bk   \n",
       "1  metropolitan opera orchestra, metropolitan ope...            vm   \n",
       "2                                                               bk   \n",
       "3                                                               bk   \n",
       "4                                                               bk   \n",
       "\n",
       "  format_postfix              person_100  \\\n",
       "0         020000              austenjane   \n",
       "1         010300         levinejamesdir.   \n",
       "2         020000            fluryandreas   \n",
       "3         020000  mozartwolfgang amadeus   \n",
       "4         020000              austenjane   \n",
       "\n",
       "                                          person_700  \\\n",
       "0                        grawechristian, graweursula   \n",
       "1  mozartwolfgang amadeus, levinejames, schikaned...   \n",
       "2                                                      \n",
       "3                                                      \n",
       "4                                      strangejoanna   \n",
       "\n",
       "                                         person_245c  \\\n",
       "0  jane austen ; aus dem englischen übersetzt von...   \n",
       "1  w. a. mozart ; libretto: emanuel schikaneder ;...   \n",
       "2                                      andreas flury   \n",
       "3                                                      \n",
       "4             jane austen ; retold by joanna strange   \n",
       "\n",
       "                                         ttlfull_245 ttlfull_246 masters_docid  \n",
       "0                                        emma, roman                 504389793  \n",
       "1             die zauberflöte, oper in zwei aufzügen                 504390597  \n",
       "2  der moralische status der tiere, henry salt, p...                 50439018X  \n",
       "3                                    die zauberflöte                 504389513  \n",
       "4                                               emma                 504389823  \n",
       "\n",
       "[5 rows x 32 columns]"
      ]
     },
     "execution_count": 26,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "goldstandard['slaves']['masters_docid'] = goldstandard['slaves']['masters_docid'].apply(lambda x : x[0])\n",
    "goldstandard['slaves'].head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Joining all slave records with all master records must result in a number of pairs that is equal to the number of master records, loaded at the beginning of this chapter."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Number of paired slave/master records 435\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>docid_x</th>\n",
       "      <th>035liste_x</th>\n",
       "      <th>isbn_x</th>\n",
       "      <th>ttlpart_x</th>\n",
       "      <th>pubyear_x</th>\n",
       "      <th>decade_x</th>\n",
       "      <th>century_x</th>\n",
       "      <th>exactDate_x</th>\n",
       "      <th>edition_x</th>\n",
       "      <th>part_x</th>\n",
       "      <th>pages_x</th>\n",
       "      <th>volumes_x</th>\n",
       "      <th>pubinit_x</th>\n",
       "      <th>pubword_x</th>\n",
       "      <th>scale_x</th>\n",
       "      <th>coordinate_x</th>\n",
       "      <th>doi_x</th>\n",
       "      <th>ismn_x</th>\n",
       "      <th>musicid_x</th>\n",
       "      <th>coordinate_E_x</th>\n",
       "      <th>coordinate_N_x</th>\n",
       "      <th>corporate_110_x</th>\n",
       "      <th>corporate_710_x</th>\n",
       "      <th>corporate_full_x</th>\n",
       "      <th>format_prefix_x</th>\n",
       "      <th>format_postfix_x</th>\n",
       "      <th>person_100_x</th>\n",
       "      <th>person_700_x</th>\n",
       "      <th>person_245c_x</th>\n",
       "      <th>ttlfull_245_x</th>\n",
       "      <th>ttlfull_246_x</th>\n",
       "      <th>masters_docid</th>\n",
       "      <th>docid_y</th>\n",
       "      <th>035liste_y</th>\n",
       "      <th>isbn_y</th>\n",
       "      <th>ttlpart_y</th>\n",
       "      <th>pubyear_y</th>\n",
       "      <th>decade_y</th>\n",
       "      <th>century_y</th>\n",
       "      <th>exactDate_y</th>\n",
       "      <th>edition_y</th>\n",
       "      <th>part_y</th>\n",
       "      <th>pages_y</th>\n",
       "      <th>volumes_y</th>\n",
       "      <th>pubinit_y</th>\n",
       "      <th>pubword_y</th>\n",
       "      <th>scale_y</th>\n",
       "      <th>coordinate_y</th>\n",
       "      <th>doi_y</th>\n",
       "      <th>ismn_y</th>\n",
       "      <th>musicid_y</th>\n",
       "      <th>coordinate_E_y</th>\n",
       "      <th>coordinate_N_y</th>\n",
       "      <th>corporate_110_y</th>\n",
       "      <th>corporate_710_y</th>\n",
       "      <th>corporate_full_y</th>\n",
       "      <th>format_prefix_y</th>\n",
       "      <th>format_postfix_y</th>\n",
       "      <th>person_100_y</th>\n",
       "      <th>person_700_y</th>\n",
       "      <th>person_245c_y</th>\n",
       "      <th>ttlfull_245_y</th>\n",
       "      <th>ttlfull_246_y</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>000311049</td>\n",
       "      <td>[(OCoLC)731635279, (ABN)000539983]</td>\n",
       "      <td>[978-3-15-020008-7]</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009uuuu</td>\n",
       "      <td></td>\n",
       "      <td>20008</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>600</td>\n",
       "      <td>reclam jun.</td>\n",
       "      <td>[Reclam jun.]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>bk</td>\n",
       "      <td>020000</td>\n",
       "      <td>austenjane</td>\n",
       "      <td>grawechristian, graweursula</td>\n",
       "      <td>jane austen ; aus dem englischen übersetzt von...</td>\n",
       "      <td>emma, roman</td>\n",
       "      <td></td>\n",
       "      <td>504389793</td>\n",
       "      <td>504389793</td>\n",
       "      <td>[(NEBIS)009587153, (LIBIB)000315536, (ABN)0005...</td>\n",
       "      <td>[978-3-15-020008-7]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009uuuu</td>\n",
       "      <td></td>\n",
       "      <td>20008</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>600</td>\n",
       "      <td>reclam</td>\n",
       "      <td>[Reclam]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>bk</td>\n",
       "      <td>020000</td>\n",
       "      <td>austenjane</td>\n",
       "      <td></td>\n",
       "      <td>jane austen ; aus dem engl. übers. von ursula ...</td>\n",
       "      <td>emma</td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>196506476</td>\n",
       "      <td>[(OCoLC)731635279, (NEBIS)009587153]</td>\n",
       "      <td>[978-3-15-020008-7]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009uuuu</td>\n",
       "      <td></td>\n",
       "      <td>20008</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>600</td>\n",
       "      <td>reclam</td>\n",
       "      <td>[Reclam]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>bk</td>\n",
       "      <td>020000</td>\n",
       "      <td>austenjane</td>\n",
       "      <td></td>\n",
       "      <td>jane austen ; aus dem engl. übers. von ursula ...</td>\n",
       "      <td>emma</td>\n",
       "      <td></td>\n",
       "      <td>504389793</td>\n",
       "      <td>504389793</td>\n",
       "      <td>[(NEBIS)009587153, (LIBIB)000315536, (ABN)0005...</td>\n",
       "      <td>[978-3-15-020008-7]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009uuuu</td>\n",
       "      <td></td>\n",
       "      <td>20008</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>600</td>\n",
       "      <td>reclam</td>\n",
       "      <td>[Reclam]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>bk</td>\n",
       "      <td>020000</td>\n",
       "      <td>austenjane</td>\n",
       "      <td></td>\n",
       "      <td>jane austen ; aus dem engl. übers. von ursula ...</td>\n",
       "      <td>emma</td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>323173349</td>\n",
       "      <td>[(OCoLC)731635279, (LIBIB)000315536]</td>\n",
       "      <td>[978-3-15-020008-7]</td>\n",
       "      <td>{'245': ['Emma', 'Roman']}</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009uuuu</td>\n",
       "      <td></td>\n",
       "      <td>20008</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>600</td>\n",
       "      <td>reclam</td>\n",
       "      <td>[Reclam]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>bk</td>\n",
       "      <td>020000</td>\n",
       "      <td>austenjane</td>\n",
       "      <td></td>\n",
       "      <td>jane austen</td>\n",
       "      <td>emma, roman</td>\n",
       "      <td></td>\n",
       "      <td>504389793</td>\n",
       "      <td>504389793</td>\n",
       "      <td>[(NEBIS)009587153, (LIBIB)000315536, (ABN)0005...</td>\n",
       "      <td>[978-3-15-020008-7]</td>\n",
       "      <td>{'245': ['Emma']}</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009</td>\n",
       "      <td>2009uuuu</td>\n",
       "      <td></td>\n",
       "      <td>20008</td>\n",
       "      <td>[600 S.]</td>\n",
       "      <td>600</td>\n",
       "      <td>reclam</td>\n",
       "      <td>[Reclam]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>bk</td>\n",
       "      <td>020000</td>\n",
       "      <td>austenjane</td>\n",
       "      <td></td>\n",
       "      <td>jane austen ; aus dem engl. übers. von ursula ...</td>\n",
       "      <td>emma</td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>00130724X</td>\n",
       "      <td>[(OCoLC)808324878, (ABN)000155059]</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Die Zauberflöte', 'Oper in zwei Aufz...</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000uuuu</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>[1 DVD-Video, DVD Region 0, 169 Min., farb.]</td>\n",
       "      <td>1 0 169</td>\n",
       "      <td>deutsche grammophon</td>\n",
       "      <td>[Deutsche Grammophon]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>metropolitan opera orchestra, metropolitan ope...</td>\n",
       "      <td>metropolitan opera orchestra, metropolitan ope...</td>\n",
       "      <td>vm</td>\n",
       "      <td>010300</td>\n",
       "      <td>levinejamesdir.</td>\n",
       "      <td>mozartwolfgang amadeus, levinejames, schikaned...</td>\n",
       "      <td>w. a. mozart ; libretto: emanuel schikaneder ;...</td>\n",
       "      <td>die zauberflöte, oper in zwei aufzügen</td>\n",
       "      <td></td>\n",
       "      <td>504390597</td>\n",
       "      <td>504390597</td>\n",
       "      <td>[(IDSBB)003690925, (NEBIS)005645758, (RERO)R00...</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Die Zauberflöte', 'Oper in zwei Aufz...</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000uuuu</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>[1 DVD-Video (169 Min.)]</td>\n",
       "      <td>1 169</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>073</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>metropolitan operaorchestra, metropolitan oper...</td>\n",
       "      <td>metropolitan operaorchestra, metropolitan oper...</td>\n",
       "      <td>vm</td>\n",
       "      <td>010300</td>\n",
       "      <td>mozartwolfgang amadeus</td>\n",
       "      <td>schikanederemanuel, hockneydavid, levinejames</td>\n",
       "      <td>w. a. mozart ; libretto: emanuel schikaneder</td>\n",
       "      <td>die zauberflöte, oper in zwei aufzügen : kv 620</td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>116188030</td>\n",
       "      <td>[(OCoLC)884447694, (IDSBB)003690925]</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Die Zauberflöte', 'Oper in zwei Aufz...</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000uuuu</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>[1 DVD-Video (169 Min.)]</td>\n",
       "      <td>1 169</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>073</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>metropolitan operaorchestra, metropolitan oper...</td>\n",
       "      <td>metropolitan operaorchestra, metropolitan oper...</td>\n",
       "      <td>vm</td>\n",
       "      <td>010300</td>\n",
       "      <td>mozartwolfgang amadeus</td>\n",
       "      <td>schikanederemanuel, hockneydavid, levinejames</td>\n",
       "      <td>w. a. mozart ; libretto: emanuel schikaneder</td>\n",
       "      <td>die zauberflöte, oper in zwei aufzügen : kv 620</td>\n",
       "      <td></td>\n",
       "      <td>504390597</td>\n",
       "      <td>504390597</td>\n",
       "      <td>[(IDSBB)003690925, (NEBIS)005645758, (RERO)R00...</td>\n",
       "      <td>[]</td>\n",
       "      <td>{'245': ['Die Zauberflöte', 'Oper in zwei Aufz...</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000uuuu</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>[1 DVD-Video (169 Min.)]</td>\n",
       "      <td>1 169</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>073</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>metropolitan operaorchestra, metropolitan oper...</td>\n",
       "      <td>metropolitan operaorchestra, metropolitan oper...</td>\n",
       "      <td>vm</td>\n",
       "      <td>010300</td>\n",
       "      <td>mozartwolfgang amadeus</td>\n",
       "      <td>schikanederemanuel, hockneydavid, levinejames</td>\n",
       "      <td>w. a. mozart ; libretto: emanuel schikaneder</td>\n",
       "      <td>die zauberflöte, oper in zwei aufzügen : kv 620</td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "     docid_x                            035liste_x               isbn_x  \\\n",
       "0  000311049    [(OCoLC)731635279, (ABN)000539983]  [978-3-15-020008-7]   \n",
       "1  196506476  [(OCoLC)731635279, (NEBIS)009587153]  [978-3-15-020008-7]   \n",
       "2  323173349  [(OCoLC)731635279, (LIBIB)000315536]  [978-3-15-020008-7]   \n",
       "3  00130724X    [(OCoLC)808324878, (ABN)000155059]                   []   \n",
       "4  116188030  [(OCoLC)884447694, (IDSBB)003690925]                   []   \n",
       "\n",
       "                                           ttlpart_x pubyear_x decade_x  \\\n",
       "0                         {'245': ['Emma', 'Roman']}  2009         2009   \n",
       "1                                  {'245': ['Emma']}  2009         2009   \n",
       "2                         {'245': ['Emma', 'Roman']}  2009         2009   \n",
       "3  {'245': ['Die Zauberflöte', 'Oper in zwei Aufz...  2000         2000   \n",
       "4  {'245': ['Die Zauberflöte', 'Oper in zwei Aufz...  2000         2000   \n",
       "\n",
       "  century_x exactDate_x edition_x part_x  \\\n",
       "0      2009    2009uuuu            20008   \n",
       "1      2009    2009uuuu            20008   \n",
       "2      2009    2009uuuu            20008   \n",
       "3      2000    2000uuuu                    \n",
       "4      2000    2000uuuu                    \n",
       "\n",
       "                                        pages_x volumes_x  \\\n",
       "0                                      [600 S.]       600   \n",
       "1                                      [600 S.]       600   \n",
       "2                                      [600 S.]       600   \n",
       "3  [1 DVD-Video, DVD Region 0, 169 Min., farb.]   1 0 169   \n",
       "4                      [1 DVD-Video (169 Min.)]     1 169   \n",
       "\n",
       "             pubinit_x              pubword_x scale_x coordinate_x doi_x  \\\n",
       "0          reclam jun.          [Reclam jun.]                   []         \n",
       "1               reclam               [Reclam]                   []         \n",
       "2               reclam               [Reclam]                   []         \n",
       "3  deutsche grammophon  [Deutsche Grammophon]                   []         \n",
       "4                                          []                   []         \n",
       "\n",
       "  ismn_x musicid_x coordinate_E_x coordinate_N_x corporate_110_x  \\\n",
       "0                                                                  \n",
       "1                                                                  \n",
       "2                                                                  \n",
       "3                                                                  \n",
       "4              073                                                 \n",
       "\n",
       "                                     corporate_710_x  \\\n",
       "0                                                      \n",
       "1                                                      \n",
       "2                                                      \n",
       "3  metropolitan opera orchestra, metropolitan ope...   \n",
       "4  metropolitan operaorchestra, metropolitan oper...   \n",
       "\n",
       "                                    corporate_full_x format_prefix_x  \\\n",
       "0                                                                 bk   \n",
       "1                                                                 bk   \n",
       "2                                                                 bk   \n",
       "3  metropolitan opera orchestra, metropolitan ope...              vm   \n",
       "4  metropolitan operaorchestra, metropolitan oper...              vm   \n",
       "\n",
       "  format_postfix_x            person_100_x  \\\n",
       "0           020000              austenjane   \n",
       "1           020000              austenjane   \n",
       "2           020000              austenjane   \n",
       "3           010300         levinejamesdir.   \n",
       "4           010300  mozartwolfgang amadeus   \n",
       "\n",
       "                                        person_700_x  \\\n",
       "0                        grawechristian, graweursula   \n",
       "1                                                      \n",
       "2                                                      \n",
       "3  mozartwolfgang amadeus, levinejames, schikaned...   \n",
       "4      schikanederemanuel, hockneydavid, levinejames   \n",
       "\n",
       "                                       person_245c_x  \\\n",
       "0  jane austen ; aus dem englischen übersetzt von...   \n",
       "1  jane austen ; aus dem engl. übers. von ursula ...   \n",
       "2                                        jane austen   \n",
       "3  w. a. mozart ; libretto: emanuel schikaneder ;...   \n",
       "4       w. a. mozart ; libretto: emanuel schikaneder   \n",
       "\n",
       "                                     ttlfull_245_x ttlfull_246_x  \\\n",
       "0                                      emma, roman                 \n",
       "1                                             emma                 \n",
       "2                                      emma, roman                 \n",
       "3           die zauberflöte, oper in zwei aufzügen                 \n",
       "4  die zauberflöte, oper in zwei aufzügen : kv 620                 \n",
       "\n",
       "  masters_docid    docid_y                                         035liste_y  \\\n",
       "0     504389793  504389793  [(NEBIS)009587153, (LIBIB)000315536, (ABN)0005...   \n",
       "1     504389793  504389793  [(NEBIS)009587153, (LIBIB)000315536, (ABN)0005...   \n",
       "2     504389793  504389793  [(NEBIS)009587153, (LIBIB)000315536, (ABN)0005...   \n",
       "3     504390597  504390597  [(IDSBB)003690925, (NEBIS)005645758, (RERO)R00...   \n",
       "4     504390597  504390597  [(IDSBB)003690925, (NEBIS)005645758, (RERO)R00...   \n",
       "\n",
       "                isbn_y                                          ttlpart_y  \\\n",
       "0  [978-3-15-020008-7]                                  {'245': ['Emma']}   \n",
       "1  [978-3-15-020008-7]                                  {'245': ['Emma']}   \n",
       "2  [978-3-15-020008-7]                                  {'245': ['Emma']}   \n",
       "3                   []  {'245': ['Die Zauberflöte', 'Oper in zwei Aufz...   \n",
       "4                   []  {'245': ['Die Zauberflöte', 'Oper in zwei Aufz...   \n",
       "\n",
       "  pubyear_y decade_y century_y exactDate_y edition_y part_y  \\\n",
       "0  2009         2009      2009    2009uuuu            20008   \n",
       "1  2009         2009      2009    2009uuuu            20008   \n",
       "2  2009         2009      2009    2009uuuu            20008   \n",
       "3  2000         2000      2000    2000uuuu                    \n",
       "4  2000         2000      2000    2000uuuu                    \n",
       "\n",
       "                    pages_y volumes_y pubinit_y pubword_y scale_y  \\\n",
       "0                  [600 S.]       600    reclam  [Reclam]           \n",
       "1                  [600 S.]       600    reclam  [Reclam]           \n",
       "2                  [600 S.]       600    reclam  [Reclam]           \n",
       "3  [1 DVD-Video (169 Min.)]     1 169                  []           \n",
       "4  [1 DVD-Video (169 Min.)]     1 169                  []           \n",
       "\n",
       "  coordinate_y doi_y ismn_y musicid_y coordinate_E_y coordinate_N_y  \\\n",
       "0           []                                                        \n",
       "1           []                                                        \n",
       "2           []                                                        \n",
       "3           []                    073                                 \n",
       "4           []                    073                                 \n",
       "\n",
       "  corporate_110_y                                    corporate_710_y  \\\n",
       "0                                                                      \n",
       "1                                                                      \n",
       "2                                                                      \n",
       "3                  metropolitan operaorchestra, metropolitan oper...   \n",
       "4                  metropolitan operaorchestra, metropolitan oper...   \n",
       "\n",
       "                                    corporate_full_y format_prefix_y  \\\n",
       "0                                                                 bk   \n",
       "1                                                                 bk   \n",
       "2                                                                 bk   \n",
       "3  metropolitan operaorchestra, metropolitan oper...              vm   \n",
       "4  metropolitan operaorchestra, metropolitan oper...              vm   \n",
       "\n",
       "  format_postfix_y            person_100_y  \\\n",
       "0           020000              austenjane   \n",
       "1           020000              austenjane   \n",
       "2           020000              austenjane   \n",
       "3           010300  mozartwolfgang amadeus   \n",
       "4           010300  mozartwolfgang amadeus   \n",
       "\n",
       "                                    person_700_y  \\\n",
       "0                                                  \n",
       "1                                                  \n",
       "2                                                  \n",
       "3  schikanederemanuel, hockneydavid, levinejames   \n",
       "4  schikanederemanuel, hockneydavid, levinejames   \n",
       "\n",
       "                                       person_245c_y  \\\n",
       "0  jane austen ; aus dem engl. übers. von ursula ...   \n",
       "1  jane austen ; aus dem engl. übers. von ursula ...   \n",
       "2  jane austen ; aus dem engl. übers. von ursula ...   \n",
       "3       w. a. mozart ; libretto: emanuel schikaneder   \n",
       "4       w. a. mozart ; libretto: emanuel schikaneder   \n",
       "\n",
       "                                     ttlfull_245_y ttlfull_246_y  \n",
       "0                                             emma                \n",
       "1                                             emma                \n",
       "2                                             emma                \n",
       "3  die zauberflöte, oper in zwei aufzügen : kv 620                \n",
       "4  die zauberflöte, oper in zwei aufzügen : kv 620                "
      ]
     },
     "execution_count": 27,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "slave_master = pd.merge(left=goldstandard['slaves'], right=goldstandard['masters'], how='inner',\n",
    "                  left_on='masters_docid', right_on='docid')\n",
    "\n",
    "print('Number of paired slave/master records', len(slave_master))\n",
    "\n",
    "# Extend display to number of columns of DataFrame\n",
    "pd.options.display.max_columns = len(slave_master)\n",
    "\n",
    "slave_master.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Looking at the examples above, reveals that the slave/master record pairs are duplicates, indeed."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "pair-------------------------------------> [0, 85]\n",
      "docid_x                                                     000311049\n",
      "035liste_x                         [(OCoLC)731635279, (ABN)000539983]\n",
      "isbn_x                                            [978-3-15-020008-7]\n",
      "ttlpart_x                                  {'245': ['Emma', 'Roman']}\n",
      "pubyear_x                                                    2009    \n",
      "decade_x                                                         2009\n",
      "century_x                                                        2009\n",
      "exactDate_x                                                  2009uuuu\n",
      "edition_x                                                            \n",
      "part_x                                                          20008\n",
      "pages_x                                                      [600 S.]\n",
      "volumes_x                                                         600\n",
      "pubinit_x                                                 reclam jun.\n",
      "pubword_x                                               [Reclam jun.]\n",
      "scale_x                                                              \n",
      "coordinate_x                                                       []\n",
      "doi_x                                                                \n",
      "ismn_x                                                               \n",
      "musicid_x                                                            \n",
      "coordinate_E_x                                                       \n",
      "coordinate_N_x                                                       \n",
      "corporate_110_x                                                      \n",
      "corporate_710_x                                                      \n",
      "corporate_full_x                                                     \n",
      "format_prefix_x                                                    bk\n",
      "format_postfix_x                                               020000\n",
      "person_100_x                                               austenjane\n",
      "person_700_x                              grawechristian, graweursula\n",
      "person_245c_x       jane austen ; aus dem englischen übersetzt von...\n",
      "ttlfull_245_x                                             emma, roman\n",
      "ttlfull_246_x                                                        \n",
      "masters_docid                                               504389793\n",
      "docid_y                                                     504389793\n",
      "035liste_y          [(NEBIS)009587153, (LIBIB)000315536, (ABN)0005...\n",
      "isbn_y                                            [978-3-15-020008-7]\n",
      "ttlpart_y                                           {'245': ['Emma']}\n",
      "pubyear_y                                                    2009    \n",
      "decade_y                                                         2009\n",
      "century_y                                                        2009\n",
      "exactDate_y                                                  2009uuuu\n",
      "edition_y                                                            \n",
      "part_y                                                          20008\n",
      "pages_y                                                      [600 S.]\n",
      "volumes_y                                                         600\n",
      "pubinit_y                                                      reclam\n",
      "pubword_y                                                    [Reclam]\n",
      "scale_y                                                              \n",
      "coordinate_y                                                       []\n",
      "doi_y                                                                \n",
      "ismn_y                                                               \n",
      "musicid_y                                                            \n",
      "coordinate_E_y                                                       \n",
      "coordinate_N_y                                                       \n",
      "corporate_110_y                                                      \n",
      "corporate_710_y                                                      \n",
      "corporate_full_y                                                     \n",
      "format_prefix_y                                                    bk\n",
      "format_postfix_y                                               020000\n",
      "person_100_y                                               austenjane\n",
      "person_700_y                                                         \n",
      "person_245c_y       jane austen ; aus dem engl. übers. von ursula ...\n",
      "ttlfull_245_y                                                    emma\n",
      "ttlfull_246_y                                                        \n",
      "Name: 0, dtype: object \n",
      "\n",
      "... and its master record ...\n",
      "docid                                                     504389793\n",
      "035liste          [(NEBIS)009587153, (LIBIB)000315536, (ABN)0005...\n",
      "isbn                                            [978-3-15-020008-7]\n",
      "ttlpart                                           {'245': ['Emma']}\n",
      "pubyear                                                    2009    \n",
      "decade                                                         2009\n",
      "century                                                        2009\n",
      "exactDate                                                  2009uuuu\n",
      "edition                                                            \n",
      "part                                                          20008\n",
      "pages                                                      [600 S.]\n",
      "volumes                                                         600\n",
      "pubinit                                                      reclam\n",
      "pubword                                                    [Reclam]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                               austenjane\n",
      "person_700                                                         \n",
      "person_245c       jane austen ; aus dem engl. übers. von ursula ...\n",
      "ttlfull_245                                                    emma\n",
      "ttlfull_246                                                        \n",
      "Name: 85, dtype: object\n",
      "\n",
      "pair-------------------------------------> [1, 145]\n",
      "docid_x                                                     196506476\n",
      "035liste_x                       [(OCoLC)731635279, (NEBIS)009587153]\n",
      "isbn_x                                            [978-3-15-020008-7]\n",
      "ttlpart_x                                           {'245': ['Emma']}\n",
      "pubyear_x                                                    2009    \n",
      "decade_x                                                         2009\n",
      "century_x                                                        2009\n",
      "exactDate_x                                                  2009uuuu\n",
      "edition_x                                                            \n",
      "part_x                                                          20008\n",
      "pages_x                                                      [600 S.]\n",
      "volumes_x                                                         600\n",
      "pubinit_x                                                      reclam\n",
      "pubword_x                                                    [Reclam]\n",
      "scale_x                                                              \n",
      "coordinate_x                                                       []\n",
      "doi_x                                                                \n",
      "ismn_x                                                               \n",
      "musicid_x                                                            \n",
      "coordinate_E_x                                                       \n",
      "coordinate_N_x                                                       \n",
      "corporate_110_x                                                      \n",
      "corporate_710_x                                                      \n",
      "corporate_full_x                                                     \n",
      "format_prefix_x                                                    bk\n",
      "format_postfix_x                                               020000\n",
      "person_100_x                                               austenjane\n",
      "person_700_x                                                         \n",
      "person_245c_x       jane austen ; aus dem engl. übers. von ursula ...\n",
      "ttlfull_245_x                                                    emma\n",
      "ttlfull_246_x                                                        \n",
      "masters_docid                                               504389793\n",
      "docid_y                                                     504389793\n",
      "035liste_y          [(NEBIS)009587153, (LIBIB)000315536, (ABN)0005...\n",
      "isbn_y                                            [978-3-15-020008-7]\n",
      "ttlpart_y                                           {'245': ['Emma']}\n",
      "pubyear_y                                                    2009    \n",
      "decade_y                                                         2009\n",
      "century_y                                                        2009\n",
      "exactDate_y                                                  2009uuuu\n",
      "edition_y                                                            \n",
      "part_y                                                          20008\n",
      "pages_y                                                      [600 S.]\n",
      "volumes_y                                                         600\n",
      "pubinit_y                                                      reclam\n",
      "pubword_y                                                    [Reclam]\n",
      "scale_y                                                              \n",
      "coordinate_y                                                       []\n",
      "doi_y                                                                \n",
      "ismn_y                                                               \n",
      "musicid_y                                                            \n",
      "coordinate_E_y                                                       \n",
      "coordinate_N_y                                                       \n",
      "corporate_110_y                                                      \n",
      "corporate_710_y                                                      \n",
      "corporate_full_y                                                     \n",
      "format_prefix_y                                                    bk\n",
      "format_postfix_y                                               020000\n",
      "person_100_y                                               austenjane\n",
      "person_700_y                                                         \n",
      "person_245c_y       jane austen ; aus dem engl. übers. von ursula ...\n",
      "ttlfull_245_y                                                    emma\n",
      "ttlfull_246_y                                                        \n",
      "Name: 1, dtype: object \n",
      "\n",
      "... and its master record ...\n",
      "docid                                                     504390597\n",
      "035liste          [(IDSBB)003690925, (NEBIS)005645758, (RERO)R00...\n",
      "isbn                                                             []\n",
      "ttlpart           {'245': ['Die Zauberflöte', 'Oper in zwei Aufz...\n",
      "pubyear                                                    2000    \n",
      "decade                                                         2000\n",
      "century                                                        2000\n",
      "exactDate                                                  2000uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                      [1 DVD-Video (169 Min.)]\n",
      "volumes                                                       1 169\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                         073\n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710     metropolitan operaorchestra, metropolitan oper...\n",
      "corporate_full    metropolitan operaorchestra, metropolitan oper...\n",
      "format_prefix                                                    vm\n",
      "format_postfix                                               010300\n",
      "person_100                                   mozartwolfgang amadeus\n",
      "person_700            schikanederemanuel, hockneydavid, levinejames\n",
      "person_245c            w. a. mozart ; libretto: emanuel schikaneder\n",
      "ttlfull_245         die zauberflöte, oper in zwei aufzügen : kv 620\n",
      "ttlfull_246                                                        \n",
      "Name: 145, dtype: object\n",
      "\n",
      "pair-------------------------------------> [2, 119]\n",
      "docid_x                                                     323173349\n",
      "035liste_x                       [(OCoLC)731635279, (LIBIB)000315536]\n",
      "isbn_x                                            [978-3-15-020008-7]\n",
      "ttlpart_x                                  {'245': ['Emma', 'Roman']}\n",
      "pubyear_x                                                    2009    \n",
      "decade_x                                                         2009\n",
      "century_x                                                        2009\n",
      "exactDate_x                                                  2009uuuu\n",
      "edition_x                                                            \n",
      "part_x                                                          20008\n",
      "pages_x                                                      [600 S.]\n",
      "volumes_x                                                         600\n",
      "pubinit_x                                                      reclam\n",
      "pubword_x                                                    [Reclam]\n",
      "scale_x                                                              \n",
      "coordinate_x                                                       []\n",
      "doi_x                                                                \n",
      "ismn_x                                                               \n",
      "musicid_x                                                            \n",
      "coordinate_E_x                                                       \n",
      "coordinate_N_x                                                       \n",
      "corporate_110_x                                                      \n",
      "corporate_710_x                                                      \n",
      "corporate_full_x                                                     \n",
      "format_prefix_x                                                    bk\n",
      "format_postfix_x                                               020000\n",
      "person_100_x                                               austenjane\n",
      "person_700_x                                                         \n",
      "person_245c_x                                             jane austen\n",
      "ttlfull_245_x                                             emma, roman\n",
      "ttlfull_246_x                                                        \n",
      "masters_docid                                               504389793\n",
      "docid_y                                                     504389793\n",
      "035liste_y          [(NEBIS)009587153, (LIBIB)000315536, (ABN)0005...\n",
      "isbn_y                                            [978-3-15-020008-7]\n",
      "ttlpart_y                                           {'245': ['Emma']}\n",
      "pubyear_y                                                    2009    \n",
      "decade_y                                                         2009\n",
      "century_y                                                        2009\n",
      "exactDate_y                                                  2009uuuu\n",
      "edition_y                                                            \n",
      "part_y                                                          20008\n",
      "pages_y                                                      [600 S.]\n",
      "volumes_y                                                         600\n",
      "pubinit_y                                                      reclam\n",
      "pubword_y                                                    [Reclam]\n",
      "scale_y                                                              \n",
      "coordinate_y                                                       []\n",
      "doi_y                                                                \n",
      "ismn_y                                                               \n",
      "musicid_y                                                            \n",
      "coordinate_E_y                                                       \n",
      "coordinate_N_y                                                       \n",
      "corporate_110_y                                                      \n",
      "corporate_710_y                                                      \n",
      "corporate_full_y                                                     \n",
      "format_prefix_y                                                    bk\n",
      "format_postfix_y                                               020000\n",
      "person_100_y                                               austenjane\n",
      "person_700_y                                                         \n",
      "person_245c_y       jane austen ; aus dem engl. übers. von ursula ...\n",
      "ttlfull_245_y                                                    emma\n",
      "ttlfull_246_y                                                        \n",
      "Name: 2, dtype: object \n",
      "\n",
      "... and its master record ...\n",
      "docid                                                     50439018X\n",
      "035liste          [(IDSBB)001651899, (NEBIS)001974886, (IDSSG)00...\n",
      "isbn                                                [3-495-47879-5]\n",
      "ttlpart           {'245': ['Der moralische Status der Tiere', 'H...\n",
      "pubyear                                                    1999    \n",
      "decade                                                         1999\n",
      "century                                                        1999\n",
      "exactDate                                                  1999uuuu\n",
      "edition                                                            \n",
      "part                                                          57 57\n",
      "pages                                                      [316 S.]\n",
      "volumes                                                         316\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                             fluryandreas\n",
      "person_700                                                         \n",
      "person_245c                                           andreas flury\n",
      "ttlfull_245       der moralische status der tiere, henry salt, p...\n",
      "ttlfull_246                                                        \n",
      "Name: 119, dtype: object\n",
      "\n",
      "pair-------------------------------------> [3, 57]\n",
      "docid_x                                                     00130724X\n",
      "035liste_x                         [(OCoLC)808324878, (ABN)000155059]\n",
      "isbn_x                                                             []\n",
      "ttlpart_x           {'245': ['Die Zauberflöte', 'Oper in zwei Aufz...\n",
      "pubyear_x                                                    2000    \n",
      "decade_x                                                         2000\n",
      "century_x                                                        2000\n",
      "exactDate_x                                                  2000uuuu\n",
      "edition_x                                                            \n",
      "part_x                                                               \n",
      "pages_x                  [1 DVD-Video, DVD Region 0, 169 Min., farb.]\n",
      "volumes_x                                                     1 0 169\n",
      "pubinit_x                                         deutsche grammophon\n",
      "pubword_x                                       [Deutsche Grammophon]\n",
      "scale_x                                                              \n",
      "coordinate_x                                                       []\n",
      "doi_x                                                                \n",
      "ismn_x                                                               \n",
      "musicid_x                                                            \n",
      "coordinate_E_x                                                       \n",
      "coordinate_N_x                                                       \n",
      "corporate_110_x                                                      \n",
      "corporate_710_x     metropolitan opera orchestra, metropolitan ope...\n",
      "corporate_full_x    metropolitan opera orchestra, metropolitan ope...\n",
      "format_prefix_x                                                    vm\n",
      "format_postfix_x                                               010300\n",
      "person_100_x                                          levinejamesdir.\n",
      "person_700_x        mozartwolfgang amadeus, levinejames, schikaned...\n",
      "person_245c_x       w. a. mozart ; libretto: emanuel schikaneder ;...\n",
      "ttlfull_245_x                  die zauberflöte, oper in zwei aufzügen\n",
      "ttlfull_246_x                                                        \n",
      "masters_docid                                               504390597\n",
      "docid_y                                                     504390597\n",
      "035liste_y          [(IDSBB)003690925, (NEBIS)005645758, (RERO)R00...\n",
      "isbn_y                                                             []\n",
      "ttlpart_y           {'245': ['Die Zauberflöte', 'Oper in zwei Aufz...\n",
      "pubyear_y                                                    2000    \n",
      "decade_y                                                         2000\n",
      "century_y                                                        2000\n",
      "exactDate_y                                                  2000uuuu\n",
      "edition_y                                                            \n",
      "part_y                                                               \n",
      "pages_y                                      [1 DVD-Video (169 Min.)]\n",
      "volumes_y                                                       1 169\n",
      "pubinit_y                                                            \n",
      "pubword_y                                                          []\n",
      "scale_y                                                              \n",
      "coordinate_y                                                       []\n",
      "doi_y                                                                \n",
      "ismn_y                                                               \n",
      "musicid_y                                                         073\n",
      "coordinate_E_y                                                       \n",
      "coordinate_N_y                                                       \n",
      "corporate_110_y                                                      \n",
      "corporate_710_y     metropolitan operaorchestra, metropolitan oper...\n",
      "corporate_full_y    metropolitan operaorchestra, metropolitan oper...\n",
      "format_prefix_y                                                    vm\n",
      "format_postfix_y                                               010300\n",
      "person_100_y                                   mozartwolfgang amadeus\n",
      "person_700_y            schikanederemanuel, hockneydavid, levinejames\n",
      "person_245c_y            w. a. mozart ; libretto: emanuel schikaneder\n",
      "ttlfull_245_y         die zauberflöte, oper in zwei aufzügen : kv 620\n",
      "ttlfull_246_y                                                        \n",
      "Name: 3, dtype: object \n",
      "\n",
      "... and its master record ...\n",
      "docid                                                     504389513\n",
      "035liste                         [(IDSBB)004654810, (ABN)000223912]\n",
      "isbn                                                             []\n",
      "ttlpart                                {'245': ['Die Zauberflöte']}\n",
      "pubyear                                                    1920    \n",
      "decade                                                         1920\n",
      "century                                                        1920\n",
      "exactDate                                                  1920uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                       [1 Bd.]\n",
      "volumes                                                           1\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                   mozartwolfgang amadeus\n",
      "person_700                                       schikanederemanuel\n",
      "person_245c       w. a. mozart ; oper in 2 akten v. emanuel schi...\n",
      "ttlfull_245                                         die zauberflöte\n",
      "ttlfull_246                                                        \n",
      "Name: 57, dtype: object\n"
     ]
    }
   ],
   "source": [
    "pd.options.display.max_rows = len(slave_master.columns)\n",
    "\n",
    "for i in [sample_pair_1, sample_pair_2, sample_pair_3, sample_pair_4]:\n",
    "    print('\\npair------------------------------------->', i)\n",
    "    print(slave_master.loc[i[0]], '\\n')\n",
    "    print('... and its master record ...')\n",
    "    print(goldstandard['masters'].loc[i[1]])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Duplicates Rows Generation"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The rows with pairs of duplicates can now be built joining each slave record with each slave record, with the condition of the same $\\texttt{masters}\\_\\texttt{docid}$."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [],
   "source": [
    "def build_duplicate_pairs (df):\n",
    "    \"\"\"Builds-up all duplicate pairs, even with itself.\"\"\"\n",
    "    \n",
    "    return pd.merge(left=df, right=df, how='inner',\n",
    "                    left_on='masters_docid', right_on='masters_docid')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The records of duplicates are marked as duplicates immediately after pairing."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Number of duplicate rows 1,473\n"
     ]
    }
   ],
   "source": [
    "duplicates = build_duplicate_pairs(goldstandard['slaves'])\n",
    "duplicates['duplicates'] = 1\n",
    "\n",
    "print('Number of duplicate rows {:,d}'.format(len(duplicates)))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "docid_x                                                     364137525\n",
       "035liste_x                        [(SNL)vtls001800340, (Sz)001800340]\n",
       "isbn_x                                            [978-3-495-48796-9]\n",
       "ttlpart_x           {'245': ['Der moralische Status der Tiere', 'H...\n",
       "pubyear_x                                                    2016    \n",
       "decade_x                                                         2016\n",
       "century_x                                                        2016\n",
       "exactDate_x                                                  2016uuuu\n",
       "edition_x                                                           2\n",
       "part_x                                                          57 57\n",
       "pages_x                                                      [316 S.]\n",
       "volumes_x                                                         316\n",
       "pubinit_x                                                    k. alber\n",
       "pubword_x                                                  [K. Alber]\n",
       "scale_x                                                              \n",
       "coordinate_x                                                       []\n",
       "doi_x                                                                \n",
       "ismn_x                                                               \n",
       "musicid_x                                                            \n",
       "coordinate_E_x                                                       \n",
       "coordinate_N_x                                                       \n",
       "corporate_110_x                                                      \n",
       "corporate_710_x                                                      \n",
       "corporate_full_x                                                     \n",
       "format_prefix_x                                                    bk\n",
       "format_postfix_x                                               020000\n",
       "person_100_x                                             fluryandreas\n",
       "person_700_x                                                         \n",
       "person_245c_x                                           andreas flury\n",
       "ttlfull_245_x       der moralische status der tiere, henry salt, p...\n",
       "ttlfull_246_x                                                        \n",
       "masters_docid                                               504390198\n",
       "docid_y                                                     361344783\n",
       "035liste_y                                         [(RERO)R008423710]\n",
       "isbn_y                             [3-495-48796-4, 978-3-495-48796-9]\n",
       "ttlpart_y           {'245': ['Der moralische Status der Tiere', 'H...\n",
       "pubyear_y                                                    2016    \n",
       "decade_y                                                         2016\n",
       "century_y                                                        2016\n",
       "exactDate_y                                                  2016uuuu\n",
       "edition_y                                                           2\n",
       "part_y                                                          57 57\n",
       "pages_y                                                      [316 S.]\n",
       "volumes_y                                                         316\n",
       "pubinit_y                                                    k. alber\n",
       "pubword_y                                                  [K. Alber]\n",
       "scale_y                                                              \n",
       "coordinate_y                                                       []\n",
       "doi_y                                                                \n",
       "ismn_y                                                               \n",
       "musicid_y                                                            \n",
       "coordinate_E_y                                                       \n",
       "coordinate_N_y                                                       \n",
       "corporate_110_y                                                      \n",
       "corporate_710_y                                                      \n",
       "corporate_full_y                                                     \n",
       "format_prefix_y                                                    bk\n",
       "format_postfix_y                                               020000\n",
       "person_100_y                                             fluryandreas\n",
       "person_700_y                                                         \n",
       "person_245c_y                                           andreas flury\n",
       "ttlfull_245_y       der moralische status der tiere, henry salt, p...\n",
       "ttlfull_246_y                                                        \n",
       "duplicates                                                          1\n",
       "Name: 1357, dtype: object"
      ]
     },
     "execution_count": 31,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import random as rand\n",
    "\n",
    "pd.options.display.max_rows = len(duplicates.columns)\n",
    "\n",
    "duplicates.loc[rand.randrange(len(duplicates))]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "On joining the raw data to pairs, the column names have been duplicated and changed. This must be reflected in the metadata."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Target is the first necessary column\n",
    "columns_metadata_dict['columns_to_use'] = ['duplicates']\n",
    "\n",
    "# After join with itself, the data has _x and _y attributes\n",
    "for i in columns_metadata_dict['data_analysis_columns']:\n",
    "    for j in ['_x', '_y']:\n",
    "        columns_metadata_dict['columns_to_use'].append(i+j)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Build Pairs of Uniques"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [],
   "source": [
    "for i in range(len(goldstandard['uniques'])):\n",
    "    if len(goldstandard['masters'][goldstandard['masters'].docid == goldstandard['uniques'].docid.loc[i]]) > 0 :\n",
    "        print('STOP!')\n",
    "        break"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The silence of the code cell above shows that there is no record in file $\\texttt{master.json}$ that has the same $\\texttt{docid}$ like any record in file $\\texttt{unique.json}$."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Masters Uniques Relationships"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The investigations above have shown that relationships between records are expressed with the same value in attribute $\\texttt{035liste}$. To find records of the uniques file that are duplicates of records of the masters file, the values of attributes $\\texttt{035liste}$ have to be compared."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "{'master': [92, 121, 121],\n",
       " 'unique': [473, 458, 474],\n",
       " 'slave': {121: [358, 346, 345, 351, 346, 351],\n",
       "  92: [267, 272, 286, 303, 267, 267, 272, 303]}}"
      ]
     },
     "execution_count": 34,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "masters_uniques_duplicates = {'master' : [], 'unique' : [], 'slave' : {}}\n",
    "\n",
    "for i in range(len(goldstandard['masters'])):\n",
    "    for j in range(len(goldstandard['masters']['035liste'][i])):\n",
    "        for k in range(len(goldstandard['uniques'])):\n",
    "            if goldstandard['masters']['035liste'][i][j] in goldstandard['uniques']['035liste'][k]:\n",
    "#                print('master', i, 'has relationship to unique', k)\n",
    "                masters_uniques_duplicates['master'].append(i)\n",
    "                masters_uniques_duplicates['unique'].append(k)\n",
    "print()\n",
    "for i in set(masters_uniques_duplicates['master']):\n",
    "    masters_uniques_duplicates['slave'].update({i : []})\n",
    "    for j in range(len(goldstandard['masters']['035liste'][i])):\n",
    "        for k in range(len(goldstandard['slaves'])):\n",
    "            if goldstandard['masters']['035liste'][i][j] in goldstandard['slaves']['035liste'][k]:\n",
    "#                print('master', i, 'has relationship to slave', k)\n",
    "                masters_uniques_duplicates['slave'][i].append(k)\n",
    "                \n",
    "masters_uniques_duplicates"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This result is surprising. The above code reveals that three unique records have relationships to a master record. Even worse but at least consistent, the affected master records also have relationships to some slave records. Is it true that they are duplicates?"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "pair-------------------------------------> 92 473\n",
      "docid                                                     504389866\n",
      "035liste          [(IDSBB)006207118, (NEBIS)010150430, (RERO)R00...\n",
      "isbn                             [978-3-642-41697-2, 3-642-41697-7]\n",
      "ttlpart           {'245': ['Empirische Bildungsforschung', 'aktu...\n",
      "pubyear                                                    2014    \n",
      "decade                                                         2014\n",
      "century                                                        2014\n",
      "exactDate                                                  2014uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                      [158 S.]\n",
      "volumes                                                         158\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                                            spinathbirgit\n",
      "person_245c                                  birgit spinath (hrsg.)\n",
      "ttlfull_245       empirische bildungsforschung, aktuelle themen ...\n",
      "ttlfull_246                                                        \n",
      "Name: 92, dtype: object \n",
      "\n",
      "... and its master record ...\n",
      "docid                                                     404685048\n",
      "035liste                       [(IDSLU)001264875, (OCoLC)871188367]\n",
      "isbn                             [978-3-642-41697-2, 3-642-41697-7]\n",
      "ttlpart           {'245': ['Empirische Bildungsforschung', 'aktu...\n",
      "pubyear                                                    2014    \n",
      "decade                                                         2014\n",
      "century                                                        2014\n",
      "exactDate                                                  2014uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                              [XI, 158 Seiten]\n",
      "volumes                                                         158\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                                                         \n",
      "person_245c                                  birgit spinath (hrsg.)\n",
      "ttlfull_245       empirische bildungsforschung, aktuelle themen ...\n",
      "ttlfull_246                                                        \n",
      "Name: 473, dtype: object \n",
      "\n",
      "... and its slave records ...\n",
      "docid                                                     312073232\n",
      "035liste          [(OCoLC)871188367, (IDSBB)006207118, (DE-599)D...\n",
      "isbn                             [978-3-642-41697-2, 3-642-41697-7]\n",
      "ttlpart           {'245': ['Empirische Bildungsforschung', 'aktu...\n",
      "pubyear                                                    2014    \n",
      "decade                                                         2014\n",
      "century                                                        2014\n",
      "exactDate                                                  2014uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                      [158 S.]\n",
      "volumes                                                         158\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                                            spinathbirgit\n",
      "person_245c                                  birgit spinath (hrsg.)\n",
      "ttlfull_245       empirische bildungsforschung, aktuelle themen ...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504389866\n",
      "Name: 267, dtype: object \n",
      "\n",
      "docid                                                     316725951\n",
      "035liste          [(OCoLC)871188367, (NEBIS)010150430, (OCoLC)87...\n",
      "isbn                             [978-3-642-41697-2, 3-642-41697-7]\n",
      "ttlpart           {'245': ['Empirische Bildungsforschung', 'aktu...\n",
      "pubyear                                                    2014    \n",
      "decade                                                         2014\n",
      "century                                                        2014\n",
      "exactDate                                                  2014uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                  [XI, 158 S.]\n",
      "volumes                                                         158\n",
      "pubinit                                                 springer vs\n",
      "pubword                                               [Springer VS]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                                            spinathbirgit\n",
      "person_245c                                  birgit spinath (hrsg.)\n",
      "ttlfull_245       empirische bildungsforschung, aktuelle themen ...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504389866\n",
      "Name: 272, dtype: object \n",
      "\n",
      "docid                                                     333126866\n",
      "035liste                                         [(RERO)R008122523]\n",
      "isbn                                            [978-3-642-41697-2]\n",
      "ttlpart           {'245': ['Empirische Bildungsforschung', 'aktu...\n",
      "pubyear                                                    2014    \n",
      "decade                                                         2014\n",
      "century                                                        2014\n",
      "exactDate                                                  2014uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                  [XI, 158 S.]\n",
      "volumes                                                         158\n",
      "pubinit                                                 springer vs\n",
      "pubword                                               [Springer VS]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                                            spinathbirgit\n",
      "person_245c                                  birgit spinath (hrsg.)\n",
      "ttlfull_245       empirische bildungsforschung, aktuelle themen ...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504389866\n",
      "Name: 286, dtype: object \n",
      "\n",
      "docid                                                     341222542\n",
      "035liste          [(OCoLC)871188367, (IDSSG)000839244, (OCoLC)87...\n",
      "isbn                             [978-3-642-41697-2, 3-642-41697-7]\n",
      "ttlpart           {'245': ['Empirische Bildungsforschung', 'aktu...\n",
      "pubyear                                                    2014    \n",
      "decade                                                         2014\n",
      "century                                                        2014\n",
      "exactDate                                                  2014uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                  [XI, 158 S.]\n",
      "volumes                                                         158\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                                            spinathbirgit\n",
      "person_245c                                  birgit spinath (hrsg.)\n",
      "ttlfull_245       empirische bildungsforschung, aktuelle themen ...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504389866\n",
      "Name: 303, dtype: object \n",
      "\n",
      "docid                                                     312073232\n",
      "035liste          [(OCoLC)871188367, (IDSBB)006207118, (DE-599)D...\n",
      "isbn                             [978-3-642-41697-2, 3-642-41697-7]\n",
      "ttlpart           {'245': ['Empirische Bildungsforschung', 'aktu...\n",
      "pubyear                                                    2014    \n",
      "decade                                                         2014\n",
      "century                                                        2014\n",
      "exactDate                                                  2014uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                      [158 S.]\n",
      "volumes                                                         158\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                                            spinathbirgit\n",
      "person_245c                                  birgit spinath (hrsg.)\n",
      "ttlfull_245       empirische bildungsforschung, aktuelle themen ...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504389866\n",
      "Name: 267, dtype: object \n",
      "\n",
      "docid                                                     312073232\n",
      "035liste          [(OCoLC)871188367, (IDSBB)006207118, (DE-599)D...\n",
      "isbn                             [978-3-642-41697-2, 3-642-41697-7]\n",
      "ttlpart           {'245': ['Empirische Bildungsforschung', 'aktu...\n",
      "pubyear                                                    2014    \n",
      "decade                                                         2014\n",
      "century                                                        2014\n",
      "exactDate                                                  2014uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                      [158 S.]\n",
      "volumes                                                         158\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                                            spinathbirgit\n",
      "person_245c                                  birgit spinath (hrsg.)\n",
      "ttlfull_245       empirische bildungsforschung, aktuelle themen ...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504389866\n",
      "Name: 267, dtype: object \n",
      "\n",
      "docid                                                     316725951\n",
      "035liste          [(OCoLC)871188367, (NEBIS)010150430, (OCoLC)87...\n",
      "isbn                             [978-3-642-41697-2, 3-642-41697-7]\n",
      "ttlpart           {'245': ['Empirische Bildungsforschung', 'aktu...\n",
      "pubyear                                                    2014    \n",
      "decade                                                         2014\n",
      "century                                                        2014\n",
      "exactDate                                                  2014uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                  [XI, 158 S.]\n",
      "volumes                                                         158\n",
      "pubinit                                                 springer vs\n",
      "pubword                                               [Springer VS]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                                            spinathbirgit\n",
      "person_245c                                  birgit spinath (hrsg.)\n",
      "ttlfull_245       empirische bildungsforschung, aktuelle themen ...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504389866\n",
      "Name: 272, dtype: object \n",
      "\n",
      "docid                                                     341222542\n",
      "035liste          [(OCoLC)871188367, (IDSSG)000839244, (OCoLC)87...\n",
      "isbn                             [978-3-642-41697-2, 3-642-41697-7]\n",
      "ttlpart           {'245': ['Empirische Bildungsforschung', 'aktu...\n",
      "pubyear                                                    2014    \n",
      "decade                                                         2014\n",
      "century                                                        2014\n",
      "exactDate                                                  2014uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                  [XI, 158 S.]\n",
      "volumes                                                         158\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                                            spinathbirgit\n",
      "person_245c                                  birgit spinath (hrsg.)\n",
      "ttlfull_245       empirische bildungsforschung, aktuelle themen ...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504389866\n",
      "Name: 303, dtype: object \n",
      "\n",
      "\n",
      "pair-------------------------------------> 121 458\n",
      "docid                                                     504390201\n",
      "035liste          [(RERO)R008499625, (NEBIS)010734165, (BGR)0006...\n",
      "isbn                             [3-290-20138-4, 978-3-290-20138-8]\n",
      "ttlpart           {'245': ['Mystiker Mittler Mensch', '600 Jahre...\n",
      "pubyear                                                    2016    \n",
      "decade                                                         2016\n",
      "century                                                        2016\n",
      "exactDate                                                  2016uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                  [388 Seiten]\n",
      "volumes                                                         388\n",
      "pubinit                                         edition nzn bei tvz\n",
      "pubword                                       [Edition NZN bei TVZ]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710     trägerverein 600 jahre niklaus von flüe 1417-2017\n",
      "corporate_full    trägerverein 600 jahre niklaus von flüe 1417-2017\n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                            gröbliroland, achermannwalter\n",
      "person_245c       herausgegeben für den trägerverein 600 jahre n...\n",
      "ttlfull_245       mystiker mittler mensch, 600 jahre niklaus von...\n",
      "ttlfull_246                                                        \n",
      "Name: 121, dtype: object \n",
      "\n",
      "... and its master record ...\n",
      "docid                                                     366417150\n",
      "035liste          [(OCoLC)951113986, (IDSBB)006619280, (OCoLC)95...\n",
      "isbn                             [978-3-290-20138-8, 3-290-20138-4]\n",
      "ttlpart           {'245': ['Mystiker - Mittler - Mensch', '600 J...\n",
      "pubyear                                                    2016    \n",
      "decade                                                         2016\n",
      "century                                                        2016\n",
      "exactDate                                                  2016uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                  [388 Seiten]\n",
      "volumes                                                         388\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710     bruder-klausen-stiftung, trägerverein 600 jahr...\n",
      "corporate_full    bruder-klausen-stiftung, trägerverein 600 jahr...\n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020400\n",
      "person_100                                                         \n",
      "person_700        gröbliroland, kronenbergheidi, riesmarkus, wal...\n",
      "person_245c       herausgegeben für den trägerverein 600 jahre n...\n",
      "ttlfull_245       mystiker - mittler - mensch, 600 jahre niklaus...\n",
      "ttlfull_246                                                        \n",
      "Name: 458, dtype: object \n",
      "\n",
      "... and its slave records ...\n",
      "docid                                                     404633099\n",
      "035liste                                         [(RERO)R008499625]\n",
      "isbn                             [3-290-20138-4, 978-3-290-20138-8]\n",
      "ttlpart           {'245': ['Mystiker Mittler Mensch', '600 Jahre...\n",
      "pubyear                                                    2016    \n",
      "decade                                                         2016\n",
      "century                                                        2016\n",
      "exactDate                                                  2016uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                  [388 Seiten]\n",
      "volumes                                                         388\n",
      "pubinit                                         edition nzn bei tvz\n",
      "pubword                                       [Edition NZN bei TVZ]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710     trägerverein 600 jahre niklaus von flüe 1417-2017\n",
      "corporate_full    trägerverein 600 jahre niklaus von flüe 1417-2017\n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                            gröbliroland, achermannwalter\n",
      "person_245c       herausgegeben für den trägerverein 600 jahre n...\n",
      "ttlfull_245       mystiker mittler mensch, 600 jahre niklaus von...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504390201\n",
      "Name: 358, dtype: object \n",
      "\n",
      "docid                                                     380205769\n",
      "035liste          [(OCoLC)951113986, (NEBIS)010734165, (OCoLC)95...\n",
      "isbn                                            [978-3-290-20138-8]\n",
      "ttlpart           {'245': ['Mystiker, Mittler, Mensch', '600 Jah...\n",
      "pubyear                                                    2016    \n",
      "decade                                                         2016\n",
      "century                                                        2016\n",
      "exactDate                                                  2016uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                  [388 Seiten]\n",
      "volumes                                                         388\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700        gröbliroland, kronenbergheidi, riesmarkus, wal...\n",
      "person_245c       herausgegeben für den trägerverein 600 jahre n...\n",
      "ttlfull_245       mystiker, mittler, mensch, 600 jahre niklaus v...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504390201\n",
      "Name: 346, dtype: object \n",
      "\n",
      "docid                                                     375482563\n",
      "035liste                         [(OCoLC)964366899, (BGR)000660651]\n",
      "isbn                             [978-3-290-20138-8, 3-290-20138-4]\n",
      "ttlpart           {'245': ['Mystiker Mittler Mensch', '600 Jahre...\n",
      "pubyear                                                    2016    \n",
      "decade                                                         2016\n",
      "century                                                        2016\n",
      "exactDate                                                  2016uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                      [388 S.]\n",
      "volumes                                                         388\n",
      "pubinit                                         edition nzn bei tvz\n",
      "pubword                                       [Edition NZN bei TVZ]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                            gröbliroland, achermannwalter\n",
      "person_245c       roland gröbli ... [et al.] (hrsg.) ; mit beitr...\n",
      "ttlfull_245       mystiker mittler mensch, 600 jahre niklaus von...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504390201\n",
      "Name: 345, dtype: object \n",
      "\n",
      "docid                                                     404109071\n",
      "035liste          [(OCoLC)951113986, (ABN)000804056, (OCoLC)9511...\n",
      "isbn                                            [978-3-290-20138-8]\n",
      "ttlpart           {'245': ['Mystiker Mittler Mensch', '600 Jahre...\n",
      "pubyear                                                    2016    \n",
      "decade                                                         2016\n",
      "century                                                        2016\n",
      "exactDate                                                  2016uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                      [388 S.]\n",
      "volumes                                                         388\n",
      "pubinit                                         edition nzn bei tvz\n",
      "pubword                                       [Edition NZN bei TVZ]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                                             gröbliroland\n",
      "person_245c       herausgegeben für den trägerverein 600 jahre n...\n",
      "ttlfull_245       mystiker mittler mensch, 600 jahre niklaus von...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504390201\n",
      "Name: 351, dtype: object \n",
      "\n",
      "docid                                                     380205769\n",
      "035liste          [(OCoLC)951113986, (NEBIS)010734165, (OCoLC)95...\n",
      "isbn                                            [978-3-290-20138-8]\n",
      "ttlpart           {'245': ['Mystiker, Mittler, Mensch', '600 Jah...\n",
      "pubyear                                                    2016    \n",
      "decade                                                         2016\n",
      "century                                                        2016\n",
      "exactDate                                                  2016uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                  [388 Seiten]\n",
      "volumes                                                         388\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700        gröbliroland, kronenbergheidi, riesmarkus, wal...\n",
      "person_245c       herausgegeben für den trägerverein 600 jahre n...\n",
      "ttlfull_245       mystiker, mittler, mensch, 600 jahre niklaus v...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504390201\n",
      "Name: 346, dtype: object \n",
      "\n",
      "docid                                                     404109071\n",
      "035liste          [(OCoLC)951113986, (ABN)000804056, (OCoLC)9511...\n",
      "isbn                                            [978-3-290-20138-8]\n",
      "ttlpart           {'245': ['Mystiker Mittler Mensch', '600 Jahre...\n",
      "pubyear                                                    2016    \n",
      "decade                                                         2016\n",
      "century                                                        2016\n",
      "exactDate                                                  2016uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                      [388 S.]\n",
      "volumes                                                         388\n",
      "pubinit                                         edition nzn bei tvz\n",
      "pubword                                       [Edition NZN bei TVZ]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                                             gröbliroland\n",
      "person_245c       herausgegeben für den trägerverein 600 jahre n...\n",
      "ttlfull_245       mystiker mittler mensch, 600 jahre niklaus von...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504390201\n",
      "Name: 351, dtype: object \n",
      "\n",
      "\n",
      "pair-------------------------------------> 121 474\n",
      "docid                                                     504390201\n",
      "035liste          [(RERO)R008499625, (NEBIS)010734165, (BGR)0006...\n",
      "isbn                             [3-290-20138-4, 978-3-290-20138-8]\n",
      "ttlpart           {'245': ['Mystiker Mittler Mensch', '600 Jahre...\n",
      "pubyear                                                    2016    \n",
      "decade                                                         2016\n",
      "century                                                        2016\n",
      "exactDate                                                  2016uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                  [388 Seiten]\n",
      "volumes                                                         388\n",
      "pubinit                                         edition nzn bei tvz\n",
      "pubword                                       [Edition NZN bei TVZ]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710     trägerverein 600 jahre niklaus von flüe 1417-2017\n",
      "corporate_full    trägerverein 600 jahre niklaus von flüe 1417-2017\n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                            gröbliroland, achermannwalter\n",
      "person_245c       herausgegeben für den trägerverein 600 jahre n...\n",
      "ttlfull_245       mystiker mittler mensch, 600 jahre niklaus von...\n",
      "ttlfull_246                                                        \n",
      "Name: 121, dtype: object \n",
      "\n",
      "... and its master record ...\n",
      "docid                                                     404845843\n",
      "035liste          [(OCoLC)951113986, (SGBN)001375035, (OCoLC)951...\n",
      "isbn                             [978-3-290-20138-8, 3-290-20138-4]\n",
      "ttlpart           {'245': ['Mystiker, Mittler, Mensch', '600 Jah...\n",
      "pubyear                                                    2016    \n",
      "decade                                                         2016\n",
      "century                                                        2016\n",
      "exactDate                                                  2016uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                  [280 Seiten]\n",
      "volumes                                                         280\n",
      "pubinit                            tvz, theologischer verlag zürich\n",
      "pubword                          [TVZ, Theologischer Verlag Zürich]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710             trägerverein «600 jahre niklaus von flüe»\n",
      "corporate_full            trägerverein «600 jahre niklaus von flüe»\n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020400\n",
      "person_100                                                         \n",
      "person_700                  gröbliroland, achermannwalter, nikolaus\n",
      "person_245c       hrsg. für den trägerverein 600 jahre nikolaus ...\n",
      "ttlfull_245       mystiker, mittler, mensch, 600 jahre niklaus v...\n",
      "ttlfull_246                                                        \n",
      "Name: 474, dtype: object \n",
      "\n",
      "... and its slave records ...\n",
      "docid                                                     404633099\n",
      "035liste                                         [(RERO)R008499625]\n",
      "isbn                             [3-290-20138-4, 978-3-290-20138-8]\n",
      "ttlpart           {'245': ['Mystiker Mittler Mensch', '600 Jahre...\n",
      "pubyear                                                    2016    \n",
      "decade                                                         2016\n",
      "century                                                        2016\n",
      "exactDate                                                  2016uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                  [388 Seiten]\n",
      "volumes                                                         388\n",
      "pubinit                                         edition nzn bei tvz\n",
      "pubword                                       [Edition NZN bei TVZ]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710     trägerverein 600 jahre niklaus von flüe 1417-2017\n",
      "corporate_full    trägerverein 600 jahre niklaus von flüe 1417-2017\n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                            gröbliroland, achermannwalter\n",
      "person_245c       herausgegeben für den trägerverein 600 jahre n...\n",
      "ttlfull_245       mystiker mittler mensch, 600 jahre niklaus von...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504390201\n",
      "Name: 358, dtype: object \n",
      "\n",
      "docid                                                     380205769\n",
      "035liste          [(OCoLC)951113986, (NEBIS)010734165, (OCoLC)95...\n",
      "isbn                                            [978-3-290-20138-8]\n",
      "ttlpart           {'245': ['Mystiker, Mittler, Mensch', '600 Jah...\n",
      "pubyear                                                    2016    \n",
      "decade                                                         2016\n",
      "century                                                        2016\n",
      "exactDate                                                  2016uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                  [388 Seiten]\n",
      "volumes                                                         388\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700        gröbliroland, kronenbergheidi, riesmarkus, wal...\n",
      "person_245c       herausgegeben für den trägerverein 600 jahre n...\n",
      "ttlfull_245       mystiker, mittler, mensch, 600 jahre niklaus v...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504390201\n",
      "Name: 346, dtype: object \n",
      "\n",
      "docid                                                     375482563\n",
      "035liste                         [(OCoLC)964366899, (BGR)000660651]\n",
      "isbn                             [978-3-290-20138-8, 3-290-20138-4]\n",
      "ttlpart           {'245': ['Mystiker Mittler Mensch', '600 Jahre...\n",
      "pubyear                                                    2016    \n",
      "decade                                                         2016\n",
      "century                                                        2016\n",
      "exactDate                                                  2016uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                      [388 S.]\n",
      "volumes                                                         388\n",
      "pubinit                                         edition nzn bei tvz\n",
      "pubword                                       [Edition NZN bei TVZ]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                            gröbliroland, achermannwalter\n",
      "person_245c       roland gröbli ... [et al.] (hrsg.) ; mit beitr...\n",
      "ttlfull_245       mystiker mittler mensch, 600 jahre niklaus von...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504390201\n",
      "Name: 345, dtype: object \n",
      "\n",
      "docid                                                     404109071\n",
      "035liste          [(OCoLC)951113986, (ABN)000804056, (OCoLC)9511...\n",
      "isbn                                            [978-3-290-20138-8]\n",
      "ttlpart           {'245': ['Mystiker Mittler Mensch', '600 Jahre...\n",
      "pubyear                                                    2016    \n",
      "decade                                                         2016\n",
      "century                                                        2016\n",
      "exactDate                                                  2016uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                      [388 S.]\n",
      "volumes                                                         388\n",
      "pubinit                                         edition nzn bei tvz\n",
      "pubword                                       [Edition NZN bei TVZ]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                                             gröbliroland\n",
      "person_245c       herausgegeben für den trägerverein 600 jahre n...\n",
      "ttlfull_245       mystiker mittler mensch, 600 jahre niklaus von...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504390201\n",
      "Name: 351, dtype: object \n",
      "\n",
      "docid                                                     380205769\n",
      "035liste          [(OCoLC)951113986, (NEBIS)010734165, (OCoLC)95...\n",
      "isbn                                            [978-3-290-20138-8]\n",
      "ttlpart           {'245': ['Mystiker, Mittler, Mensch', '600 Jah...\n",
      "pubyear                                                    2016    \n",
      "decade                                                         2016\n",
      "century                                                        2016\n",
      "exactDate                                                  2016uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                  [388 Seiten]\n",
      "volumes                                                         388\n",
      "pubinit                                                            \n",
      "pubword                                                          []\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700        gröbliroland, kronenbergheidi, riesmarkus, wal...\n",
      "person_245c       herausgegeben für den trägerverein 600 jahre n...\n",
      "ttlfull_245       mystiker, mittler, mensch, 600 jahre niklaus v...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504390201\n",
      "Name: 346, dtype: object \n",
      "\n",
      "docid                                                     404109071\n",
      "035liste          [(OCoLC)951113986, (ABN)000804056, (OCoLC)9511...\n",
      "isbn                                            [978-3-290-20138-8]\n",
      "ttlpart           {'245': ['Mystiker Mittler Mensch', '600 Jahre...\n",
      "pubyear                                                    2016    \n",
      "decade                                                         2016\n",
      "century                                                        2016\n",
      "exactDate                                                  2016uuuu\n",
      "edition                                                            \n",
      "part                                                               \n",
      "pages                                                      [388 S.]\n",
      "volumes                                                         388\n",
      "pubinit                                         edition nzn bei tvz\n",
      "pubword                                       [Edition NZN bei TVZ]\n",
      "scale                                                              \n",
      "coordinate                                                       []\n",
      "doi                                                                \n",
      "ismn                                                               \n",
      "musicid                                                            \n",
      "coordinate_E                                                       \n",
      "coordinate_N                                                       \n",
      "corporate_110                                                      \n",
      "corporate_710                                                      \n",
      "corporate_full                                                     \n",
      "format_prefix                                                    bk\n",
      "format_postfix                                               020000\n",
      "person_100                                                         \n",
      "person_700                                             gröbliroland\n",
      "person_245c       herausgegeben für den trägerverein 600 jahre n...\n",
      "ttlfull_245       mystiker mittler mensch, 600 jahre niklaus von...\n",
      "ttlfull_246                                                        \n",
      "masters_docid                                             504390201\n",
      "Name: 351, dtype: object \n",
      "\n"
     ]
    }
   ],
   "source": [
    "pd.options.display.max_rows = len(slave_master.columns)\n",
    "\n",
    "for i in range(len(masters_uniques_duplicates['master'])):\n",
    "    print('\\npair------------------------------------->', \n",
    "          masters_uniques_duplicates['master'][i], masters_uniques_duplicates['unique'][i]\n",
    "         )\n",
    "    print(goldstandard['masters'].loc[masters_uniques_duplicates['master'][i]], '\\n')\n",
    "    print('... and its master record ...')\n",
    "    print(goldstandard['uniques'].loc[masters_uniques_duplicates['unique'][i]], '\\n')\n",
    "    print('... and its slave records ...')\n",
    "    for j in masters_uniques_duplicates['slave'][masters_uniques_duplicates['master'][i]]:\n",
    "        print(goldstandard['slaves'].loc[j], '\\n')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The visual check confirms that the status of duplicates are given for the pairs of records in uniques and slaves. Therefore, these records must be excluded from the pairing of rows to records of uniques."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Uniques Rows Generation"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "To build pairs of uniques of the goldstandard, all records of slaves are joined with all records of uniques, except for the records that will produce duplicates shown in the previous subsection."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Number of slave records : 435, number of unique records : 593, expected pairs : 257,955 = joined pairs : 257,955\n"
     ]
    }
   ],
   "source": [
    "df_s_1 = goldstandard['slaves']\n",
    "df_u_1 = goldstandard['uniques'].copy() # Do not modify original data.\n",
    "\n",
    "# Exclude duplication candidates from above\n",
    "df_u_1.drop(index=masters_uniques_duplicates['unique'], inplace=True)\n",
    "#display(df_u_1.loc[masters_uniques_duplicates['unique']])\n",
    "\n",
    "df_s_1['duplicates'] = 0\n",
    "df_u_1['duplicates'] = 0\n",
    "# Full join, Cartesian product\n",
    "non_duplicates = pd.merge(df_s_1, df_u_1, on='duplicates')\n",
    "\n",
    "print('Number of slave records : {:,d}, number of unique records : {:,d}, expected pairs : {:,d} = joined pairs : {:,d}'.format(\n",
    "    len(df_s_1), len(df_u_1), len(df_s_1)*len(df_u_1), len(non_duplicates)))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "docid_x                                                     40314471X\n",
       "035liste_x               [(NATIONALLICENCE)oxford-10.1093/ndt/gft319]\n",
       "isbn_x                                                             []\n",
       "ttlpart_x           {'245': ['Molecular bases of circadian rhythmi...\n",
       "pubyear_x                                                    201310  \n",
       "decade_x                                                         2013\n",
       "century_x                                                        2013\n",
       "exactDate_x                                                  201310uu\n",
       "edition_x                                                            \n",
       "part_x                                        28 10 2013 10 2421 2431\n",
       "pages_x                                                            []\n",
       "volumes_x                                                            \n",
       "pubinit_x                                                            \n",
       "pubword_x                                                          []\n",
       "scale_x                                                              \n",
       "coordinate_x                                                       []\n",
       "doi_x                                              10.1093/ndt/gft319\n",
       "ismn_x                                                               \n",
       "musicid_x                                                            \n",
       "coordinate_E_x                                                       \n",
       "coordinate_N_x                                                       \n",
       "corporate_110_x                                                      \n",
       "corporate_710_x                                                      \n",
       "corporate_full_x                                                     \n",
       "format_prefix_x                                                    bk\n",
       "format_postfix_x                                               010053\n",
       "person_100_x                                                         \n",
       "person_700_x        bonnyolivier, vinciguerramanlio, gumzmichelle ...\n",
       "person_245c_x       [olivier bonny, manlio vinciguerra, michelle l...\n",
       "ttlfull_245_x       molecular bases of circadian rhythmicity in re...\n",
       "ttlfull_246_x                                                        \n",
       "masters_docid                                               264854039\n",
       "duplicates                                                          0\n",
       "docid_y                                                     410670472\n",
       "035liste_y          [(VAUD)991004117739702852, (RNV)005699188-41bc...\n",
       "isbn_y                                                             []\n",
       "ttlpart_y           {'245': ['Bonne chance !', 'cours de langue fr...\n",
       "pubyear_y                                                    19982004\n",
       "decade_y                                                         1998\n",
       "century_y                                                        1998\n",
       "exactDate_y                                                  19982004\n",
       "edition_y                                                            \n",
       "part_y                                                               \n",
       "pages_y                                                      [3 vol.]\n",
       "volumes_y                                                           3\n",
       "pubinit_y                          berner lehrmittel- und medienverl.\n",
       "pubword_y                        [Berner Lehrmittel- und Medienverl.]\n",
       "scale_y                                                              \n",
       "coordinate_y                                                       []\n",
       "doi_y                                                                \n",
       "ismn_y                                                               \n",
       "musicid_y                                                            \n",
       "coordinate_E_y                                                       \n",
       "coordinate_N_y                                                       \n",
       "corporate_110_y                                                      \n",
       "corporate_710_y     interkantonale lehrmittelzentrale (rapperswil,...\n",
       "corporate_full_y    interkantonale lehrmittelzentrale (rapperswil,...\n",
       "format_prefix_y                                                    bk\n",
       "format_postfix_y                                               020000\n",
       "person_100_y                                                         \n",
       "person_700_y                                            kesslersigrid\n",
       "person_245c_y       sigrid kessler... [et al.] ; [hrsg.] interkant...\n",
       "ttlfull_245_y             bonne chance !, cours de langue française 2\n",
       "ttlfull_246_y                                                        \n",
       "Name: 207432, dtype: object"
      ]
     },
     "execution_count": 37,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "pd.options.display.max_rows = len(non_duplicates.columns)\n",
    "\n",
    "non_duplicates.loc[rand.randrange(len(non_duplicates))]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The number of records of pairs of uniques shown above, is big enough. No further records of pairs of uniques for training and testing purposes will be needed. For this reason, joining the records of uniques with themselves will be omitted and the pairs generated so far will be taken as they are."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Build Feature Base"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The rows with pairs of duplicates and the rows with pairs of uniques resulting from above, can be concatenated to a DataFrame which will be the basis for further processing into the feature matrix."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Number of rows with pairs of uniques :\t\t257,955\n",
      "Number of rows with pairs of duplicates :\t1,473\n"
     ]
    }
   ],
   "source": [
    "df_feature_base = pd.concat([duplicates, non_duplicates], sort=True)\n",
    "# Set unique values on index\n",
    "df_feature_base.reset_index(inplace=True, drop=True)\n",
    "\n",
    "print('Number of rows with pairs of uniques :\\t\\t{:,d}'.format(len(df_feature_base[df_feature_base.duplicates==0])))\n",
    "print('Number of rows with pairs of duplicates :\\t{:,d}'.format(len(df_feature_base[df_feature_base.duplicates==1])))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Summary"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The result of this chapter is a full understanding of Swissbib's goldstandard data and how to produce pairs of rows which represent duplicates and pairs of rows which represent uniques. After generating the pairs of duplicates and the pairs of uniques, the following ratio is in the data set that will be used for training the machine learning models."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "ratio of uniques :\t99.43 %\n",
      "ratio of duplicates :\t0.57 %\n"
     ]
    }
   ],
   "source": [
    "print('ratio of uniques :\\t{:.2f} %\\nratio of duplicates :\\t{:.2f} %'.format(\n",
    "    df_feature_base.duplicates.value_counts(normalize=True).loc[0]*100,\n",
    "    df_feature_base.duplicates.value_counts(normalize=True).loc[1]*100))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Besides the data with rows of uniques and duplicates, the metadata of the project have been updated. After this chapter, the metadata look like the result of the following lines of code."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "data_analysis_columns \n",
      " ['coordinate_E', 'coordinate_N', 'corporate_full', 'doi', 'edition', 'exactDate', 'format_prefix', 'format_postfix', 'isbn', 'ismn', 'musicid', 'part', 'person_100', 'person_700', 'person_245c', 'pubinit', 'scale', 'ttlfull_245', 'ttlfull_246', 'volumes'] \n",
      "\n",
      "columns_to_use \n",
      " ['duplicates', 'coordinate_E_x', 'coordinate_E_y', 'coordinate_N_x', 'coordinate_N_y', 'corporate_full_x', 'corporate_full_y', 'doi_x', 'doi_y', 'edition_x', 'edition_y', 'exactDate_x', 'exactDate_y', 'format_prefix_x', 'format_prefix_y', 'format_postfix_x', 'format_postfix_y', 'isbn_x', 'isbn_y', 'ismn_x', 'ismn_y', 'musicid_x', 'musicid_y', 'part_x', 'part_y', 'person_100_x', 'person_100_y', 'person_700_x', 'person_700_y', 'person_245c_x', 'person_245c_y', 'pubinit_x', 'pubinit_y', 'scale_x', 'scale_y', 'ttlfull_245_x', 'ttlfull_245_y', 'ttlfull_246_x', 'ttlfull_246_y', 'volumes_x', 'volumes_y'] \n",
      "\n"
     ]
    }
   ],
   "source": [
    "for k in columns_metadata_dict.keys():\n",
    "    print(k, '\\n', columns_metadata_dict[k], '\\n')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The data handover for the next chapter still needs to done."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Goldstandard DataFrame Handover"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "For further processing in the next chapters, the metadata dictionary and the resulting feature base DataFrame of this chapter need to be persisted. Both will be restored and used in upcoming chapters. The metadata extended in this chapter is saved into a pickle file."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 41,
   "metadata": {},
   "outputs": [],
   "source": [
    "import bz2\n",
    "\n",
    "# Binary intermediary metadata file\n",
    "with open(os.path.join(path_goldstandard,\n",
    "                       'columns_metadata.pkl'), 'wb') as dict_output_file:\n",
    "    pk.dump(columns_metadata_dict, dict_output_file)\n",
    "\n",
    "# Store into compressed intermediary file\n",
    "with bz2.BZ2File(os.path.join(path_goldstandard, 'feature_base_df.pkl'),\n",
    "                 'w') as df_output_file:\n",
    "    pk.dump(df_feature_base, df_output_file)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The stored feature base DataFrame may become a big file. A file bigger than 100MB cannot be checked in into github. To be able to checkin the pickle file of the feature base data, it has been compressed using Python library $\\texttt{bz2}$."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}