fixed issues

Author: miriambaglioni

Dockerfile

@@ -17,11 +17,11 @@ ADD requirements.txt /home/jovyan/openaire/
 
 
 # this command is to download the data and set up the requirements
-# COMMENT NOT TO DOWNLOAD THE DATA
+# COMMENT NOT TO DOWNLOAD THE DATA. UNCOMMENT the last three lines
 RUN cd /home/jovyan/openaire && make data 
 
-# UNCOMMENT THE FOLLOWING COMMANDS TO COPY THE DATA FROM LOCAL FOLDER
 # the following commands are for downloaded dataset stored in the local folder to be added to the image
+# UNCOMMENT THE FOLLOWING COMMANDS TO COPY THE DATA FROM LOCAL FOLDER. COMMENT the previous command
 # ADD [downloaded_data_folder] /home/jovyan/openaire/[downloaded_data_folder]
 # RUN ls /home/jovyan/openaire/[downloaded_data_folder]/*.tar | xargs -i tar xf {} -C /home/jovyan/openaire/data/raw/
 # RUN cd /home/jovyan/openaire && make requirements 

README.md

@@ -20,7 +20,7 @@ This will take care of everything is needed to create a Docker image. At the end
 
 # How to run the container
 Open Docker Engine, locate the Docker image you just built and run it, having care of specifying a port (e.g., 8888).
-In the log, you should see an URL promped like `https://127.0.0.1:8888/...`; that's our guy, click on it.
+In the log, you should see an URL prompted like `https://127.0.0.1:8888/...`; that's our guy, click on it.
 The browser will open a page with JupyterLab; this is where you can start playing with the OpenAIRE Graph.
 
 You can run the container from the Terminal too with the following command

notebooks/beginners_kit.ipynb

@@ -66,7 +66,7 @@
    "metadata": {},
    "outputs": [],
    "source": [
-    "df = pd.read_json('../data/raw/publication/part-00000.txt.gz', compression='gzip', lines=True)\n",
+    "df = pd.read_json('../data/raw/publication/part-00000.json.gz', compression='gzip', lines=True)\n",
     "df.head(2)"
    ]
   },
@@ -250,7 +250,7 @@
    "outputs": [],
    "source": [
     "pretty_print(json.loads(publications\n",
-    "                        .where(\"id='78975075580c::2ff84f3173897001283274434e8f3eaa'\")\n",
+    "                        .where(\"id='dedup_wf_001::0e3994a1750486fa484062a783fb3cae'\")\n",
     "                        .toJSON()\n",
     "                        .first()), expanded=False)"
    ]
@@ -721,7 +721,7 @@
     "query = \"\"\"\n",
     "SELECT legalshortname, legalname\n",
     "FROM organizations \n",
-    "WHERE legalshortname IS NULL and legalshortname IS NOT NULL\n",
+    "WHERE legalshortname IS NULL and legalname IS NOT NULL\n",
     "\"\"\"\n",
     "\n",
     "spark.sql(query).limit(20).toPandas()"