course_summary.md

Course Summary

Note that the course summary will be updated throughout the course.

Block 1

Getting started

Goals

1. navigate in the shell application: cmd or terminal
2. have python and anaconda installed, all required packages installed
3. now how to open and close, Python console, IPython console, jupyter notebook

Content

Shell: learn shell commands like ls, cd, pwd, mkdir, cp, mv, rm, rm -r, touch, echo, cat Python: download and installing anaconda, open python console, close it, install packages using anaconda IPython: open console, getting help, advantage compared to python console Jupyter notebook: open it, create a notebook, write code in cells, write markdown in cells, execute and create cells, delete cells, restart the kernel, close the notebook, stop the notebook server

Resources

• https://www.datacamp.com/courses/introduction-to-shell-for-data-science
• https://www.python.org/about/
• https://ipython.readthedocs.io/en/stable/
• https://www.datacamp.com/community/tutorials/tutorial-jupyter-notebook
• https://jupyter-notebook.readthedocs.io/en/stable/
• https://github.com/adam-p/markdown-here/wiki/Markdown-Cheatsheet
• Howto install WSL on windows 10
• Howto install Anaconda into WSL Note: if you simply copy paste file and directory names from the blog post, you may encounter errors (e.g., because – is not the same as -). Better type the first letters of a path/filename yourself and use Tab to autocomplete. Note 2: In the step where it's about actually installing Anaconda, use bash Anaconda3-2019.03-Linux-x86_64.sh. Note 3: You may find it convenient to set up a symbolic link to your windows home directory: ln -s /mnt/c/Users/your_username ~/windows

Exercises

• https://www.practicepython.org/exercise/2014/01/29/01-character-input.html
• https://www.datacamp.com/courses/introduction-to-shell-for-data-science

Basics of python

Goals

1. Know different ways to write and execute python code: console, script, jupyter notebook
2. Be familiar with python variables and data types, know how to access the documentation
3. Be familiar with booleans, dictionaries, if-else statements, loops, indexing, slicing, mutability, generators, iterators

Content

• python data types: boolean, int float, string, list, dict, tuple
• operators: +, -, /, *, **, %
• methods associated with data types, e.g., essential string methods, essential list methods.
• if-elif-else statements, conditional variable assignment, in operator
• list and tuple indexing, dict indexing, mutability vs. immutability,
• while loops, for loops, concept of iterator and generator, using enumerate, and zip, combining them.
• iterating through dictionaries
• list comprehension, conditional list comprehension

Resources

• https://github.com/cne-tum/msne-datascience-2019/blob/master/notebooks/block1/block1_session2_basic_python.ipynb
• https://github.com/cne-tum/msne-datascience-2019/blob/master/notebooks/block1/block1_session3_programming_concepts.ipynb
• https://www.datacamp.com/courses/intro-to-python-for-data-science
• https://s3.amazonaws.com/assets.datacamp.com/blog_assets/PythonForDataScience.pdf

Exercises

• https://www.datacamp.com/courses/intro-to-python-for-data-science
• https://www.practicepython.org/exercise/2014/02/26/04-divisors.html
• https://www.practicepython.org/exercise/2014/03/19/07-list-comprehensions.html
• https://www.practicepython.org/exercise/2017/01/24/33-birthday-dictionaries.html

NumPy

Goals

1. What is a Numpy array, and why to use them? (motivation)
2. Importing and Generating Data
3. Getting insight about the Data (type, dimension, size, etc.)
4. Manipulating the array (arithmetic operations, transpose, etc.)
5. Slicing and Masking
6. Combining arrays
7. Saving data

Content

• Import data:
  • np.load()
  • np.loadtxt()
  • np.genfromtxt()
• Creating Numpy arrays
  • np.zeros()
  • np.ones()
  • np.random.random()
  • np.empty()
  • np.full()
  • np.full_like()
  • np.eye()
  • np.identity()
• Data Inspection (assuming we have numpy a array object called data)
  • data.dtype
  • data.ndim
  • data.shape
  • data.size
  • data.strides
  • data.min()
  • data.max()
  • data.mean()
  • data.std()
  • data.cumsum()
• Data Transformation (assuming we have a numpy array object called data)
  • data.T
  • data.reshape()
  • data.resize()
  • np.expand_dims()
  • np.ravel()
  • np.add(), np.subtract(), np.multiply(), np.divide(), np.remainder()
  • np.exp(), np.log()
  • Masking using list (or array) of True and False values
• Combining multiple arrays ans splitting an array
  • np.concatenate()
  • np.append()
  • np.hstack()
  • np.vstack()
  • np.hsplit()
  • np.vsplit()
• Saving numpy arrays
  • save(): saves data in .npy format
  • savez(): Save several arrays into an uncompressed .npz archive
  • savez_compressed()
  • savetxt()

Resources

• https://github.com/cne-tum/msne-datascience-2019/blob/master/notebooks/block1/block1_session4_numpy.ipynb
• https://www.datacamp.com/community/tutorials/python-numpy-tutorial
• Cheat sheet

Exercises

• https://github.com/cne-tum/msne-datascience-2019/blob/master/notebooks/block1/block1_session4_numpyexercises.ipynb
• Section 4 (NumPy) of the datacamp Introduction to Python course