alcherniaev / most_useful_spark Public

Notifications You must be signed in to change notification settings
Fork 1
Star 0

I wrote this code to illustrate Spark (Python) basics for newcomers at Sberbank

0 stars 1 fork Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 7 Commits
.ipynb_checkpoints		.ipynb_checkpoints
README.md		README.md
most_useful_spark.ipynb		most_useful_spark.ipynb

Repository files navigation

most_useful_spark

I wrote this code to illustrate Spark (Python) basics for newcomers at Sberbank

create dataframe
joins
execution plan
repartition vs partitionBy
write table
Regex
date
windows func
UDF
Broadcast filtering
Работа с HDFS

About

I wrote this code to illustrate Spark (Python) basics for newcomers at Sberbank

Report repository

Releases

No releases published

Packages

No packages published

Languages

Jupyter Notebook 100.0%