Chispa Chispa is a helper library that makes it easy to unit test your PySpark code. Fun fact: "Chispa" means spark in Spanish. Here's how to test a column function: unit-test1 Here's another example of how to test a column function: unit-test2