🐍 Quick reference guide to common patterns & functions in PySpark.

Notes on Apache Spark (pyspark)

PySpark Code for Hands-on Learners

PySpark Tutorial for Beginners - Practical Examples in Jupyter Notebook with Spark version 3.4.1. The tutorial covers various topics like Spark Introduction, Spark Installation, Spark RDD Transformations and Actions, Spark DataFrame, Spark SQL, and more. It is completely free on YouTube and is beginner-friendly without any prerequisites.

Teaching Materials for Distributed Statistical Computing (大数据分布式计算教学材料)

Implementation of Spark code in Jupyter notebook. Topics include: RDDs and DataFrame, exploratory data analysis (EDA), handling multiple DataFrames, visualization, Machine Learning

Elevate big data skills with Apache Spark's core concepts and examples

A tutorial that helps Big Data Engineers ramp up faster by getting familiar with PySpark dataframes and functions. It also covers topics like EMR sizing, Google Colaboratory, fine-tuning PySpark jobs, and much more.

Deploying python ML models in pyspark using Pandas UDFs

A PySpark course to get started with the basics for a Data Engineer

Useful scripts and notebooks for Data Science. The project was made by Miquido. https://www.miquido.com/

My notes on PySpark

Sample code for pyspark

spark with python_jupyter

A small walk through on how we can use PySpark with Google Colab

This is for spark streaming tutorials

Apache Spark learning notes and examples using Python 3

In this Repo, I create a tutorial of PySpark to better understand how to read and manage Big Data.