Ultimate Developer Command Guide

Complete Python, PySpark & SQL Reference

All essential commands in one optimized cheat sheet

Python Commands

Command Function Example

print("Welcome to
print() Outputs data to console Python!") # Prints:
Welcome to Python!

my_list = [1, 2, 3];

len() Returns length of an object print(len(my_list)) #
Output: 3

for i in range(3):
range() Generates a sequence of numbers print(i) # Prints: 0, 1,
2

def greet(name): return

f"Hello, {name}";
def Defines a custom function
print(greet("Alice")) #
Prints: Hello, Alice

import math;
import Imports a module or library print(math.pi) # Prints:
3.141592653589793

squares = [x**2 for x in

[x for x in [1, 2, 3]];
Creates a list using comprehension
iterable] print(squares) # Prints:
[1, 4, 9]

x = 10; if x > 5:
print("Big") else:
if/elif/else Conditional logic
print("Small") # Prints:
Big

for fruit in ["apple",

for Iterates over a sequence "banana"]: print(fruit) #
Prints: apple, banana

count = 0; while count <

while Loops until condition is false 3: print(count); count +=
1 # Prints: 0, 1, 2

try: print(1/0) except

ZeroDivisionError:
try/except Handles exceptions print("Cannot divide by
zero") # Prints: Cannot
divide by zero

with open("example.txt",
"w") as f:
open() Opens a file for reading/writing
f.write("Hello") #
Creates file with text
 my_list = [];
my_list.append(5);
list.append() Adds an item to a list
print(my_list) # Prints:
[5]

my_dict = {"key":
"value"};
dict.get() Retrieves value from dictionary
print(my_dict.get("key"))
# Prints: value

PySpark Commands

Command/Function Function Example

Initializes a Spark from pyspark.sql import SparkSession; spark =

SparkSession.builder
session SparkSession.builder.appName("MyApp").getOrCreate()

Loads CSV file into df = spark.read.csv("data.csv", header=True,

spark.read.csv()
a DataFrame inferSchema=True); df.show() # Displays CSV data

Displays first n
df.show() df.show(3) # Shows first 3 rows
rows of DataFrame

Displays
df.printSchema() df.printSchema() # Shows column names and types
DataFrame schema

Selects specific df.select("name", "age").show() # Shows name and

df.select()
columns age columns

Filters rows based df.filter(df.age > 25).show() # Shows rows where

df.filter()
on condition age > 25

df.where("salary > 50000").show() # Filters rows

df.where() Alias for filter
where salary > 50000

Groups data and df.groupBy("department").agg({"salary":

df.groupBy().agg()
applies aggregation "avg"}).show() # Shows avg salary per dept

Joins two df1.join(df2, df1.id == df2.id, "inner").show() #

df.join()
DataFrames Inner join on id

Adds or modifies a df.withColumn("age_plus_10", df.age + 10).show() #

df.withColumn()
column Adds column with age + 10

df.withColumnRenamed("old_name", "new_name").show()
df.withColumnRenamed() Renames a column
# Renames column

Drops specified
df.drop() df.drop("salary").show() # Drops salary column
columns

Replaces null df.fillna({"age": 0}).show() # Replaces null ages

df.fillna()
values with 0

Removes duplicate df.dropDuplicates(["name"]).show() # Drops

df.dropDuplicates()
rows duplicate names
 Saves DataFrame df.write.csv("output.csv", mode="overwrite") #
df.write.csv()
as CSV Saves DataFrame to CSV

Registers
df.createOrReplaceTempView("temp_table") # Creates
df.createOrReplaceTempView() DataFrame as SQL
SQL view
table

Runs SQL query on spark.sql("SELECT name FROM temp_table WHERE age >
spark.sql()
DataFrame 30").show() # Runs SQL query

from pyspark.sql.window import Window; w =

Defines window for Window.partitionBy("dept").orderBy("salary");
Window.partitionBy()
ranking/aggregation df.withColumn("rank", row_number().over(w)).show()
# Adds rank column

SQL Commands

Command Function Example

SELECT name, age FROM

SELECT Retrieves data from a table employees # Selects
name and age columns

SELECT * FROM employees

WHERE age > 30 #
WHERE Filters rows based on condition
Filters employees older
than 30

SELECT * FROM employees

ORDER BY salary DESC #
ORDER BY Sorts result set
Sorts by salary in
descending order

SELECT department,
AVG(salary) FROM
GROUP BY Groups rows for aggregation employees GROUP BY
department # Avg salary
per dept

SELECT department,
COUNT(*) FROM employees
GROUP BY department
HAVING Filters grouped results
HAVING COUNT(*) > 5 #
Depts with > 5
employees

SELECT e.name,
d.dept_name FROM
employees e JOIN
JOIN Combines rows from multiple tables
departments d ON
e.dept_id = d.id #
Joins tables

SELECT e.name,
d.dept_name FROM
employees e LEFT JOIN
LEFT JOIN Includes all rows from left table
departments d ON
e.dept_id = d.id # Left
join
 SELECT * FROM employees
LIMIT Restricts number of returned rows LIMIT 5 # Returns first
5 rows

INSERT INTO employees

(name, age) VALUES
INSERT INTO Adds new rows to a table
('Alice', 28) # Inserts
a new employee

UPDATE employees SET

salary = 60000 WHERE
UPDATE Modifies existing rows
name = 'Alice' #
Updates salary

DELETE FROM employees

WHERE age < 18 #
DELETE Removes rows from a table
Deletes rows where age
< 18

CREATE TABLE employees

(id INT, name
CREATE TABLE Creates a new table
VARCHAR(50), age INT) #
Creates employees table

ALTER TABLE employees

ADD COLUMN salary
ALTER TABLE Modifies table structure
DECIMAL(10,2) # Adds
salary column

DROP TABLE employees #

DROP TABLE Deletes a table
Deletes employees table

Cheat Sheet Summary

Your comprehensive reference for daily development tasks across Python, PySpark and SQL
Version 2.0 | Updated: August 2024

Print Tip: Use Ctrl+P (Win) / Cmd+P (Mac) to save as PDF