Scribd
Upload
18 views

Reference Guide - Pandas Tools For Structuring A Dataset

The document provides a reference guide for common Pandas functions used to structure datasets. It lists functions for combining data frames like merge(), concat(), and join(); extracting or selecting specific columns or data types using []; filtering data using Boolean masks; sorting values with sort_values(); and slicing data frames with iloc[] and loc[]. Key takeaways are that these tools are foundational for structuring data through operations like filtering, sorting, merging, and slicing. Additional resources are provided for learning more about the functions and parameters.

Uploaded by

khederissa385
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
18 views

Reference Guide - Pandas Tools For Structuring A Dataset

The document provides a reference guide for common Pandas functions used to structure datasets. It lists functions for combining data frames like merge(), concat(), and join(); extracting or selecting specific columns or data types using []; filtering data using Boolean masks; sorting values with sort_values(); and slicing data frames with iloc[] and loc[]. Key takeaways are that these tools are foundational for structuring data through operations like filtering, sorting, merging, and slicing. Additional resources are provided for learning more about the functions and parameters.

Uploaded by

khederissa385
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 5

Reference guide: Python functions for structuring a

dataset

Pandas structuring reference guide

As you’ve learned, there are far too many Python functions to memorize all of them. That’s why,
as every data professional will tell you, you’ll be using reference sheets and coding libraries
nearly every day in your data analysis work.

The following reference guide will help you identify the most common Pandas tools used for
structuring data. Note that this is just for reference. For detailed information on how each
method works, including explanations of every parameter and examples, refer to the linked
documentation.

Combine data
Note that for many situations that require combining data, you can use a number of different
functions, methods, or approaches. Usually you’re not limited to a single “correct” function. So if
these functions and methods seem very similar, don’t worry! It’s because they are! The best way
to learn them, determine what works best for you, and understand them is to use them!

df.merge()
● A method available to the DataFrame class.
● Use df.merge() to take columns or indices from other dataframes and combine them
with the one to which you’re applying the method.
● Example:

df1.merge(df2, how=‘inner’, on=[‘month’,’year’])

pd.concat()
● A pandas function to combine series and/or dataframes
● Use pd.concat() to join columns, rows, or dataframes along a particular axis
● Example:
df3 = pd.concat([df1.drop(['column_1','column_2'], axis=1), df2])

df.join()
● A method available to the DataFrame class.
● Use df.join() to combine columns with another dataframe either on an index or on a key
column. Efficiently join multiple DataFrame objects by index at once by passing a list.
● Example:

df1.set_index('key').join(df2.set_index('key'))

Visual representation of a combination:

Extract or select data


df[[columns]]
● Use df[[columns]] to extract/select columns from a dataframe.
● Example:

df[['animal', 'legs']]

df.select_dtypes()
● A method available to the DataFrame class.
● Use df.select_dtypes() to return a subset of the dataframe’s columns based on the
column dtypes (e.g., float64, int64, bool, object, etc.).
● Example:
df2 = df.select_dtypes(include=['int64'])

Visual representation of extraction:

Filter data
Recall from Course 2 that Boolean masks are used to filter dataframes.

df[condition]
● Use df[condition] to create a Boolean mask, then apply the mask to the dataframe to
filter according to selected condition.
● Example:

df[df['class']=='Aves']

Visual representation of filtering:

Sort data
df.sort_values()
● A method available to the DataFrame class.
● Use df.sort_values() to sort data according to selected parameters.
● Example:

df.sort_values(by=['legs'], ascending=False)

Visual representation of sorting:

Slice data
df.iloc[]
● Use df.iloc[] to slice a dataframe based on an integer index location.
● Examples:

df.iloc[5:10, 2:] → selects only rows 5 through 9, at columns 2+

df.iloc[5:10] → selects only rows 5 through 9, all columns

df.iloc[1, 2] → selects value at row 1, column 2

df.iloc[[0, 2], [2, 4] → selects only rows 0 and 2, at columns 2 and

df.loc[]
● Use df.loc[] to slice a dataframe based on a label or Boolean array.
● Example:

df.loc[:, ['color', 'class']]


Key takeaways
The tools in this reference guide are foundational to structuring data, including filtering, sorting,
merging, and slicing. You will find yourself using them throughout your career as a data
professional.

Resources for more information


Refer to these links for more details on Python functions and their various parameters.
● Pandas documentation to describe parameters in Python functions
● W3schools provides explanations for Python functions in an easy-to-understand way

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy