14/08/2024, 15:56 ML-5 - Jupyter Notebook

Name : Kanase Aditya Madhukar

Roll No : 2441059

Batch : D

Assignment No.05 : Implement K-Nearest Neighbors algorithm on diabetes.csv dataset. Compute confusion matrix,
accuracy, error rate, precision and recall on the given dataset. Dataset link :
https://www.kaggle.com/datasets/abdallamahgoub/diabetes
(https://www.kaggle.com/datasets/abdallamahgoub/diabetes)

In [1]: import pandas as pd

import numpy as np
from sklearn import metrics
from sklearn.svm import SVC
from sklearn.linear_model import LogisticRegression
from sklearn.model_selection import train_test_split
from sklearn.preprocessing import StandardScaler
from sklearn.neighbors import KNeighborsClassifier
from sklearn.metrics import confusion_matrix, accuracy_score, precision_score, recall_sco

In [2]: df = pd.read_csv('diabetes.csv')

In [3]: df.head()

Out[3]:
Pregnancies Glucose BloodPressure SkinThickness Insulin BMI Pedigree Age Outcome

0 6 148 72 35 0 33.6 0.627 50 1

1 1 85 66 29 0 26.6 0.351 31 0

2 8 183 64 0 0 23.3 0.672 32 1

3 1 89 66 23 94 28.1 0.167 21 0

4 0 137 40 35 168 43.1 2.288 33 1

In [4]: df.tail()

Out[4]:
Pregnancies Glucose BloodPressure SkinThickness Insulin BMI Pedigree Age Outcome

763 10 101 76 48 180 32.9 0.171 63 0

764 2 122 70 27 0 36.8 0.340 27 0

765 5 121 72 23 112 26.2 0.245 30 0

766 1 126 60 0 0 30.1 0.349 47 1

767 1 93 70 31 0 30.4 0.315 23 0

In [5]: df.isnull().sum()

Out[5]: Pregnancies 0
Glucose 0
BloodPressure 0
SkinThickness 0
Insulin 0
BMI 0
Pedigree 0
Age 0
Outcome 0
dtype: int64

localhost:8888/notebooks/ML/ML-5.ipynb 1/4
14/08/2024, 15:56 ML-5 - Jupyter Notebook

In [6]: X = df.drop("Outcome", axis=1)

y = df["Outcome"]

In [7]: X

Out[7]:
Pregnancies Glucose BloodPressure SkinThickness Insulin BMI Pedigree Age

0 6 148 72 35 0 33.6 0.627 50

1 1 85 66 29 0 26.6 0.351 31

2 8 183 64 0 0 23.3 0.672 32

3 1 89 66 23 94 28.1 0.167 21

4 0 137 40 35 168 43.1 2.288 33

... ... ... ... ... ... ... ... ...

763 10 101 76 48 180 32.9 0.171 63

764 2 122 70 27 0 36.8 0.340 27

765 5 121 72 23 112 26.2 0.245 30

766 1 126 60 0 0 30.1 0.349 47

767 1 93 70 31 0 30.4 0.315 23

768 rows × 8 columns

In [8]: X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.2, random_state=42

In [9]: scaler = StandardScaler()

X_train = scaler.fit_transform(X_train)
X_test = scaler.transform(X_test)

In [10]: X_train

Out[10]: array([[-0.52639686, -1.15139792, -3.75268255, ..., -4.13525578,

-0.49073479, -1.03594038],
[ 1.58804586, -0.27664283, 0.68034485, ..., -0.48916881,
2.41502991, 1.48710085],
[-0.82846011, 0.56687102, -1.2658623 , ..., -0.42452187,
0.54916055, -0.94893896],
...,
[ 1.8901091 , -0.62029661, 0.89659009, ..., 1.76054443,
1.981245 , 0.44308379],
[-1.13052335, 0.62935353, -3.75268255, ..., 1.34680407,
-0.78487662, -0.33992901],
[-1.13052335, 0.12949347, 1.43720319, ..., -1.22614383,
-0.61552223, -1.03594038]])

In [11]: k = 3
knn = KNeighborsClassifier(n_neighbors=k)
knn.fit(X_train, y_train)

Out[11]: KNeighborsClassifier(n_neighbors=3)

localhost:8888/notebooks/ML/ML-5.ipynb 2/4
14/08/2024, 15:56 ML-5 - Jupyter Notebook

In [12]: y_pred = knn.predict(X_test)

y_pred

/home/comp/anaconda3/lib/python3.9/site-packages/sklearn/neighbors/_classification.py:2
28: FutureWarning: Unlike other reduction functions (e.g. `skew`, `kurtosis`), the defa
ult behavior of `mode` typically preserves the axis it acts along. In SciPy 1.11.0, thi
s behavior will change: the default value of `keepdims` will become False, the `axis` o
ver which the statistic is taken will be eliminated, and the value None will no longer
be accepted. Set `keepdims` to True or False to avoid this warning.
mode, _ = stats.mode(_y[neigh_ind, k], axis=1)

Out[12]: array([0, 0, 0, 1, 1, 0, 0, 1, 1, 0, 1, 0, 0, 1, 0, 0, 0, 0, 1, 0, 1, 0,
0, 0, 1, 1, 0, 0, 0, 0, 1, 1, 1, 1, 1, 1, 1, 0, 0, 1, 0, 0, 1, 0,
0, 0, 0, 0, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 1, 0, 1,
0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 1, 0,
0, 0, 0, 0, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 1, 0, 1,
0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 1, 1, 1, 1,
0, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0])

In [13]: conf_matrix = confusion_matrix(y_test, y_pred)

accuracy = accuracy_score(y_test, y_pred)

error_rate = 1 - accuracy
precision = precision_score(y_test, y_pred)
recall = recall_score(y_test, y_pred)

print("Confusion Matrix:")
print(conf_matrix)
print("Accuracy:", accuracy)
print("Error Rate:", error_rate)
print("Precision:", precision)
print("Recall:", recall)

Confusion Matrix:
[[81 18]
[27 28]]
Accuracy: 0.7077922077922078
Error Rate: 0.29220779220779225
Precision: 0.6086956521739131
Recall: 0.509090909090909

In [14]: model = SVC(C = 1)

model.fit(X_train, y_train)

y_pred = model.predict(X_test)

In [15]: kc = metrics.confusion_matrix(y_test, y_pred)

print("SVM accuracy: ", kc)

SVM accuracy: [[82 17]

[24 31]]

In [16]: sc = metrics.accuracy_score(y_test,y_pred)
print("SVM accuracy: ", sc)

SVM accuracy: 0.7337662337662337

In [19]: lr = LogisticRegression()

lr.fit(X_train, y_train)

y_pred = lr.predict(X_test)

In [20]: acc = metrics.accuracy_score(y_test,y_pred)

print("Logistic Regression accuracy: ", acc)

Logistic Regression accuracy: 0.7532467532467533

localhost:8888/notebooks/ML/ML-5.ipynb 3/4
14/08/2024, 15:56 ML-5 - Jupyter Notebook

In [ ]:

localhost:8888/notebooks/ML/ML-5.ipynb 4/4