Simple Linear Regression:-

Regression is a statistic method which estimating the relationship between dependent

variables and independent variables. On the basis of variables, regression are two types, one
is simple linear regression and second is multiple linear regression. In simple linear
regression, we uses one independent variables to predict the outcome of dependent variables
Y.
 Dependent variables: - that variables who is being affected by other variables is called
dependent variables.
 Independent variables: - that variables who affect the outcome of the values of any variables
is called independent variables. For example, agricultural production depend on the rainfall
in any region. It means rainfall affect the agricultural production and agricultural production
will not affect the values of the rainfall. So agricultural production is dependent variable and
rainfall is independent variables.

 Derive the simple linear regression value by using the data which give on
table 5.
Ads Cost(X) Sales(Y)
45 15
55 25
47 17
75 34
90 41
100 47
95 46
88 37
50 22
45 20

Solution:-
 Summary output

Regression Statistics
Multiple R 0.985401606
R Square 0.971016325
Adjusted R Square 0.967393366
Standard Error 2.180543935
Observations 10

ANOVA
 df SS MS F Significance F
Regression 1 1274.362 1274.362 268.0174 1.95241E-07
Residual 8 38.03817 4.754772
Total 9 1312.4

Coefficie Standard P- Lower Upper Lower Upper

nts Error t Stat value 95% 95% 95.0% 95.0%
- - - - - -
Interc 5.652056 2.4493 0.0399 10.97337 0.330741 10.97337 0.330741
ept 555 2.307591 3 78 172 389 172 389
Ads
Cost(X 0.522493 16.371 1.95E- 0.448896 0.596090 0.448896 0.596090
) 573 0.031915 24 07 677 47 677 47

 Residual Output:-

Observation Predicted Sales(Y) Residuals

1 17.86015424 -2.860154242
2 23.08508997 1.914910026
3 18.90514139 -1.905141388
4 33.53496144 0.46503856
5 41.37236504 -0.372365039
6 46.59730077 0.402699229
7 43.9848329 2.015167095
8 40.32737789 -3.327377892
9 20.47262211 1.527377892
10 17.86015424 2.139845758
 X Variables- Line Fit Plot

50

45

40 y = 0.5225x - 5.6521
35 R² = 1
Sales (Y)

30 Sales(Y)

25 Predicted Y

20
Linear (Predicted Y)
15

10
40 50 60 70 80 90 100 110

Ads Cost (X)

Multiply regression:-

Data:-
S.N. District Y X1 X2 X3 X4
1 Indore 928 32.88 80.87 841 20.9
2 Jabalpur 929 14.51 81.07 473 25.3
3 Sagar 893 17.63 76.46 232 28.9
4 Bhopal 918 28.62 80.37 855 19.6
5 Rewa 931 19.86 71.62 375 32.9
6 Satna 926 19.19 72.26 297 29.9
7 Dhar 964 25.6 59 268 40.2
8 Chhindwara 964 13.07 71.16 177 36.6
9 Gwalior 864 24.5 76.65 446 14.5
10 Ujjain 955 16.12 72.34 326 33.8
11 Morena 840 23.44 71.03 394 16.8
12 West Nimar 965 22.85 62.7 233 40.9
13 Chhattarpur 883 19.51 63.74 203 32.7
14 Shivpuri 877 22.76 62.55 171 34.5
 15 Bhind 837 19.21 75.26 382 8.4
16 Balaghat 1021 13.6 77.09 184 47
17 Betul 971 12.92 68.9 157 42.9
18 Dewas 942 19.53 69.35 223 38.4
19 Rajgarh 956 23.26 61.21 251 41.8
20 Shajapur 938 17.2 69.09 244 39.1
21 Vidisha 896 20.09 70.53 286 21.6
22 Ratlam 971 19.72 66.78 255 39
23 Tikamgarh 901 20.13 61.43 157 36.9
24 Barwani 982 27.57 49.08 242 41.9
25 Seoni 982 18.22 72.12 157 42.4
26 Mandsaur 963 13.24 71.78 199 42.9
27 Raisen 901 18.35 72.98 178 23.4
28 Sehore 918 21.54 70.06 261 28.7
29 East Nimar 943 21.5 66.39 178 38.6
30 Katni 952 21.41 71.98 173 31
31 Damoh 910 16.63 69.73 185 34.3
32 Guna 912 26.97 63.23 208 30.3
33 Hoshangabad 914 14.49 75.29 232 22.4
34 Singrauli 920 28.05 60.41 213 34.6
35 Sidhi 957 23.72 64.43 172 32.2
36 Narsimhapur 920 14.01 75.69 182 29.5
37 Shahdol 974 17.39 66.67 285 38.1
38 Mandla 1008 17.97 66.87 142 49
39 Jhabua 990 30.7 43.3 285 48.9
40 Panna 905 18.67 64.79 142 32.4
41 Ashoknagar 904 22.66 66.42 271 20.8
42 Neemuch 954 13.77 70.8 221 42.9
43 Datia 873 18.46 72.63 200 26
44 Burhanpur 951 19.37 64.36 229 31.5
45 Anuppur 976 12.3 67.88 94 37.6
46 Alirajpur 1011 19.45 36.1 104 48.6
47 Dindori 1002 21.32 63.9 158 52.9
48 Sheopur 901 22.94 57.43 171 28.7
49 Umaria 950 24.96 65.89 158 36.3
50 Harda 935 20.25 72.5 171 26.9

Solution:-
Regression
Statistics
Multiple R 0.861298143
R Square 0.741834491
Adjusted R
Square 0.730848725
Standard Error 21.88011616
Observations 50

ANOVA
Significance
df SS MS F F
Regression 2 64655.56429 32327.78215 67.52687689 1.5122E-14
Residual 47 22500.75571 478.7394832
Total 49 87156.32

Coefficients Standard Error t Stat P-value Lower 95% Upper 95% Lower 95.0% Upper 95.0%
Intercept 778.3740084 17.20965382 45.2289172 2.11941E-40 743.75265 812.995366 743.752651 812.9953662
X Variable 1 0.063250698 0.024872373 2.5430102 0.014341646 0.0132139 0.11328746 0.01321394 0.113287458
X Variable 2 4.213768359 0.382159805 11.0261946 1.24661E-14 3.444962 4.98257472 3.444962 4.982574721