Scribd Logo
Upload

Welcome to Scribd!

  • 25 views

    Assignment 2: Introduction To Machine Learning Prof. B. Ravindran

    Uploaded by

    Vijayramasamy
    This document contains 10 multiple choice questions about machine learning concepts like linear regression, feature selection methods, LASSO vs Ridge regression, and principal component analysis. Key points covered include: 1) The parameters in linear regression can take any real value. 2) Best subset selection is more computationally expensive than forward or backward selection due to evaluating all possible subsets. 3) Adding interaction terms to linear regression can reduce the training error by allowing for a more flexible model fit. 4) Principal component analysis finds orthogonal directions that explain the most variance in the data, with the first principal component explaining the highest variance.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd

    Assignment 2: Introduction To Machine Learning Prof. B. Ravindran

    Uploaded by

    Vijayramasamy
    25 views3 pages
    This document contains 10 multiple choice questions about machine learning concepts like linear regression, feature selection methods, LASSO vs Ridge regression, and principal component analysis. Key points covered include: 1) The parameters in linear regression can take any real value. 2) Best subset selection is more computationally expensive than forward or backward selection due to evaluating all possible subsets. 3) Adding interaction terms to linear regression can reduce the training error by allowing for a more flexible model fit. 4) Principal component analysis finds orthogonal directions that explain the most variance in the data, with the first principal component explaining the highest variance.

    Original Title

    ML_A2

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    This document contains 10 multiple choice questions about machine learning concepts like linear regression, feature selection methods, LASSO vs Ridge regression, and principal component analysis. Key points covered include: 1) The parameters in linear regression can take any real value. 2) Best subset selection is more computationally expensive than forward or backward selection due to evaluating all possible subsets. 3) Adding interaction terms to linear regression can reduce the training error by allowing for a more flexible model fit. 4) Principal component analysis finds orthogonal directions that explain the most variance in the data, with the first principal component explaining the highest variance.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    25 views3 pages

    Assignment 2: Introduction To Machine Learning Prof. B. Ravindran

    Uploaded by

    Vijayramasamy
    This document contains 10 multiple choice questions about machine learning concepts like linear regression, feature selection methods, LASSO vs Ridge regression, and principal component analysis. Key points covered include: 1) The parameters in linear regression can take any real value. 2) Best subset selection is more computationally expensive than forward or backward selection due to evaluating all possible subsets. 3) Adding interaction terms to linear regression can reduce the training error by allowing for a more flexible model fit. 4) Principal component analysis finds orthogonal directions that explain the most variance in the data, with the first principal component explaining the highest variance.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    You are on page 1of 3

    Assignment 2

    Introduction to Machine Learning


    Prof. B. Ravindran
    1. The parameters obtained in linear regression

    (a) can take any value in the real space


    (b) are strictly integers
    (c) always lie in the range [0,1]
    (d) can take only non zero values

    Sol. (a)
    2. Consider forward selection, backward selection and best subset selection with respect to the
    same data set. Which of the following is true?
    (a) Best subset selection can be computationally more expensive than forward selection
    (b) forward selection and backward selection always lead to the same result
    (c) best subset selection can be computationally less expensive than backward selection
    (d) best subset selection and forward selection are computationally equally expensive
    (e) both (b) and (d)

    Sol. (a)
    Explanation Best subset selection has to explore all possible subsets which takes exponential
    time. It is not guaranteed that forward selection and backward selection take the same time.
    Forward selection and backward selection are computational much cheaper than best subset
    selection.

    3. Adding interaction terms (such as products of two dimensions) along with original features in
    linear regression
    (a) can reduce training error.
    (b) can increase training error.
    (c) cannot affect training error.

    Sol. (a)
    Adding interaction terms gives us additional modeling freedom. This can fit the training data
    better and hence leads to lower training error.
    4. Consider the following five training examples

    X = [2 3 4 5 6]

    Y = [12.8978 17.7586 23.3192 28.3129 32.1351]


    We want to learn a function f (x) of the form f (x) = ax + b which is parameterized by (a, b).
    Using squared error as the loss function, which of the following parameters would you use to
    model this function.

    1
    (a) (4 3)
    (b) (5 3)
    (c) (5 1)
    (d) (1 5)
    Sol. (b)

    5. A study was conducted to understand the effect of number of hours the students spent studying
    to their performance in the final exams. You are given the following 8 samples from the study.
    What is the best linear fit on this dataset?

    Table 1: Number of hours spent vs final score

    Number of hours spent studying (x) Score in the final exam (0-100) (y)
    10 95
    9 80
    2 10
    15 50
    10 45
    16 98
    11 38
    16 93

    (a) y = -3.39x + 11.62


    (b) y = 4.59x + 12.58
    (c) y = 3.39x + 10.58
    (d) y = 4.69x + 11.62
    Sol. (b)

    6. Which of the following shrinkage method is more likely to lead to sparse solution?

    (a) Lasso regression


    (b) Ridge regression
    (c) Lasso and ridge regression both return sparse solutions
    Sol. (a)

    7. Consider the design matrix X of dimension N × (p + 1). Which of the following statements
    are true?
    (a) The rowspace of X is the same as the columnspace of X >
    (b) The rowspace of X is the same as the rowspace of X >
    (c) both (a) and (b)
    (d) none of the above

    2
    Sol. (a)

    8. How does LASSO differ from Ridge Regression? (multiple options may be correct)
    (a) LASSO uses L1 regularization while Ridge Regression uses L2 regularization.
    (b) LASSO uses L2 regularization while Ridge Regression uses L1 regularization.
    (c) The LASSO constraint is a high-dimensional rhomboid while the Ridge Regression con-
    straint is a high-dimensional ellipsoid.
    (d) Ridge Regression shrinks more coefficients to 0 compared to LASSO.
    (e) The Ridge Regression constraint is a high-dimensional rhomboid while the LASSO con-
    straint is a high-dimensional ellipsoid.
    (f) Ridge Regression shrinks less coefficients to 0 compared to LASSO.

    Sol. (a), (c), (f)


    9. Principal Component Regression (PCR) is an approach to find an orthogonal set of basis
    vectors which can then be used to reduce the dimension of the input. Which of the following
    matrices contains the principal component directions as its columns (follow notation from the
    lecture video)

    (a) X
    (b) S
    (c) Xc
    (d) V
    (e) U
    Sol. (d)
    10. Let v1 , v2 , . . . vp denote the Principal Components of some data X, as extracted by Principal
    Components Analysis and where v1 is the First Principal Component. What can you say
    about the variance of X in the directions defined by v1 , v2 , . . . vp ? (multiple options may be
    correct)
    (a) X has the highest variance along v1
    (b) X has the lowest variance along vp
    (c) X has the lowest variance along v1
    (d) X has the highest variance along vp
    (e) Order of variance : v1 ≥ v2 ≥ . . . ≥ vp
    (f) Order of variance : vp ≥ vp−1 ≥ . . . ≥ v1

    Sol. (a), (b), (e)

    You might also like

    pFad - Phonifier reborn

    Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

    Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


    Alternative Proxies:

    Alternative Proxy

    pFad Proxy

    pFad v3 Proxy

    pFad v4 Proxy