Scribd Logo
Upload

Welcome to Scribd!

  • 8 views

    Homework IntroToDL

    Uploaded by

    quyngoc.20032705
    This document discusses modifications to a ResNet-34 model to create a ResNet-18 model, data augmentation methods applied to an image, and adjusting the learning rate schedule during training. Specifically, it instructs to: 1) Modify one line of code to change the ResNet-34 to a ResNet-18. 2) Apply 4 data augmentation methods chosen based on the last 4 digits of a student ID to an image, noting the parameters. 3) Plot the learning rate schedule over 50 epochs for 2 schedulers chosen based on the last 2 digits of a student ID.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd

    Homework IntroToDL

    Uploaded by

    quyngoc.20032705
    8 views3 pages
    This document discusses modifications to a ResNet-34 model to create a ResNet-18 model, data augmentation methods applied to an image, and adjusting the learning rate schedule during training. Specifically, it instructs to: 1) Modify one line of code to change the ResNet-34 to a ResNet-18. 2) Apply 4 data augmentation methods chosen based on the last 4 digits of a student ID to an image, noting the parameters. 3) Plot the learning rate schedule over 50 epochs for 2 schedulers chosen based on the last 2 digits of a student ID.

    Original Title

    Homework-IntroToDL

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    This document discusses modifications to a ResNet-34 model to create a ResNet-18 model, data augmentation methods applied to an image, and adjusting the learning rate schedule during training. Specifically, it instructs to: 1) Modify one line of code to change the ResNet-34 to a ResNet-18. 2) Apply 4 data augmentation methods chosen based on the last 4 digits of a student ID to an image, noting the parameters. 3) Plot the learning rate schedule over 50 epochs for 2 schedulers chosen based on the last 2 digits of a student ID.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    8 views3 pages

    Homework IntroToDL

    Uploaded by

    quyngoc.20032705
    This document discusses modifications to a ResNet-34 model to create a ResNet-18 model, data augmentation methods applied to an image, and adjusting the learning rate schedule during training. Specifically, it instructs to: 1) Modify one line of code to change the ResNet-34 to a ResNet-18. 2) Apply 4 data augmentation methods chosen based on the last 4 digits of a student ID to an image, noting the parameters. 3) Plot the learning rate schedule over 50 epochs for 2 schedulers chosen based on the last 2 digits of a student ID.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    You are on page 1of 3

    Assignment 1 - Introduction to Deep Learning 20231

    1, Given the following implementation of ResNet-34

    class ResNet(nn.Module):
    def __init__(self, block, layers, planes, num_classes = 10):
    super(ResNet, self).__init__()
    self.inplanes = 64
    self.conv1 = nn.Sequential(
    nn.Conv2d(3, 64, kernel_size = 7, stride = 2, padding = 3),
    nn.BatchNorm2d(64),
    nn.ReLU())
    self.maxpool = nn.MaxPool2d(kernel_size = 3, stride = 2, padding = 1)
    self.layer0 = self._make_layer(block, planes[0], layers[0], stride = 1)
    self.layer1 = self._make_layer(block, planes[1], layers[1], stride = 2)
    self.layer2 = self._make_layer(block, planes[2], layers[2], stride = 2)
    self.layer3 = self._make_layer(block, planes[3], layers[3], stride = 2)
    self.avgpool = nn.AdaptiveAvgPool2d((1,1))
    self.fc = nn.Linear(512, num_classes)

    def _make_layer(self, block, planes, blocks, stride=1):


    downsample = None
    if stride != 1 or self.inplanes != planes:

    downsample = nn.Sequential(
    nn.Conv2d(self.inplanes, planes, kernel_size=1, stride=stride),
    nn.BatchNorm2d(planes),
    )
    layers = []
    layers.append(block(self.inplanes, planes, stride, downsample))
    self.inplanes = planes
    for i in range(1, blocks):
    layers.append(block(self.inplanes, planes))

    return nn.Sequential(*layers)

    def forward(self, x):


    x = self.conv1(x)
    x = self.maxpool(x)
    x = self.layer0(x)
    x = self.layer1(x)
    x = self.layer2(x)
    x = self.layer3(x)
    x = self.avgpool(x)
    x = x.view(x.size(0), -1)
    x = self.fc(x)

    return x
    ResNet34 = ResNet(ResidualBlock,[3,4,6,3],[64,128,256,512])
    Modify 1 line of code to make a ResNet-18 model instead of ResNet-34

    2, Data Augmentation
    Refer to https://pytorch.org/vision/0.15/transforms.html
    Given the following image (you can download it via this link). Firstly, resize it to 256x256.
    List of augmentation methods used in this exercise
    0 RandomCrop
    1 Pad (zero)
    2 Random rotation
    3 Random affine
    4 ElasticTransform
    5 Horizontal Flip
    6 Vertical Flip
    7 Color Jitter
    8 RandomInvert(p=1)
    9 Gaussian Blur (kernel size = 7)
    E1 Pad (edge)
    E2 RandomAdjustSharpness
    E3 Pad (symmetric)

    Instruction: Visualize 4 augmentation methods as follows


    - Take the last 4 digits your student ID and you have to choose 4 methods correspond
    to the above table (e.g. 20202023 -> methods 2, 0, 2, 3)
    - Digit 2 is repeated twice, so the methods for you to do are 2, 0, 3, and E1 (if you have
    a digit repeated 3 times, e.g. 3133 do 3, 1, E1 and E2; etc.)
    - You can use any parameters you want for the augmentation methods, but note it
    down.
    Example

    3, Adjust learning rate


    - Set up an Adam optimizer for a random network, initial learning rate = 0.01
    - Plot the change of learning rate through 50 epochs using wandb
    - The following table lists the learning rate schedulers, refer to
    https://pytorch.org/docs/stable/optim.html

    0 ExponentialLR
    1 StepLR (step size = 10)
    2 CosineAnnealingLR (T max = 10)
    3 CyclicLR (mode = “triangular2”)

    - From the last 2 digits of your student ID, take the remainder of each by 4 and it will
    be the 2 learning rates you will have to plot
    - For example, 20237672 -> 72 -> 7 % 4 = 3 (CyclicLR) and 2 % 4 = 2
    (CosineAnnealingLR) ; if you get the same number twice, do the n+1 one, e.g. 37 -> 3
    and 3 -> 3 and 0
    - Except from the mentioned parameters, everything else will be of your choice
    - Note:get_last_lr() or optimizer.__dict__['param_groups'][0]['lr'] can be helpful
    4,
    a, Implement VGG 16 with a 224x224 input, adding BatchNorm2d after each conv+ReLU
    layer except for the ones before max pool layers(as shown in the image)
    b, How many extra learnable parameters are there compared to the one without
    batchnorm?

    You might also like

    pFad - Phonifier reborn

    Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

    Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


    Alternative Proxies:

    Alternative Proxy

    pFad Proxy

    pFad v3 Proxy

    pFad v4 Proxy