Mumbai University BE Computer syllabus

Mumbai University · Final Year Computer Engineering · Rev-2019 'C' Scheme

Deep Learning

CSDC8011 · Department Optional Course 5 · Semester VIII · 3 credits · Internal tests 20 (average of two) + end-semester 80

End-semester paper (3 hours): Six questions of 20 marks; you answer four. Each module's share of the paper follows its lecture hours.

One of the Department Optional Course 5 options. In this paper Q1 and Q6 span every module, and Q2 to Q5 cover the other modules.

All notes for this subject
  1. Module 1: Fundamentals of Neural Networks

    4 hours

    Biological neurons; McCulloch–Pitts; perceptron and delta learning; multilayer perceptron for separable and non-separable classes; deep networks and their history.

    Examined in the 80-mark end-semester paper (about 10% of it, by lecture hours); the class tests cover what has been taught by then

    • Perceptron and feed-forward networks
    • Deep learning vs machine learning
    • History, advantages and challenges of deep learning
  2. Module 2: Training, Optimisation and Regularisation

    10 hours

    Feed-forward DNNs; tanh, logistic, softmax, ReLU and leaky ReLU; squared-error and cross-entropy loss; backpropagation; GD, SGD, mini-batch, momentum, Nesterov, AdaGrad, Adam and RMSProp; bias–variance; L1, L2, dropout, weight decay, batch norm, early stopping and augmentation.

    Examined in the 80-mark end-semester paper (about 26% of it, by lecture hours); the class tests cover what has been taught by then

    • Activation functions in deep networks
    • Loss functions
    • Forward and backpropagation
    • Gradient descent and vanishing and exploding gradients
    • Optimisers: momentum, Nesterov, AdaGrad, RMSProp and Adam
    • Regularisation: dropout, batch normalisation and early stopping
  3. Module 3: Autoencoders

    6 hours

    Linear, undercomplete and overcomplete autoencoders; regularisation; denoising, sparse and contractive autoencoders; image compression.

    Examined in the 80-mark end-semester paper (about 15% of it, by lecture hours); the class tests cover what has been taught by then

    • Autoencoders
    • Denoising, sparse and contractive autoencoders
  4. Module 4: Convolutional Neural Networks

    7 hours

    Convolution, padding and stride; input, output and filter sizes; convolution and pooling layers; weight sharing; LeNet and AlexNet.

    Examined in the 80-mark end-semester paper (about 18% of it, by lecture hours); the class tests cover what has been taught by then

    • Convolution, padding and strides
    • Pooling and fully connected layers
    • CNN architecture
    • LeNet and AlexNet
  5. Module 5: Recurrent Neural Networks

    8 hours

    Sequence learning; unfolding graphs; RNNs and bidirectional RNNs; BPTT and truncated BPTT; vanishing and exploding gradients; LSTM and GRU.

    Examined in the 80-mark end-semester paper (about 21% of it, by lecture hours); the class tests cover what has been taught by then

    • Recurrent neural networks
    • Bidirectional and deep RNNs
    • Backpropagation through time
    • Long-term dependencies, LSTM and GRU
  6. Module 6: Recent Trends

    4 hours

    GAN architecture; image generation and deepfakes.

    Examined in the 80-mark end-semester paper (about 10% of it, by lecture hours); the class tests cover what has been taught by then

    • Generative adversarial networks
    • Types and applications of GANs

Module contents are summarised from the official Mumbai University syllabus . AiCanCode.org is not affiliated with the University of Mumbai.