RTMNU Final CSE (AI & ML) syllabus

RTMNU · Final Year B.Tech Computer Science & Engineering (AI & ML) · CBCS

Deep Learning

BTCSEAI&ML702.1T · Elective IV · Semester VII · 3 credits · College 30 + university 70

One of the Elective IV options.

  1. Unit 1: Basics of Deep Learning

    8 hours

    The history of deep learning, the McCulloch–Pitts neuron and thresholding logic; perceptrons, the perceptron learning algorithm and its convergence; multilayer perceptrons and their representation power, sigmoid neurons and feed-forward networks.

    Examined in the 70-mark end-semester paper

    • McCulloch–Pitts neuron and thresholding logic
    • Perceptron learning rule
    • Multilayer perceptron
    • Feed-forward network architectures
  2. Unit 2: Training Feed-forward Neural Networks

    7 hours

    The representation power of feed-forward networks and how they are trained: gradient descent and its momentum-based, Nesterov accelerated and stochastic forms, AdaGrad, RMSProp and Adam.

    Examined in the 70-mark end-semester paper

    • Backpropagation
    • Gradient descent variants
    • Momentum and Nesterov accelerated gradient descent
    • Optimisers: AdaGrad, RMSProp and Adam
  3. Unit 3: Optimisation, Activation, Initialisation and Regularisation

    7 hours

    The optimisation algorithms in practice; activation functions (sigmoid, tanh, ReLU) and Xavier and He initialisation; regularisation — bias and variance, overfitting, hyperparameter tuning, L1 and L2 regularisation, data augmentation, early stopping, and parameter sharing and tying.

    Examined in the 70-mark end-semester paper

    • Activation functions
    • Weight initialisation: Xavier and He
    • Bias-variance trade-off
    • Regularisation and dropout
    • Early stopping, parameter sharing and ensembles
    • Hyperparameters in deep learning
    • Data augmentation
  4. Unit 4: Convolutional Neural Networks

    7 hours

    The convolution operation and pooling; the LeNet, AlexNet, ZF-Net, VGGNet, GoogLeNet and ResNet architectures; visualising convolutional networks and guided backpropagation.

    Examined in the 70-mark end-semester paper

    • Convolution and feature maps
    • Padding, stride and pooling
    • CNN architectures: LeNet to ResNet
    • Visualising CNNs: guided backpropagation and Deep Dream
  5. Unit 5: Recurrent Neural Networks

    7 hours

    Recurrent neural networks, backpropagation through time, vanishing and exploding gradients, long short-term memory cells and gated recurrent units.

    Examined in the 70-mark end-semester paper

    • Recurrent neural networks
    • Backpropagation through time
    • Vanishing and exploding gradients
    • LSTM
    • GRU

Unit contents are summarised from the official RTMNU syllabus . AiCanCode.org is not affiliated with Rashtrasant Tukadoji Maharaj Nagpur University (RTMNU).