RTMNU TY CSE syllabus

RTMNU · Third Year B.Tech Computer Science & Engineering · NEP 2020

Generative AI

BCSE6T24.3 · Elective III · Semester VI · 3 credits · College 30 + university 70

One of the Elective III options. Five units here (an LLM and prompting unit), where TY Computer Engineering's version has four.

  1. Unit 1: Generative AI and Autoencoders

    7 hours

    An introduction to generative AI; autoencoders — representational power, layer size and depth; undercomplete, denoising, contractive and variational autoencoders; case study: autoencoders for dimension reduction.

    Examined in the 70-mark end-semester paper

    • Evolution of generative AI
    • Autoencoders
    • Denoising, sparse and contractive autoencoders
    • Variational autoencoders
  2. Unit 2: GANs, Autoregressive Models and Transformers

    8 hours

    Generative adversarial networks — structure and training, deep convolutional GANs; autoregressive models with finite memory and long-range memory through RNNs and CNNs; transformers — encoders, decoders and scaling laws; case study: a GAN-aided intrusion-detection system.

    Examined in the 70-mark end-semester paper

    • Generative adversarial networks
    • Types and applications of GANs
    • Autoregressive models: RNN- and CNN-based
    • Attention mechanism
    • Scaling laws for language models
  3. Unit 3: Structured Probabilistic Models

    7 hours

    Issues with unstructured models; directed and undirected graphs to describe models; the partition function, separation and d-separation, converting between graphs and sampling from graphical models; case study: the restricted Boltzmann machine.

    Examined in the 70-mark end-semester paper

    • Structured probabilistic models: directed and undirected graphs
    • Partition function and d-separation
    • Sampling from graphical models
    • Boltzmann machines and deep belief networks
  4. Unit 4: Generative AI Applications

    7 hours

    Generative AI in art and creativity, image and video generation, text generation, music composition, healthcare and finance; real-world use cases and the challenges of deploying generative models.

    Examined in the 70-mark end-semester paper

    • Applications of generative AI
    • Text, image, audio and video generation
  5. Unit 5: Large Language Models and Foundation Models

    7 hours

    Foundation models and the architecture of modern LLMs (GPT, BERT); pretraining versus fine-tuning and transfer learning in generative AI; prompt engineering — prompt design, zero-, one- and few-shot prompting and chain-of-thought prompting.

    Examined in the 70-mark end-semester paper

    • Foundation models and large language models
    • Contextual embeddings and BERT
    • Transfer learning and data augmentation
    • Zero-shot, one-shot and few-shot prompting

Unit contents are summarised from the official RTMNU syllabus . AiCanCode.org is not affiliated with Rashtrasant Tukadoji Maharaj Nagpur University (RTMNU).