RTMNU · Third Year B.Tech Computer Science & Engineering · NEP 2020
Generative AI
BCSE6T24.3 · Elective III · Semester VI · 3 credits · College 30 + university 70
One of the Elective III options. Five units here (an LLM and prompting unit), where TY Computer Engineering's version has four.
Unit 1: Generative AI and Autoencoders
7 hoursAn introduction to generative AI; autoencoders — representational power, layer size and depth; undercomplete, denoising, contractive and variational autoencoders; case study: autoencoders for dimension reduction.
Examined in the 70-mark end-semester paper
- Evolution of generative AI
- Autoencoders
- Denoising, sparse and contractive autoencoders
- Variational autoencoders
Unit 2: GANs, Autoregressive Models and Transformers
8 hoursGenerative adversarial networks — structure and training, deep convolutional GANs; autoregressive models with finite memory and long-range memory through RNNs and CNNs; transformers — encoders, decoders and scaling laws; case study: a GAN-aided intrusion-detection system.
Examined in the 70-mark end-semester paper
- Generative adversarial networks
- Types and applications of GANs
- Autoregressive models: RNN- and CNN-based
- Attention mechanism
- Scaling laws for language models
Unit 3: Structured Probabilistic Models
7 hoursIssues with unstructured models; directed and undirected graphs to describe models; the partition function, separation and d-separation, converting between graphs and sampling from graphical models; case study: the restricted Boltzmann machine.
Examined in the 70-mark end-semester paper
- Structured probabilistic models: directed and undirected graphs
- Partition function and d-separation
- Sampling from graphical models
- Boltzmann machines and deep belief networks
Unit 4: Generative AI Applications
7 hoursGenerative AI in art and creativity, image and video generation, text generation, music composition, healthcare and finance; real-world use cases and the challenges of deploying generative models.
Examined in the 70-mark end-semester paper
- Applications of generative AI
- Text, image, audio and video generation
Unit 5: Large Language Models and Foundation Models
7 hoursFoundation models and the architecture of modern LLMs (GPT, BERT); pretraining versus fine-tuning and transfer learning in generative AI; prompt engineering — prompt design, zero-, one- and few-shot prompting and chain-of-thought prompting.
Examined in the 70-mark end-semester paper
- Foundation models and large language models
- Contextual embeddings and BERT
- Transfer learning and data augmentation
- Zero-shot, one-shot and few-shot prompting
Unit contents are summarised from the official RTMNU syllabus . AiCanCode.org is not affiliated with Rashtrasant Tukadoji Maharaj Nagpur University (RTMNU).