RTMNU Final CSE (AI & ML) syllabus

RTMNU · Final Year B.Tech Computer Science & Engineering (AI & ML) · CBCS

Reinforcement Learning

BTCSEAI&ML802.2T · Elective VI · Semester VIII · 3 credits · College 30 + university 70

One of the Elective VI options. An NPTEL course: its page lists twelve weeks, grouped here into units.

  1. Unit 1: Introduction and Bandit Algorithms (weeks 1–3)

    The trial-and-error learning problem and its roots; bandit algorithms — UCB, PAC algorithms and median elimination, and policy-gradient bandits.

    Examined in the 70-mark end-semester paper

    • History and scope of reinforcement learning
    • Multi-armed bandits
    • Exploration strategies
    • PAC bandit algorithms and median elimination
  2. Unit 2: Full Reinforcement Learning and MDPs (weeks 4–5)

    The full reinforcement-learning problem as a Markov decision process, value functions and Bellman optimality.

    Examined in the 70-mark end-semester paper

  3. Unit 3: Dynamic Programming, TD Methods and Eligibility Traces (weeks 6–7)

    Dynamic-programming solutions of MDPs, temporal-difference methods, and eligibility traces.

    Examined in the 70-mark end-semester paper

    • Dynamic programming for MDPs
    • Policy iteration
    • Value iteration
    • Temporal difference learning
    • Eligibility traces and TD(λ)
  4. Unit 4: Function Approximation and Deep RL (weeks 8–10)

    Function approximation and least-squares methods; fitted Q-iteration, deep Q-networks and policy gradients for full RL.

    Examined in the 70-mark end-semester paper

    • Value-function approximation
    • Least-squares methods and fitted Q-iteration
    • Deep Q-networks
    • Policy gradient theorem
  5. Unit 5: Hierarchical RL and POMDPs (weeks 11–12)

    Hierarchical reinforcement learning and partially observable Markov decision processes.

    Examined in the 70-mark end-semester paper

    • Hierarchical reinforcement learning
    • Partially observable MDPs

Unit contents are summarised from the official RTMNU syllabus . AiCanCode.org is not affiliated with Rashtrasant Tukadoji Maharaj Nagpur University (RTMNU).