SPPU BE AI&DS syllabus

SPPU · Final Year Artificial Intelligence and Data Science · 2020 Course

GPU Programming and Architecture

417524A · Elective IV · Semester VII · 3 credits · In-semester 30 + end-semester 70

One of the Elective IV options.

All notes for this subject
  1. Unit 1: GPU Architecture

    6 hours

    Evolution of GPUs; parallelism; CUDA hardware; threads, blocks, grids, warps and scheduling; shared, global, constant and texture memory.

    Marks: 15 in the in-semester exam

    • GPU architecture
    • Threads, blocks, grids and warps
    • CUDA memory types
  2. Unit 2: CUDA Programming

    6 hours

    CUDA platform and programming model; kernels and thread and memory hierarchies; heterogeneous and asynchronous SIMT programming; compute capability; multi-CPU and multi-GPU; optimising decomposition, memory, transfers and threads.

    Marks: 15 in the in-semester exam

    • CUDA kernels and thread hierarchy
    • Heterogeneous programming
    • Multi-GPU programming
    • Optimising CUDA applications
  3. Unit 3: CUDA Programming Issues

    6 hours

    Error handling; synchronisation and algorithmic issues; debugging; NVCC compilation workflow; binary and PTX compatibility; the CUDA runtime.

    Marks: 17–18 in the end-semester exam

    • CUDA error handling
    • Synchronisation in CUDA
    • NVCC compilation and PTX
  4. Unit 4: Introduction to OpenCL

    6 hours

    OpenCL model and host programs; alternatives; kernels; host–device interaction; execution environment and memory model; examples.

    Marks: 17–18 in the end-semester exam

    • OpenCL programming model
    • OpenCL kernels and host code
    • OpenCL memory model
  5. Unit 5: Algorithms on GPUs

    6 hours

    Convolution, prefix sum and sparse matrix multiplication; heterogeneous clusters; dynamic parallelism and its limits; memory allocation.

    Marks: 17–18 in the end-semester exam

    • Parallel convolution
    • Parallel prefix sum
    • Sparse matrix multiplication on GPUs
    • Dynamic parallelism
  6. Unit 6: OpenCL Application Design

    6 hours

    OpenCL platform and memory models; application-specific processors and TTA; standalone OpenCL; heterogeneous computing; neural network training and inference.

    Marks: 17–18 in the end-semester exam

    • OpenCL for heterogeneous computing
    • GPU neural network training

Unit contents are summarised from the official SPPU syllabus . AiCanCode.org is not affiliated with Savitribai Phule Pune University.