Artificial Intelligence & Data Science is coming soon

We're still writing and reviewing the notes for every subject, and we'll open it when every subject is ready. Meanwhile you can practise aptitude, ask Aria about any subject, or see the branches that are ready.

Artificial Intelligence & Data Science

GPU Programming and Architecture

GPU architecture and CUDA memory, CUDA programming and optimisation, NVCC and errors, OpenCL, parallel GPU algorithms.

Interview questions
Notes for GPU Programming and Architecture are being written and reviewed. Until they're up, Aria teaches every topic — ask for any part of the syllabus, with worked numericals.

Coming next in GPU Programming and Architecture

  1. GPU architecture· notes coming
  2. Threads, blocks, grids and warps· notes coming
  3. CUDA memory types· notes coming
  4. CUDA kernels and thread hierarchy· notes coming
  5. Heterogeneous programming· notes coming
  6. Multi-GPU programming· notes coming
  7. Optimising CUDA applications· notes coming
  8. CUDA error handling· notes coming
  9. Synchronisation in CUDA· notes coming
  10. NVCC compilation and PTX· notes coming
  11. OpenCL programming model· notes coming
  12. OpenCL kernels and host code· notes coming
  13. OpenCL memory model· notes coming
  14. Parallel convolution· notes coming
  15. Parallel prefix sum· notes coming
  16. Sparse matrix multiplication on GPUs· notes coming
  17. Dynamic parallelism· notes coming
  18. OpenCL for heterogeneous computing· notes coming
  19. GPU neural network training· notes coming
  20. Evolution of GPU architectures and GPGPU· notes coming
  21. CUDA program structure and data transfer· notes coming
  22. CUDA runtime API and kernel launch· notes coming
  23. Mapping threads to multidimensional data· notes coming
  24. CUDA matrix–matrix multiplication· notes coming
  25. Thread scheduling and latency tolerance· notes coming
  26. Reducing global memory traffic with tiling· notes coming
  27. Warps, memory bandwidth and resource partitioning· notes coming
  28. Floating-point considerations on GPUs· notes coming
  29. GPU applications: gaming, computer vision and optimisation· notes coming
  30. Warp divergence and memory coalescing· notes coming
  31. Reduction kernels, kernel fusion and thread coarsening· notes coming