deep-roots learning program · module 12

Module 12 — GPU & AI accelerator memory

Every chapter: first principles, What insiders know, a See it yourself lab, connections, and a quiz with worked answers.

01

The GPU memory hierarchy

Registers, shared memory, L2, HBM — SIMT and the bandwidth-first design.

→
02

Coalescing & the roofline

Warp memory access as cache-line physics; tiling; compute-vs-memory bound.

→
03

Allocation & the real OOM

GMMU, the caching allocator, fragmentation — why free ≥ request still fails.

→
04

Unified memory & the future

Managed memory, Apple UMA, CXL — memory as a network endpoint.

→
the exam
fin

Module 12 final exam

Every chapter, worked answers behind the fold.

→