Skip to main content
grasp.study
About
Explore
Pricing
Log in
Try it for free
Back to course
👋
Welcome to a Grasp lesson
Create a free account
to keep studying and create your own study path.
Image-Enhanced Lesson Design
·
Module 1
Visualizing FlashAttention’s IO-Aware Dataflow
1
Tracing Tiled QKV Data Movement in FlashAttention’s Memory Hierarchy
Trace, on an annotated memory-hierarchy diagram, how one tiled block of query, key, and value matrices moves between HBM and SRAM during a FlashAttention forward pass.
End of course,
Back to course
Previous module
Next module