Someone wanted to learn this too, so Grasp built them a personal learning path.
You can keep exploring this one or create a path like this one shaped around you.
Recommended resources
Module 2
Introduction to GPU Programming: CUDA and Metal
Module 3
GPU Memory Models and Data Transfer
Module 4
Parallel Algorithms and Synchronization
Module 5
Hardware-Agnostic Tensor Library
Module 6
Core Operator Kernels: Activations and Normalization
Module 7
Advanced Operator Kernels: GEMM and Convolution
Module 8
Building the Inference Engine Core
Module 9
Python Integration with PyBind11
Module 10