Deep Learning
│
▼
Transformers
│
▼
PyTorch Internals
│
▼
CUDA
│
▼
Triton
│
▼
Compiler Optimizations
│
▼
ML Infrastructure
Learning:
- Convolutional Neural Networks
Building:
- Deep Learning implementations
Reading:
- Dive into Deep Learning
Next:
- TransformersFlashAttention
torch.compile()
Torch Dispatcher
Tensor Layouts
Kernel Fusion
Triton
Tensor Operations
Autograd
Neural Network Modules
Optimizers
CNNs
Transformers
| Languages |
|
| Deep Learning |
|
| Backend |
|
| Frontend |
|
| Systems |
|
2026.07
✓ Tensor Fundamentals
✓ Tensor Storage & Strides
✓ Memory Layout
✓ Broadcasting
✓ Autograd
✓ Convolutional Neural Networks: LeNet, ResNeXt , DenseNet
→ RNN
→ Transformers
→ RL



