Computational Biologist @aizentherapeutics
|| WashU MS CS
Pinned Loading
-
QuantizedAttentionKernel
QuantizedAttentionKernel PublicFP8-Attention: A CUDA-accelerated kernel for efficient transformer attention computation that uses E4M3 FP8 quantization and FlashAttention-style tiling to reduce memory usage and increase inferenc…
Cuda 1
-
Something went wrong, please refresh the page to try again.
If the problem persists, check the GitHub status page or contact support.
If the problem persists, check the GitHub status page or contact support.