This repository will soon be deleted as it's now deprecated. Please use kernels-community/sage-attention.
SageAttention
This is a build of the SageAttention compatible with kernels library
- Downloads last month
- 18
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
# !pip install kernels from kernels import get_kernel kernel = get_kernel("kernels-community/sage_attention")