Kernels:

---

kernels-community

/

aiter-flash-attn-ck

like 1

Follow

kernels-community 460

Trusted publisher

This is the repository card of kernels-community/aiter-flash-attn-ck that has been pushed on the Hub. It was built to be used with the kernels library. This card was automatically generated.

How to use

# make sure `kernels` is installed: `pip install -U kernels`
from kernels import get_kernel

kernel_module = get_kernel("kernels-community/aiter-flash-attn-ck", version=1)
__kernel_metadata__ = kernel_module.__kernel_metadata__

__kernel_metadata__(...)

Available functions

• __kernel_metadata__
• flash_attn_func
• flash_attn_varlen_func
• flash_attn_with_kvcache

Benchmarks

No benchmark available yet.