Moonshot AI Open-Sources FlashKDA: CUTLASS Kernels for Kimi Delta Attention with Variable-Length Batching and H20 Benchmarks
The group behind Kimi.ai (Moonshot AI) simply made a major contribution to the open-source AI infrastructure area. The analysis group has made a major contribution to the open-source AI infrastructure area. They launched FlashKDA (Flash Kimi Delta Attention), a high-performance CUTLASS-based kernel implementation of the Kimi Delta Attention (KDA) mechanism. The FlashKDA library is offered…
