squall/flash-attention
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1b9facacc3
flash-attention/csrc/flash_attn/src
History
Tri Dao 5badfb7848 Implement attention kernel that splits the batch into two
2022-10-13 20:49:02 -07:00
..
fmha Implement for bf16 2022-07-09 23:31:56 -07:00
.DS_Store Rename, add benchmarking script 2022-05-26 13:57:38 -07:00
fmha_block_dgrad_fp16_kernel_loop.sm80.cu Implement cross attention 2022-07-03 17:48:12 -07:00
fmha_block_dgrad_kernel_1xN_loop.h Refactor gemm_cl to template on either __half or __nv_bfloat16 2022-07-09 23:18:26 -07:00
fmha_block_fprop_fp16_kernel.sm80.cu Implement cross attention 2022-07-03 17:48:12 -07:00
fmha_block_fprop_kernel_1xN.h Refactor gemm_cl to template on either __half or __nv_bfloat16 2022-07-09 23:18:26 -07:00
fmha_blockmask.h Implement cross attention 2022-07-03 17:48:12 -07:00
fmha_dgrad_fp16_kernel_loop.sm80.cu Replace BOOL_SWITCH with FP16_SWITCH to work around MSVC bug with constexpr variables and templates 2022-10-04 21:31:39 -04:00
fmha_dgrad_kernel_1xN_loop.h Implement for bf16 2022-07-09 23:31:56 -07:00
fmha_fprop_fp16_kernel.sm80.cu Replace BOOL_SWITCH with FP16_SWITCH to work around MSVC bug with constexpr variables and templates 2022-10-04 21:31:39 -04:00
fmha_fprop_kernel_1xN.h Implement attention kernel that splits the batch into two 2022-10-13 20:49:02 -07:00
fmha_kernel.h Implement cross attention 2022-07-03 17:48:12 -07:00
fmha_utils.h Implement for bf16 2022-07-09 23:31:56 -07:00
fmha.h Implement attention kernel that splits the batch into two 2022-10-13 20:49:02 -07:00
fp16_switch.h Fixed switch statement, thanks @yocabon 2022-10-04 21:31:39 -04:00
philox.cuh Rename, add benchmarking script 2022-05-26 13:57:38 -07:00
static_switch.h Implement attention kernel that splits the batch into two 2022-10-13 20:49:02 -07:00