Tri Dao
|
10dad61277
|
apply_dropout now takes tensor of rowcol layout
|
2024-01-14 01:03:23 -08:00 |
|
Tri Dao
|
8d1b169ed1
|
Simplify SmemLayoutVtransposed in kernel_traits.h
|
2024-01-12 11:53:29 -08:00 |
|
Tri Dao
|
ccbb14f38e
|
Implement rotary embedding in flash_attn_with_kvcache
|
2023-09-16 01:20:16 -07:00 |
|
Tri Dao
|
37c6e05406
|
Implement flash_attn_with_kvcache
|
2023-09-04 00:11:44 -07:00 |
|
Sophia Wisdom
|
dd8a754915
|
Remove old code in utils.h (#511)
|
2023-09-01 15:32:09 -07:00 |
|
Tri Dao
|
dbd7923782
|
Prepare for Cutlass 3.2
|
2023-08-13 15:24:32 -07:00 |
|
Tri Dao
|
3524e13c11
|
Update to Cutlass 3.1
|
2023-08-13 13:53:17 -07:00 |
|
Tri Dao
|
4f285b3547
|
FlashAttention-2 release
|
2023-07-17 06:21:34 -07:00 |
|