Tri Dao
|
ccbb14f38e
|
Implement rotary embedding in flash_attn_with_kvcache
|
2023-09-16 01:20:16 -07:00 |
|
Tri Dao
|
5953c4f58c
|
Remove unused sdPsum in dot_do_o function
|
2023-09-03 20:44:07 -07:00 |
|
Sophia Wisdom
|
37e32febba
|
Remove commented out code in bwd (#512)
* Remove lots of comments
* Remove unused traits
|
2023-09-01 16:43:58 -07:00 |
|
Tri Dao
|
b1fbbd8337
|
Implement splitKV attention
|
2023-08-29 00:58:29 -07:00 |
|
Tri Dao
|
dbd7923782
|
Prepare for Cutlass 3.2
|
2023-08-13 15:24:32 -07:00 |
|
Tri Dao
|
4f285b3547
|
FlashAttention-2 release
|
2023-07-17 06:21:34 -07:00 |
|