4 Commits

Author	SHA1	Message	Date
Tri Dao	19d1261025	Add back need_weights in FlashMHA	2022-08-09 10:14:10 -07:00
Tri Dao	713ea302d7	Allow headdim 128 in FlashMHA interface	2022-08-05 09:47:22 -07:00
Tri Dao	6c3a8c65af	Implement cross attention	2022-07-03 17:48:12 -07:00
Tri Dao	5a61cb7729	Rename src -> flash_attn	2022-06-01 18:50:26 -07:00