4 Commits

Author	SHA1	Message	Date
Tri Dao	9e5e8bc91e	Change causal mask to be aligned to bottom-right instead of top-left	2023-08-24 23:41:07 -07:00
BoxiangW	e07aa036db	Support flash attention 2 with causal masking when KV's seq length is longer than Q's seq length. (#436)	2023-08-24 16:42:34 -07:00
Tri Dao	a4f148b6ab	Fix masking of bwd when seqlen is not divisible by 128	2023-07-31 17:46:34 -07:00
Tri Dao	4f285b3547	FlashAttention-2 release	2023-07-17 06:21:34 -07:00