4 Commits

Author	SHA1	Message	Date
Ying Zhang	db80387343	Add seqused_q in fwd / bwd and seqused_k in bwd.	2024-09-16 14:24:11 -07:00
Jay Shah	32792d37ec	add missing if condition for key_padding_mask in test_util.py	2024-08-19 11:17:17 -07:00
Ying Zhang	53537da422	add a unittest	2024-08-17 13:23:50 -07:00
Ying Zhang	dfe1a59e4b	Add var-seq-len to FA3 fp16 / bf16 fwd (#1072) ... * fwd var-seq-len * fixes * benchmark * fixes --------- Co-authored-by: Tri Dao <tridao@users.noreply.github.com>	2024-07-22 21:32:41 -07:00