Commit Graph

4 Commits

Author SHA1 Message Date
Ying Zhang
db80387343 Add seqused_q in fwd / bwd and seqused_k in bwd. 2024-09-16 14:24:11 -07:00
Jay Shah
32792d37ec add missing if condition for key_padding_mask in test_util.py 2024-08-19 11:17:17 -07:00
Ying Zhang
53537da422 add a unittest 2024-08-17 13:23:50 -07:00
Ying Zhang
dfe1a59e4b
Add var-seq-len to FA3 fp16 / bf16 fwd (#1072)
* fwd var-seq-len

* fixes

* benchmark

* fixes

---------

Co-authored-by: Tri Dao <tridao@users.noreply.github.com>
2024-07-22 21:32:41 -07:00