5 Commits

Author	SHA1	Message	Date
Tri Dao	3aae9c18c1	Revert "Changes For FP8 (#1075)" ... This reverts commit 1899c970c8.	2024-07-25 01:28:44 -07:00
ganeshcolfax	1899c970c8	Changes For FP8 (#1075) ... * adding files for fp8 changes. * removed contiguous check. * enable all tests except odd-seq-lengths, where it crashes now. * undid clang formatting. * change to correct tile size for headdim=128. * fixed odd-seq-len-k. * minor formatting. * minor reformatting. --------- Co-authored-by: Tri Dao <tridao@users.noreply.github.com>	2024-07-23 13:51:14 -07:00
janEbert	3c4053b75c	Make FA3 externally importable (#1053) ... Library name to import is `flash_attn_interface`, which matches the test.	2024-07-22 21:34:56 -07:00
Tri Dao	74b0761ff7	[FA3] BF16 forward	2024-07-14 23:39:46 -07:00
Tri Dao	7f67966cc7	FA3 initial code release	2024-07-11 09:53:36 -07:00