3 Commits

Author	SHA1	Message	Date
Antoine Adam	4e38df059e	remove numpy dependency ... According to the `setup.py` file, only dependencies are torch and einops. But the `bert_padding.py` file requires `numpy` only to multiply the elements of a `torch.Size` object. This change aims at allowing the use of FlashAttention without numpy.	2022-10-06 19:17:15 +02:00
Tri Dao	6cc7342575	Support index_first_axis with more than 2 dimensions	2022-08-05 09:48:16 -07:00
Tri Dao	5a61cb7729	Rename src -> flash_attn	2022-06-01 18:50:26 -07:00