squall/flash-attention
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
96d10f6545
flash-attention/tests/models
History
Tri Dao 96d10f6545 Implement LLaMa
2023-04-18 21:51:35 -07:00
..
test_bert.py [FusedDense] Support relu, rename FusedDenseGeluDense -> FusedMLP 2023-01-17 18:12:27 -08:00
test_gpt_generation_parallel.py Implement GPT-J 2023-03-22 16:16:58 -07:00
test_gpt_generation.py [FT] Fix FT's single query attention for bf16 hdim128 rotary 2023-03-28 21:27:00 -07:00
test_gpt_neox.py Implement LLaMa 2023-04-18 21:51:35 -07:00
test_gpt_parallel.py [FusedDense] Support relu, rename FusedDenseGeluDense -> FusedMLP 2023-01-17 18:12:27 -08:00
test_gpt.py Implement GPT-J 2023-03-22 16:16:58 -07:00
test_gptj.py Implement LLaMa 2023-04-18 21:51:35 -07:00
test_llama.py Implement LLaMa 2023-04-18 21:51:35 -07:00
test_opt.py Implement GPT-J 2023-03-22 16:16:58 -07:00
test_vit.py [FusedDense] Support relu, rename FusedDenseGeluDense -> FusedMLP 2023-01-17 18:12:27 -08:00