squall/flash-attention
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2c7d7b7396
flash-attention/tests
History
Tri Dao 2c7d7b7396 Implement norm head for Baichuan2
2023-12-22 16:55:40 -08:00
..
layers Run isort and black on test files 2023-08-18 20:59:35 -07:00
losses [CrossEntropy] Test longer sequences 2023-12-16 19:11:23 -08:00
models Implement norm head for Baichuan2 2023-12-22 16:55:40 -08:00
modules Run isort and black on test files 2023-08-18 20:59:35 -07:00
ops [LayerNorm] Implement dropout in fused residual + LN/RMSNorm 2023-12-19 16:26:07 -08:00
pyproject.toml Move pyproject.toml to flash-attn and tests dir to avoid PEP 517 2023-08-25 15:05:28 -07:00
test_flash_attn.py Clean up alibi, implement non-causal alibi 2023-12-21 22:27:40 -08:00
test_rotary.py [Rotary] Implement varlen rotary 2023-09-03 17:57:10 -07:00