squall/flash-attention
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
main
flash-attention/examples/inference
History
Tri Dao 02ac572f3f Clarify inference README is a placeholder
2023-10-12 10:14:58 -07:00
..
README.md Clarify inference README is a placeholder 2023-10-12 10:14:58 -07:00

README.md

Example of LLM inference using FlashAttention

Example script of using FlashAttention for inference coming soon.