squall/flash-attention
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
02ac572f3f
flash-attention/examples/inference/README.md
Tri Dao 02ac572f3f Clarify inference README is a placeholder
2023-10-12 10:14:58 -07:00

115 B
Raw Blame History

Example of LLM inference using FlashAttention

Example script of using FlashAttention for inference coming soon.