flash-attention/examples/inference/README.md

4 lines
115 B
Markdown
Raw Normal View History

2023-09-22 17:31:00 +08:00
# Example of LLM inference using FlashAttention
Example script of using FlashAttention for inference coming soon.