flash-attention/examples/inference/README.md
2023-10-12 10:14:58 -07:00

4 lines
115 B
Markdown

# Example of LLM inference using FlashAttention
Example script of using FlashAttention for inference coming soon.