squall/flash-attention
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Merge pull request #154 from kuizhiqing/usage

Browse Source 
add paddlepaddle in usage
This commit is contained in:
Tri Dao 2023-04-04 02:54:37 -04:00 committed by GitHub
commit d478eeec8f
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
usage.md
View File

@ -27,6 +27,8 @@ PR or email us. We'd very much like to hear from you!
- EleutherAI's [GPT-NeoX](https://github.com/EleutherAI/gpt-neox/pull/725). This is a research library for training large language transformer models at scale based on NVIDIA's Megatron-LM and Microsoft's DeepSpeed.
- PaddlePaddle: integrated into the framework with [API](https://github.com/PaddlePaddle/Paddle/blob/develop/python/paddle/nn/functional/flash_attention.py) `paddle.nn.functional.flash_attention`.
## MLPerf benchmarks
[MLPerf](https://mlcommons.org/en/) is a competitive machine learning performance benchmark. FlashAttention