From c5be8d3aabef5d282dc095268185c6688ee81dcd Mon Sep 17 00:00:00 2001 From: kuizhiqing Date: Tue, 4 Apr 2023 14:15:51 +0800 Subject: [PATCH] add paddlepaddle in usage --- usage.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/usage.md b/usage.md index e86197c..bde3160 100644 --- a/usage.md +++ b/usage.md @@ -27,6 +27,8 @@ PR or email us. We'd very much like to hear from you! - EleutherAI's [GPT-NeoX](https://github.com/EleutherAI/gpt-neox/pull/725). This is a research library for training large language transformer models at scale based on NVIDIA's Megatron-LM and Microsoft's DeepSpeed. +- PaddlePaddle: integrated into the framework with [API](https://github.com/PaddlePaddle/Paddle/blob/develop/python/paddle/nn/functional/flash_attention.py) `paddle.nn.functional.flash_attention`. + ## MLPerf benchmarks [MLPerf](https://mlcommons.org/en/) is a competitive machine learning performance benchmark. FlashAttention