From d2a69a55e26061c224857f9d91d86356e69f4dca Mon Sep 17 00:00:00 2001 From: Quentin Anthony Date: Wed, 28 Dec 2022 18:33:58 -0500 Subject: [PATCH] Add gpt-neox adoption --- usage.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/usage.md b/usage.md index 0d9c052..e86197c 100644 --- a/usage.md +++ b/usage.md @@ -24,6 +24,8 @@ PR or email us. We'd very much like to hear from you! - MosaicML [Composer](https://github.com/mosaicml/composer) [library](https://www.mosaicml.com/blog/gpt-3-quality-for-500k). Composer is a library for efficient neural network training. + +- EleutherAI's [GPT-NeoX](https://github.com/EleutherAI/gpt-neox/pull/725). This is a research library for training large language transformer models at scale based on NVIDIA's Megatron-LM and Microsoft's DeepSpeed. ## MLPerf benchmarks