squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
c45f3c3ab6
vllm/cacheflow/parallel_utils/README.md
Zhuohan Li 2f49f15585
Support tensor parallel (#2)
2023-03-21 13:45:42 -07:00

1 line
169 B
Markdown
Raw Blame History

The files in this folder are ported from [Megatron-LM](https://github.com/NVIDIA/Megatron-LM/tree/main/megatron/core). We only keep the codes that are used in inference.
Reference in New Issue View Git Blame Copy Permalink