squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
e331957784
vllm/cacheflow/model_executor/parallel_utils
History
Woosuk Kwon 7c041ab578
Refactor system architecture (#82)
2023-05-09 15:30:12 -07:00
..
tensor_parallel Refactor system architecture (#82) 2023-05-09 15:30:12 -07:00
__init__.py Refactor system architecture (#82) 2023-05-09 15:30:12 -07:00
parallel_state.py Refactor system architecture (#82) 2023-05-09 15:30:12 -07:00
README.md Refactor system architecture (#82) 2023-05-09 15:30:12 -07:00
utils.py Refactor system architecture (#82) 2023-05-09 15:30:12 -07:00

README.md

The files in this folder are ported from Megatron-LM. We only keep the codes that are used in inference.