vllm/vllm/distributed
youkaichao da78caecfa
[core][distributed] zmq fallback for broadcasting large objects (#6183)
[core][distributed] add zmq fallback for broadcasting large objects (#6183)
2024-07-09 18:49:11 -07:00
..
device_communicators [core][distributed] zmq fallback for broadcasting large objects (#6183) 2024-07-09 18:49:11 -07:00
__init__.py [Core][Refactor] move parallel_utils into vllm/distributed (#3950) 2024-04-10 15:33:30 -07:00
communication_op.py [Core][Distributed] code deduplication in tp&pp with coordinator(#5293) 2024-06-12 17:27:08 -07:00
parallel_state.py [core][distributed] zmq fallback for broadcasting large objects (#6183) 2024-07-09 18:49:11 -07:00
utils.py [core][distributed] support n layers % pp size != 0 (#6115) 2024-07-03 16:40:31 -07:00