4 Commits

Author	SHA1	Message	Date
Zhuohan Li	fd4ea8ef5c	Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221)	2024-01-03 11:30:22 -08:00
Woosuk Kwon	cd3aa153a4	Fix broken worker test (#1900)	2023-12-02 22:17:33 -08:00
Simon Mo	5ffc0d13a2	Migrate linter from pylint to ruff (#1665)	2023-11-20 11:58:01 -08:00
Yanming W	8efe23f150	Fix input_metadata.selected_token_indices in worker prepare_inputs (#1546)	2023-11-08 14:19:12 -08:00