Tri Dao 78b7a1dc18 [OPT] Load fp16 weights on CPU before moving to GPU		2023-01-22 17:01:32 -08:00
..
__init__.py	Add __init__.py files to subdirectories for installation	2022-11-17 16:55:44 -08:00
benchmark.py	Move benchmark utils, support AMP	2022-10-23 12:50:00 -07:00
distributed.py	[TP] Implement TensorParallel without sequence parallel	2023-01-07 13:45:22 -08:00
generation.py	[OPT] Load fp16 weights on CPU before moving to GPU	2023-01-22 17:01:32 -08:00
pretrained.py	[OPT] Load fp16 weights on CPU before moving to GPU	2023-01-22 17:01:32 -08:00