Commit Graph

5 Commits

Author SHA1 Message Date
ferdinand.mom
86c9b91d02 Revert to @zzhhjjj class naming as it is more expressive 2024-12-17 15:55:18 +00:00
ferdinand.mom
859650a2c0 breaking: refactor loading big model to only download safetensors files 2024-12-17 15:46:09 +00:00
Haojun Zhao
55efb321f9
Merge pull request #9 from huggingface/async_tp
Async tp
2024-12-14 07:24:35 -05:00
zzhhjjj
481eeb8377 stop iteration fix. recreate a new dataloder 2024-12-13 13:29:11 +00:00
zzhhjjj
2d6d9fb6b1 async TP + test 2024-11-20 01:55:02 +00:00