Commit Graph

4 Commits

Author SHA1 Message Date
ferdinand.mom
8741c9b167 change distributed option to pass to multi-node 2024-11-02 02:18:49 +00:00
ferdinand.mom
bd6b8a0972 add hf token + fix multi-node training with torchrun args 2024-11-02 02:18:40 +00:00
ferdinand.mom
486c1763a6 add fuse adam 2024-11-02 01:38:14 +00:00
ferdinand.mom
f74bff79e0 cleaning 2024-10-30 14:58:41 +00:00