4 Commits

Author	SHA1	Message	Date
ferdinand.mom	8c155f47ce	all reduce gradient across DP & CP ranks	2024-09-26 14:00:06 +00:00
ferdinand.mom	31b5fb9efc	ugly ass display of grid (to be changed)	2024-09-26 13:45:53 +00:00
ferdinand.mom	cfbf6c170e	every rank has now the loss	2024-09-25 14:12:31 +00:00
ferdinand.mom	b2e276d3b8	rename parallel_context to process_group_manager	2024-09-25 13:33:20 +00:00