|
src
|
support bf16, all reduce loss
|
2024-10-22 23:38:44 +00:00 |
|
.gitignore
|
tesnsor parallel, will clean later
|
2024-10-18 05:13:44 +00:00 |
|
convert_picotron_to_hf.py
|
refactor organisation
|
2024-10-10 15:12:14 +00:00 |
|
generate.py
|
various fix (modeling, dataloader, cpu load)
|
2024-10-18 14:33:46 +00:00 |
|
model.py
|
add cuda kernels
|
2024-10-22 22:38:29 +00:00 |
|
README.md
|
Initial commit
|
2024-09-18 14:01:22 +02:00 |
|
requirements.txt
|
add wandb support
|
2024-09-25 14:19:16 +00:00 |
|
setup.py
|
tesnsor parallel, will clean later
|
2024-10-18 05:13:44 +00:00 |
|
train.py
|
support bf16, all reduce loss
|
2024-10-22 23:38:44 +00:00 |
|
utils.py
|
add DDP
|
2024-10-16 16:48:55 +00:00 |
