squall/picotron
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

set num workers to 1 for now to avoid os memory error

Browse Source
This commit is contained in:
ferdinand.mom 2024-11-04 14:39:52 +00:00
parent e19f74b715
commit a44f905254
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
template/base_config.json
View File

@ -29,7 +29,7 @@
},
"dataset": {
"name": "roneneldan/TinyStories",
"num_workers": 4,
"num_workers": 1,
"num_proc": 4
},
"checkpoint": {