picotron/requirements.txt

torch==2.1.0
triton==2.1.0
numpy==1.26.4
datasets==2.19.1
transformers==4.41.1
flash-attn==2.5.0
wandb
fix requirements to avoid drop in throughput 2024-11-04 22:33:07 +08:00			`torch==2.1.0`
breaking: socketStartConnect: Connect to <ip address> failed : Software caused connection abort 2024-09-24 05:14:48 +08:00			`triton==2.1.0`
			`numpy==1.26.4`
			`datasets==2.19.1`
			`transformers==4.41.1`
fix requirements to avoid drop in throughput 2024-11-04 22:33:07 +08:00			`flash-attn==2.5.0`
add wandb support 2024-09-25 22:19:16 +08:00			`wandb`