Files
LLM-from-scratch/utils/dolly_pretrain_deepspeed.sh
T
2025-05-19 11:51:33 +08:00

2 lines
154 B
Bash

deepspeed --num_gpus=4 --master_port=12345 pretrain_transformers.py
# deepspeed --include="localhost:1,2,3" --master_port=12345 pretrain_transformers.py