339 B
339 B
Usage:
pretrain.sh
: do pre-train (optional)sft.sh
: do supervised fine-tuningreward.sh
: do reward modeling (must after sft.sh)ppo.sh
: do PPO training (must after sft.sh and reward.sh)dpo.sh
: do DPO training (must after sft.sh)orpo.sh
: do ORPO trainingpredict.sh
: do predict (must after sft.sh and dpo.sh)