Commit Graph

724 Commits

Author SHA1 Message Date
hiyouga 7e8655c8b5 fix error info 2023-09-19 18:30:23 +08:00
hiyouga 469f859161 add tests.cal_flops.py 2023-09-16 23:40:41 +08:00
hiyouga acda45e463 update readme 2023-09-16 17:33:01 +08:00
hiyouga 0b5f970c05 fix #913 2023-09-15 20:58:28 +08:00
hiyouga 8632bff811 fix #896 2023-09-14 18:37:34 +08:00
hiyouga 8857e45602 fix #887 2023-09-14 17:56:58 +08:00
hoshi-hiyouga 3202985087
Merge pull request #900 from mmbwf/main
Fix PPO replace_model loading wrong default parameters.
2023-09-14 17:34:22 +08:00
hiyouga bd4e24bfee Update wechat.jpg 2023-09-14 16:31:11 +08:00
mmbwf 30fb721f12
Update utils.py
Fix parameters load error.
2023-09-14 15:38:04 +08:00
hiyouga 026af87e7f add MathInstruct dataset 2023-09-13 22:30:14 +08:00
hiyouga 7ba57d5b14 fix ppo save model 2023-09-12 16:25:29 +08:00
hiyouga d4be857e23 fix #762 #814 2023-09-12 16:10:10 +08:00
hiyouga 3b306478d4 tiny fix 2023-09-11 18:27:08 +08:00
hiyouga ccb3553576 Release v0.1.8 2023-09-11 17:31:34 +08:00
hiyouga 0fbece85a7 update flashattn, fix ppo save model 2023-09-11 17:25:36 +08:00
hiyouga b218c271ed remove PeftTrainer 2023-09-10 22:23:23 +08:00
hiyouga baac22f4f4 truncate readme 2023-09-10 21:04:20 +08:00
hiyouga 63611de7ae update readme 2023-09-10 21:01:20 +08:00
hiyouga 34005252df update readme 2023-09-10 20:52:21 +08:00
hiyouga d8aa1404be support FlashAttention2 2023-09-10 20:43:56 +08:00
hiyouga 815b92e698 fix #850 2023-09-10 14:22:03 +08:00
hiyouga a51b7c98ac fix lora target 2023-09-09 17:04:45 +08:00
hiyouga bca1a247bc support lora target auto find 2023-09-09 15:38:37 +08:00
hiyouga d8d82ca281 fix chatglm2 tokenizer 2023-09-09 13:50:29 +08:00
hiyouga d2015c8e12 add baichuan2 convert script 2023-09-08 22:59:41 +08:00
hiyouga 90bd085ae4 fix bug in DPO data collator 2023-09-08 20:45:07 +08:00
hiyouga b34797a845 fix #761 2023-09-08 20:22:18 +08:00
hiyouga 8ea32e4046 change to right-padding, update reward score #803 2023-09-08 20:04:31 +08:00
hiyouga 8aaaa132d4 fix chatglm template 2023-09-08 14:45:58 +08:00
hiyouga 8b66247d2f Update wechat.jpg 2023-09-07 20:56:07 +08:00
hiyouga f5351c18e1 update requirements 2023-09-07 19:26:25 +08:00
hiyouga 5a9970dbef fix #818 2023-09-07 19:19:53 +08:00
hiyouga ed1c2c5557 add deepspeed check in PPO training 2023-09-07 19:12:40 +08:00
hiyouga e2bf7c3bad fix #809 2023-09-07 19:04:32 +08:00
hiyouga 85b1f6632a fix baichuan templates 2023-09-07 18:54:14 +08:00
hiyouga 0531886e1f update baichuan2 template 2023-09-06 21:43:06 +08:00
hiyouga 60603a94c6 add Baichuan2 models 2023-09-06 18:40:11 +08:00
hiyouga 62ce65c628 add Baichuan2 models 2023-09-06 18:36:04 +08:00
hoshi-hiyouga 9224db90ea
Merge pull request #786 from kinghuin/patch-1
fix utils.py bug
2023-09-05 10:49:34 +08:00
Q a19fc2ebf7
fix utils.py bug 2023-09-05 10:38:01 +08:00
hiyouga 370bdb6e43 fix #763 2023-09-01 23:13:05 +08:00
hiyouga a9d1fb72f7 refactor dataset_attr, add eos in pt, fix #757 2023-09-01 19:00:45 +08:00
hiyouga cf106e9d65 Update wechat.jpg 2023-09-01 15:02:23 +08:00
codingma 701a9d60cb
Merge pull request #741 from hiyouga/feature-addDatasetCheck
Feature add dataset check
2023-08-31 20:57:36 +08:00
codemayq 0bcc489c42 update llama2 template 2023-08-30 16:23:56 +08:00
codemayq f7fdc088d4 add dataset stage check 2023-08-30 16:23:08 +08:00
codingma 9b4d16d040
Merge pull request #651 from hiyouga/feature-dataset_stage
add dataset stage
2023-08-28 16:03:45 +08:00
codingma 01dfba85b4
Merge pull request #678 from hiyouga/feature-txt_preview
add text format dataset preview in webui
2023-08-28 16:03:02 +08:00
codemayq 604f85487b add ad gen dataset 2023-08-27 20:35:32 +08:00
hiyouga 15cec650c7 Update wechat.jpg 2023-08-27 01:21:31 +08:00