LLaMA-Factory/examples/merge_lora/llama3_gptq.yaml

12 lines
262 B
YAML
Raw Normal View History

2024-05-16 17:02:00 +00:00
### model
2024-05-06 13:47:00 +00:00
model_name_or_path: meta-llama/Meta-Llama-3-8B-Instruct
template: llama3
2024-05-16 17:02:00 +00:00
### export
2024-05-06 13:47:00 +00:00
export_dir: models/llama3_gptq
export_quantization_bit: 4
export_quantization_dataset: data/c4_demo.json
export_size: 2
export_device: cpu
export_legacy_format: false