Closed
Description
Reminder
- I have read the README and searched the existing issues.
System Info
Latest branch. It is affected by this commit:
dabad55#diff-bddef399f9575dd690ff2e4a91ae1bcfba5614eaaac63f139fe1ed2d988ad90cR348
Reproduction
model
model_name_or_path: meta-llama/Meta-Llama-3.1-8B-Instruct/
adapter_name_or_path: saves/distill/sft
template: llama3
finetuning_type: lora
export
export_dir: models/distill
export_size: 2
export_device: cuda
export_legacy_format: false
Expected behavior
It should correctly export the model using the template.
Others
No response
Activity