How to use nrishabh/llama3-8b-instruct-qlora-large with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("LoftQ/Meta-Llama-3-8B-Instruct-4bit-64rank") model = PeftModel.from_pretrained(base_model, "nrishabh/llama3-8b-instruct-qlora-large")
425f118 de0f7bd 425f118
1
2
3
4
version https://git-lfs.github.com/spec/v1 oid sha256:1566104477e43dbd953449afb6f0974e2c7765e1042ea8d06d2a920964a1cde5 size 5048
