german-cwi-llm
Collection
9 items • Updated
How to use tschomacker/german-cwi-llm-llammlein-7b-qlora-contextualized-all-features with PEFT:
from peft import PeftModel
from transformers import AutoModelForSequenceClassification
base_model = AutoModelForSequenceClassification.from_pretrained("LSX-UniWue/LLaMmlein_7B")
model = PeftModel.from_pretrained(base_model, "tschomacker/german-cwi-llm-llammlein-7b-qlora-contextualized-all-features")How to use tschomacker/german-cwi-llm-llammlein-7b-qlora-contextualized-all-features with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("tschomacker/german-cwi-llm-llammlein-7b-qlora-contextualized-all-features", device_map="auto")See the full repository documentation: https://github.com/tschomacker/german-cwi-llm
Paper: (link will be added after publication)
Base model
LSX-UniWue/LLaMmlein_7B