FastLlama
Collection
A Faster and Higher-performing FastLlama Series • 4 items • Updated • 4
How to use suayptalha/FastLlama-3.2-3B-LoRA with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("suayptalha/FastLlama-3.2-3B-LoRA", device_map="auto")