# Problem in deploying on hugging face hub

**URL:** <https://discuss.huggingface.co/t/problem-in-deploying-on-hugging-face-hub/67156>\
**Category:** Models\
**Created:** [December 27, 2023, 10:53am UTC](https://discuss.huggingface.co/t/problem-in-deploying-on-hugging-face-hub/67156 "2023-12-27T10:53:44Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![alinankali](https://avatars.discourse-cdn.com/v4/letter/a/cab0a1/32.png) [@alinankali](https://discuss.huggingface.co/u/alinankali)\
**Post date:** [December 27, 2023, 10:53am UTC](https://discuss.huggingface.co/t/problem-in-deploying-on-hugging-face-hub/67156/1 "2023-12-27T10:53:44Z")

</div>

Hi!  
I fine-tuned nllb model on my data using Lora.  
but after uploading it on hugging face hub, I couldn’t deploy it and hugging face is not showing any deploy button for me.  
these are the files in my model that I uploaded.  
Can someone help me with this issue?

 ![Screenshot (240)](https://us1.discourse-cdn.com/hellohellohello/original/3X/3/f/3f17d6617638d604fc8c7ee64c1790129daabd5c.png)

---

<div class="post-metadata">

**Author:** ![nielsr](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/nielsr/32/39617_2.png) [@nielsr](https://discuss.huggingface.co/u/nielsr)\
**Post date:** [December 27, 2023, 11:54am UTC](https://discuss.huggingface.co/t/problem-in-deploying-on-hugging-face-hub/67156/2 "2023-12-27T11:54:28Z")

</div>

Hi,

It looks like the repository contains the adapter weights.

To load the entire model (base model with adapter weights), you can use the `AutoPeftModelForSeq2Seq` class:

```auto
from peft import AutoPeftModelForSeq2SeqLM

base_model_id = "facebook/nllb-200-distilled-600M"
adapter_model_id = "your-adapter-repo"

peft_model = AutoPeftModelForSeq2SeqLM.from_pretrained(base_model_id, adapter_model_id)

# now you can call the merge_and_unload method which returns a regular NLLB model which you can use for inference
model = peft_model.merge_and_unload()

```

---

<div class="post-metadata">

**Author:** ![alinankali](https://avatars.discourse-cdn.com/v4/letter/a/cab0a1/32.png) [@alinankali](https://discuss.huggingface.co/u/alinankali)\
**Post date:** [January 1, 2024, 8:07am UTC](https://discuss.huggingface.co/t/problem-in-deploying-on-hugging-face-hub/67156/3 "2024-01-01T08:07:24Z")

</div>

I got this error. my base model is nllb 3.3:  
During handling of the above exception, another exception occurred:

Traceback (most recent call last):  
File “/home/ali/veirtual\_env/mahdi.py”, line 6, in   
peft\_model = AutoPeftModelForSeq2SeqLM.from\_pretrained(base\_model\_id, adapter\_model\_id)  
File “/home/ali/checkpoint/model-training/vnev/lib/python3.10/site-packages/peft/auto.py”, line 69, in from\_pretrained  
peft\_config = PeftConfig.from\_pretrained(pretrained\_model\_name\_or\_path, \*\*kwargs)  
File “/home/ali/checkpoint/model-training/vnev/lib/python3.10/site-packages/peft/config.py”, line 109, in from\_pretrained  
raise ValueError(f"Can’t find ‘{CONFIG\_NAME}’ at ‘{pretrained\_model\_name\_or\_path}’")  
ValueError: Can’t find ‘adapter\_config.json’ at ‘facebook/nllb-200-3.3B’

---

<div class="post-metadata">

**Author:** ![E27085921](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/e27085921/32/28834_2.png) [@E27085921](https://discuss.huggingface.co/u/E27085921)\
**Post date:** [June 30, 2024, 8:10am UTC](https://discuss.huggingface.co/t/problem-in-deploying-on-hugging-face-hub/67156/4 "2024-06-30T08:10:41Z")

</div>

Hi, is this problem already fixed? I have the same problem.
