# Error: ‘AlbertModel’ object has no attribute ‘bias’

**URL:** <https://discuss.huggingface.co/t/error-albertmodel-object-has-no-attribute-bias/9266>\
**Category:** 🤗Transformers\
**Created:** [August 16, 2021, 12:10pm UTC](https://discuss.huggingface.co/t/error-albertmodel-object-has-no-attribute-bias/9266 "2021-08-16T12:10:20Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Che](https://avatars.discourse-cdn.com/v4/letter/c/d78d45/32.png) [@Che](https://discuss.huggingface.co/u/Che)\
**Post date:** [August 16, 2021, 12:10pm UTC](https://discuss.huggingface.co/t/error-albertmodel-object-has-no-attribute-bias/9266/1 "2021-08-16T12:10:20Z")

</div>

simply trying to extract use a an albert model pretrained on custom vocab:

I get the error - **‘AlbertModel’ object has no attribute ‘bias’** can someone provide some guidance I am using transformers 4.9.2?

ptcfg = AlbertConfig.from\_json\_file(prt\_config)  
modelprt = Albertmodel(ptcfg)  
modelprt = load\_tf\_weights\_in\_albert(modelprt, self.ptcfg, prot\_model)