# How to use custom positional embedding while fine tuning Bert

**URL:** <https://discuss.huggingface.co/t/how-to-use-custom-positional-embedding-while-fine-tuning-bert/7992>\
**Category:** Beginners\
**Created:** [July 4, 2021, 9:54am UTC](https://discuss.huggingface.co/t/how-to-use-custom-positional-embedding-while-fine-tuning-bert/7992 "2021-07-04T09:54:41Z")\
**Posts on this page:** 1\
**Showing post:** 3

<div class="post-metadata">

**Author:** ![TimShieh](https://avatars.discourse-cdn.com/v4/letter/t/7feea3/32.png) [@TimShieh](https://discuss.huggingface.co/u/TimShieh)\
**Post date:** [September 14, 2022, 12:53pm UTC](https://discuss.huggingface.co/t/how-to-use-custom-positional-embedding-while-fine-tuning-bert/7992/3 "2022-09-14T12:53:07Z")

</div>

All you need is change BertEmbeddings class, you can build a new class and inherit BertEmbeddings.  
You can follow the post.(I wrote the solution in it.)

> [@How to use additional input features for NER?](https://discuss.huggingface.co/t/how-to-use-additional-input-features-for-ner/4364/26):
>
> Hi f3n1Xx, I’m still stuck at the same problem and it’s also for a biological problem. There is no code in the link you provided. Would you mind posting here how you added additional features. If you can’t release the entire code could you just show a simplified example please? Thank you!

---

_[View the full topic](https://discuss.huggingface.co/t/how-to-use-custom-positional-embedding-while-fine-tuning-bert/7992)._