# Potential error in the documentation relating to Deberta-v2 position\_biased\_input

**URL:** <https://discuss.huggingface.co/t/potential-error-in-the-documentation-relating-to-deberta-v2-position-biased-input/78156>\
**Category:** 🤗Transformers\
**Created:** [March 19, 2024, 7:37pm UTC](https://discuss.huggingface.co/t/potential-error-in-the-documentation-relating-to-deberta-v2-position-biased-input/78156 "2024-03-19T19:37:49Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Pile-of-linear-Algeb](https://avatars.discourse-cdn.com/v4/letter/p/cc9497/32.png) [@Pile-of-linear-Algeb](https://discuss.huggingface.co/u/Pile-of-linear-Algeb)\
**Post date:** [March 19, 2024, 7:37pm UTC](https://discuss.huggingface.co/t/potential-error-in-the-documentation-relating-to-deberta-v2-position-biased-input/78156/1 "2024-03-19T19:37:49Z")

</div>

Hope this is the right place to ask about this. In the documentation it says that the default value for **position\_biased\_input** in deberta-v2 is False but in the source above it says that the default value is True.

 ![issue](https://us1.discourse-cdn.com/hellohellohello/original/3X/f/b/fbc7d4bc9b9578da5014faccede5062779e9ef82.png)  
I could of course be wrong here but I thought it was better to raise this issue

---

<div class="post-metadata">

**Author:** ![nielsr](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/nielsr/32/39617_2.png) [@nielsr](https://discuss.huggingface.co/u/nielsr)\
**Post date:** [March 20, 2024, 8:13am UTC](https://discuss.huggingface.co/t/potential-error-in-the-documentation-relating-to-deberta-v2-position-biased-input/78156/2 "2024-03-20T08:13:22Z")

</div>

Hi,

That’s indeed a bug, could you open an issue on Github?

---

<div class="post-metadata">

**Author:** ![Pile-of-linear-Algeb](https://avatars.discourse-cdn.com/v4/letter/p/cc9497/32.png) [@Pile-of-linear-Algeb](https://discuss.huggingface.co/u/Pile-of-linear-Algeb)\
**Post date:** [March 20, 2024, 12:03pm UTC](https://discuss.huggingface.co/t/potential-error-in-the-documentation-relating-to-deberta-v2-position-biased-input/78156/3 "2024-03-20T12:03:49Z")

</div>

Will do, actually I have found an additional issue with the position\_biased\_input. IDK if it is the intended behaviour but setting this to true adds a position embedding layer and therefore a max length for the input. However the tokenizer does not change which could lead to issues
