# Albert giving OOM compared to Bert

**URL:** <https://discuss.huggingface.co/t/albert-giving-oom-compared-to-bert/2769>\
**Category:** Models\
**Created:** [December 10, 2020, 1:35pm UTC](https://discuss.huggingface.co/t/albert-giving-oom-compared-to-bert/2769 "2020-12-10T13:35:04Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![hfawaz](https://avatars.discourse-cdn.com/v4/letter/h/ea666f/32.png) [@hfawaz](https://discuss.huggingface.co/u/hfawaz)\
**Post date:** [December 10, 2020, 1:35pm UTC](https://discuss.huggingface.co/t/albert-giving-oom-compared-to-bert/2769/1 "2020-12-10T13:35:04Z")

</div>

Hey,  
I am tried running on GTX 1080 (10GB) bert-base-uncased with sucess on IMDB dataset with a batch-size equal to 16 and sequence length equal to 128.  
Running albert-base-v2 with the same sequence length and same batch size is giving me Out-of-memory issues.  
Is the reason that Bert is uncased ? Is albert-base-v2 case or uncased ?
