# Request: Mask-LM Training Google Colab

**URL:** <https://discuss.huggingface.co/t/request-mask-lm-training-google-colab/2119>\
**Category:** Beginners\
**Created:** [November 19, 2020, 2:45am UTC](https://discuss.huggingface.co/t/request-mask-lm-training-google-colab/2119 "2020-11-19T02:45:38Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![zanderbush](https://avatars.discourse-cdn.com/v4/letter/z/13edae/32.png) [@zanderbush](https://discuss.huggingface.co/u/zanderbush)\
**Post date:** [November 19, 2020, 2:45am UTC](https://discuss.huggingface.co/t/request-mask-lm-training-google-colab/2119/1 "2020-11-19T02:45:38Z")

</div>

Does anyone have a Google Colab notebook they can share? (If possible, one that has been adapted to the new model upload)

---

<div class="post-metadata">

**Author:** ![Jung](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/jung/32/21989_2.png) [@Jung](https://discuss.huggingface.co/u/Jung)\
**Post date:** [November 19, 2020, 3:57am UTC](https://discuss.huggingface.co/t/request-mask-lm-training-google-colab/2119/2 "2020-11-19T03:57:00Z")

</div>

Hi, not exactly what you requested (ie. not the latest Huggingface version),  
but it should give the main idea with a bonus on working with TPU:

Kaggle notebook on **implementation of MLM finetuning on TPUs with a custom training loop in TensorFlow 2**.  
[https://www.kaggle.com/riblidezso/finetune-xlm-roberta-on-jigsaw-test-data-with-mlm](https://www.kaggle.com/riblidezso/finetune-xlm-roberta-on-jigsaw-test-data-with-mlm)

---

<div class="post-metadata">

**Author:** ![zanderbush](https://avatars.discourse-cdn.com/v4/letter/z/13edae/32.png) [@zanderbush](https://discuss.huggingface.co/u/zanderbush)\
**Post date:** [November 20, 2020, 2:10am UTC](https://discuss.huggingface.co/t/request-mask-lm-training-google-colab/2119/3 "2020-11-20T02:10:47Z")

</div>

Thank you!