# Using Tokenizer for integer data

**URL:** <https://discuss.huggingface.co/t/using-tokenizer-for-integer-data/28835>\
**Category:** 🤗Tokenizers\
**Created:** [January 3, 2023, 10:42am UTC](https://discuss.huggingface.co/t/using-tokenizer-for-integer-data/28835 "2023-01-03T10:42:20Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![HasnainKhan](https://avatars.discourse-cdn.com/v4/letter/h/e79b87/32.png) [@HasnainKhan](https://discuss.huggingface.co/u/HasnainKhan)\
**Post date:** [January 3, 2023, 10:42am UTC](https://discuss.huggingface.co/t/using-tokenizer-for-integer-data/28835/1 "2023-01-03T10:42:20Z")

</div>

Hey guys, I am working on a problem where I am having tabular data having more than 90 features and one target and all the features are in integers (continuous). I want to use pre-trained BERT, GPT2 but when it comes to the tokenizer the tokenizer is expecting the input in the text format. I can change the integer data in the text format like this;

original\_data = [1,2,3,4,5,…,94]  
transformed\_data = [“1 2 3 4 5 …94”]

Now if I pass the transformed\_data to the tokenizer then surely it will work but I wanna know if someone tried to use transformers for this purpose and if yes, then what was the outcome, and how did the results look like?