Hugging Face's logo

Andrija
/
SRoBERTa-L

Fill-Mask
Transformers
PyTorch
Croatian
Serbian
multilingual
roberta
masked-lm
Model card Files
xet
 Community
2
How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("fill-mask", model="Andrija/SRoBERTa-L")
# Load model directly
from transformers import AutoTokenizer, AutoModelForMaskedLM

tokenizer = AutoTokenizer.from_pretrained("Andrija/SRoBERTa-L")
model = AutoModelForMaskedLM.from_pretrained("Andrija/SRoBERTa-L", device_map="auto")
Quick Links

Transformer language model for Croatian and Serbian

Trained on 6GB datasets that contain Croatian and Serbian language for two epochs (500k steps). Leipzig, OSCAR and srWac datasets

Model #params Arch. Training data
Andrija/SRoBERTa-L 80M Third Leipzig Corpus, OSCAR and srWac (6 GB of text)
Downloads last month
21
Inference Providers NEW
Fill-Mask
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Datasets used to train Andrija/SRoBERTa-L