SpanBERT Fine-Tuned on SQuAD v1.1

This model is a fine-tuned SpanBERT base for extractive question answering on the SQuAD v1.1 dataset. It was trained using the Hugging Face Trainer API with the following key hyperparameters:

  • Learning rate: 3e-5
  • Batch size: 8
  • Warmup ratio: 0.1
  • Weight decay: 0.01
  • Epochs: 2

Evaluation Results (SQuAD v1.1 Dev)

Using v1.1 dev dataset with official evaluation script, this is not uploaded to test on hidden testset.

Metric Score
Exact Match (EM) 83.47
F1 Score 90.70
Total Samples 10,570
Downloads last month
5
Safetensors
Model size
0.1B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for justinlengch/spanbert-squad1-finetuned

Finetuned
(7)
this model

Dataset used to train justinlengch/spanbert-squad1-finetuned