Edge-Inference-Benchmarks / data /acc-Gemma-3.csv
Jonna Marie Matthiesen
Add accuracy tables, RTX 3500 Ada latency, and fix 270M variant grouping
7671b7c
raw
history blame contribute delete
145 Bytes
Model,MMLU-Pro,IFEval,BBH,TruthfulQA,GSM8K
google/gemma-3-1b-it,0.15,0.55,0.38,0.31,0.42
embedl/gemma-3-1b-it-FlashHead,0.15,0.49,0.38,0.31,0.39