Edge-Inference-Benchmarks / data /acc-Llama-3.2.csv
Jonna Marie Matthiesen
Add accuracy tables, RTX 3500 Ada latency, and fix 270M variant grouping
7671b7c
raw
history blame contribute delete
327 Bytes
Model,MMLU-Pro,HellaSwag,IFEval,BoolQ,BBH,TruthfulQA,GSM8K
meta-llama/Llama-3.2-1B-Instruct,0.18,0.59,0.45,0.69,0.38,0.36,0.46
embedl/Llama-3.2-1B-Instruct-FlashHead,0.18,0.59,0.45,0.69,0.38,0.36,0.46
meta-llama/Llama-3.2-3B-Instruct,0.31,,0.57,,0.57,0.57,0.77
embedl/Llama-3.2-3B-Instruct-FlashHead,0.31,,0.56,,0.57,0.58,0.77