Vitas Ayurveda Phi-3 (Q4_K_M GGUF)

Fine-tuned Phi-3-mini on classical Ayurvedic texts for structured health guidance.

Usage

from llama_cpp import Llama

llm = Llama.from_pretrained(
    repo_id="Chaitu6969/Vitas-Ayurveda-Phi3",
    filename="ayurveda_phi3_q4km.gguf",
    n_ctx=4096,
    n_gpu_layers=-1
)

Evaluation

Metric	Score
ROUGE-1	0.4257
ROUGE-2	0.2116
ROUGE-L	0.3379
Mean PPL	9.49

Part of Vitas AI

See: https://github.com/NeelPatel06/Vitas_ai

Downloads last month: 12

GGUF

Model size

4B params

Architecture

llama

Hardware compatibility

We're not able to determine the quantization variants.

View all variants

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Chaitu6969/Vitas-Ayurveda-Phi3

Base model

microsoft/Phi-3-mini-4k-instruct

Quantized

(181)

this model