Thanks for the quants
#1
by Retreatcost - opened
Thx for your efforts doing the quants, but this model is not for regular user consumption.
It will output essentially the same thing as regular Mistral Nemo Base (just autocomplete, without any assistant capabilities).
I don't recommend using it (besides experiments probably). That's why I made it gated - to prevent automatic quants.
I'm currently training a model on this base (a real finetune, custom dataset), probably going to release an alpha version soon.
Hello!
Noted. I did expect that, but made the quant anyway - just in case someone wants to test it in ExLlamaV3 for whatever reason :)
Looking forward to seeing the new fine-tune!