Mistral
Mistral Nemo 12B
12B parameters
Best for
- multilingual
- long context
License terms
Mistral Nemo 12B is released under the Apache 2.0 license. Yachay has vetted it for commercial use (allowed).
No naming or attribution constraints on derivatives.
How Yachay tunes it
We default to LORA on Google Cloud Vertex AI Tuning. Yachay auto-selects the right GPU for this model — typically A100 40 GB (Spot) based on the 24 GB FP16 footprint. Hyperparameters are customisable at submit (epochs, batch size, learning rate).
Released July 18, 2024. Weights are pulled from HuggingFace at job start; expect 5–15 minutes of cold start before tuning begins.
Related models
Same family first, then nearest size across families.
Ready to fine-tune Mistral Nemo 12B?
Sign in with your Condor umbrella account — from ~$0.15 / M training tokens on production-size jobs. No upfront bond; card on file, charged at completion.