Unsloth AI

unsloth.ai

26 March 2025 21:38

You can now Run DeepSeek-V3-0324 locally using our 1.58 & 2.51-bit Dynamic GGUF!🐋 We shrank the 720GB model to 131GB (-80%) by selectively quantizing layers for the best performance. Fixes basic quants breaking & bad output issues: www.unsloth.ai/blog/deepsee... GGUF huggingface.co/unsloth/Deep...

Unsloth AI

unsloth.ai

10 March 2025 20:48

We made a Guide to teach you how to Fine-tune LLMs correctly! Learn about: • Choosing the right parameters & training method • RL, GRPO, DPO, CPT • Data prep, Overfitting, Evaluation • Training with Unsloth & deploy on vLLM, Ollama, Open WebUI 🔗https://docs.unsloth.ai/get-started/fine-tuning-guide