Back to products
Unsloth

Unsloth

Finetune LLMs 2x faster, 80% less memory

Overview

What it is

Open-source running and training of AI models and LLMs.

Intent

I need it when

Integrate local LLMs into coding tools and AI agents without relying on cloud APIs

Unsloth exposes OpenAI-compatible and Anthropic-compatible API endpoints. Users can connect local models to Claude Code, OpenCode, Cursor, Continue, and other tools via authenticated API keys, enabling agentic workflows with self-healing tool calling and code execution.

Deploy and monitor fine-tuned models with real-time observability and version control

Unsloth Studio provides live training observability (loss, gradient norms, GPU utilization), stores training history for experiment replay, and enables model export to multiple formats. Users can revisit runs, re-export, and experiment iteratively without losing progress.

Transform unstructured documents into training datasets for domain-specific model customization

Unsloth Data Recipes (powered by NVIDIA Nemo Data Designer) auto-converts PDFs, CSV, JSON, DOCX into usable datasets via visual node workflow. Users can clean, refine, and expand data before training, reducing manual data preparation time.

Fine-tune open-source LLMs on local hardware without cloud costs or data privacy concerns

Unsloth enables 2x faster training with 70% less VRAM on 500+ models (text, vision, audio, embeddings) via no-code UI. Users upload PDFs/CSV/JSON, auto-create datasets, train locally on NVIDIA/Mac/Intel GPUs, and export to GGUF or safetensors—all offline and private.

Run and compare multiple open-source models locally for inference and experimentation

Unsloth Studio's Model Arena lets users load GGUF and safetensor models, run them side-by-side, and compare outputs. Supports 500+ models with tool calling, web search, code execution, and automatic inference tuning—all 100% offline on Mac, Windows, or Linux.

Drop

Not a fit when

  • User requires cloud-hosted inference without local hardware setup; Unsloth is designed for local-only operation on user's own devices
  • User needs proprietary closed-source model training; Unsloth is open-source and Apache 2.0 / AGPL-3.0 licensed
  • User has AMD GPU and needs training support; AMD training support is not yet available (chat inference only, with Unsloth Core workaround)
  • User requires enterprise SLA and support without contacting sales; Pro and Enterprise tiers require direct contact with no published SLAs
  • User works exclusively with proprietary APIs like OpenAI; Unsloth focuses on open models (Qwen, Gemma, Llama, Mistral, etc.)
  • User needs real-time collaborative multi-user training on shared infrastructure; Unsloth Studio is single-user local-only
Commercials

Pricing

Freemium: Free open-source version with core features. Pro tier (2.5x faster training, 20% less VRAM, enhanced multi-GPU) and Enterprise tier (30x faster training, multi-node support, 30% accuracy improvement, 5x faster inference) available by contact. View pricing