WizardLM 13B: Evol-Instruct Model
Technical review of WizardLM 13B -- the model that pioneered Evol-Instruct training. Real benchmarks from the Open LLM Leaderboard, VRAM requirements, and honest 2026 assessment.
Technical Specifications Overview
ollama run wizardlm:13b-llama2-q4_0WizardLM 13B Evol-Instruct Architecture
WizardLM 13B architecture showing Evol-Instruct training pipeline: base LLaMA model fine-tuned with evolved instructions for improved instruction-following
Evol-Instruct: The Training Innovation Behind WizardLM
WizardLM's key contribution to the AI field is Evol-Instruct, a novel method for automatically generating high-complexity training data. Instead of relying on expensive human annotation (like InstructGPT) or distillation from proprietary models (like Alpaca), Evol-Instruct uses an LLM to evolve simple instructions into progressively more complex ones.
How Evol-Instruct Works
The method uses two evolution strategies described in arXiv:2304.12244:
- In-Depth Evolution: Makes instructions harder by adding constraints, increasing reasoning steps, concretizing abstract concepts, or requiring multi-step solutions
- In-Breadth Evolution: Generates entirely new instructions inspired by existing ones, expanding topic coverage and diversity
In-Depth Evolution Example
In-Breadth Evolution Example
The WizardLM team evolved 52K Alpaca instructions through multiple rounds of Evol-Instruct, producing the training dataset used to fine-tune the LLaMA base model. This approach proved effective: on the Evol-Instruct testset, WizardLM 7B showed competitive performance with ChatGPT on complex instructions while using a fraction of the parameters. The same recipe was scaled up to WizardLM 30B, which trades roughly 2x the VRAM for a modest quality gain over this 13B release.
Historical note: The Evol-Instruct methodology influenced many subsequent models and training approaches. The WizardLM team later applied similar techniques to create WizardCoder and WizardMath, demonstrating the generalizability of evolved instruction tuning. The community also blended the method with Vicuna's conversational data in WizardVicuna, best known today through its uncensored builds (see our guide to uncensored local LLMs).
Real Benchmark Performance
All benchmark scores below are from the HuggingFace Open LLM Leaderboard -- not marketing claims.
MMLU: 13B Model Comparison
MMLU Score (%) - Source: Open LLM Leaderboard
HellaSwag & ARC Comparison
HellaSwag & ARC-Challenge (%) - Source: Open LLM Leaderboard
Multi-dimensional Benchmark Analysis
Performance Metrics
Benchmark Context
WizardLM 13B v1.2 performs comparably to other 13B-class models from the same era (mid-2023). Its MMLU of 54.6% places it in the middle of the 13B pack. The model's real strength is instruction-following quality -- the Evol-Instruct training makes it handle complex multi-step instructions better than raw benchmark scores suggest. However, standard benchmarks show it barely moves its base model (Llama 2 13B, 54.3% MMLU) on knowledge tasks.
Note: all scores are from the original Open LLM Leaderboard (v1) result files on Hugging Face, which list the Llama 2 13B base as the HellaSwag and ARC comparison. This site has not run these benchmarks.
VRAM Requirements by Quantization
VRAM Usage by Quantization Level
Download sizes for the Llama 2-based WizardLM 13B on Ollama's wizardlm tag list (checked November 2, 2026): wizardlm:13b-llama2-q4_0 7.4 GB, -q4_K_M 7.9 GB, -q5_K_M 9.2 GB, -q8_0 13.8 GB, -fp16 26 GB. Add about 1 GB for the KV cache and runtime at the 4K context.
Q4_K_M
4-bit quantization, minimal quality loss
Q5_K_M
5-bit quantization, good quality balance
Q8_0
8-bit quantization, near-lossless
FP16
Full precision, no quality loss
Installation & Setup Guide
System Requirements
System Requirements
Install Ollama
Install the Ollama runtime for local model deployment
Download WizardLM 13B
Download the Llama 2-based WizardLM 13B at Q4_0 (7.4GB download, needs ~8GB VRAM). Ollama has no plain wizardlm:13b tag
Run WizardLM 13B
Start an interactive chat session with WizardLM 13B
Test instruction following
Test the model with a structured instruction-following task
Terminal Demo
Comparison with Other 13B Models
Only comparing local 13B-class models -- cloud models (ChatGPT, Claude) operate at completely different scales and are not meaningful comparisons.
| Model | Size | RAM Required | Speed ceiling (RTX 3060 12GB) | MMLU (Open LLM Leaderboard v1) | Licence |
|---|---|---|---|---|---|
| WizardLM 13B v1.2 | 7.4GB (Q4) | ~8GB VRAM | ~49 tok/s ceiling | 54.6% | Free (Llama 2 License) |
| Llama 2 13B Chat | 7.4GB (Q4) | ~8GB VRAM | ~49 tok/s ceiling | 54.6% | Free (Llama 2 License) |
| Vicuna 13B v1.5 | 7.4GB (Q4) | ~8GB VRAM | ~49 tok/s ceiling | 56.7% | Free (Llama 2 License) |
| Nous Hermes 13B | 7.4GB (Q4) | ~8GB VRAM | ~49 tok/s ceiling | 50.4% | Free (LLaMA 1 based) |
| CodeLlama 13B | 7.4GB (Q4) | ~8GB VRAM | ~49 tok/s ceiling | 32.8% | Free (Llama 2 License) |
Speed is an upper bound, not a measurement: an RTX 3060 12GB's 360 GB/s of memory bandwidth divided by the 7.4 GB Q4_0 file. All five share the Llama 13B layout, so the ceiling is the same; real speed lands below it.
Key Takeaways
- *All 13B models share similar VRAM footprints (~8GB at Q4_K_M) since they share the LLaMA 2 architecture
- *WizardLM 13B (54.6% MMLU) sits just behind Vicuna 13B v1.5 (56.7%); its case rests on instruction-following from Evol-Instruct, not on knowledge scores
- *Llama 2 13B Chat lands on the same MMLU (54.6%): both are fine-tunes of the same base, and instruction tuning adds little knowledge
- *CodeLlama 13B scores far lower on MMLU (32.8%) because it was specialized for code, not general knowledge
Practical Use Cases
Instruction Following
WizardLM 13B excels at structured multi-step instructions thanks to Evol-Instruct training. Good for drafting documents with specific formatting, step-by-step explanations, and constrained writing tasks.
Local Privacy
All inference runs on your own hardware. No data leaves your machine. Useful for processing sensitive documents, internal communications, or proprietary information without cloud API exposure.
Learning & Experimentation
At 13B parameters, the model is small enough for experimentation. Good for learning about LLM behavior, prompt engineering practice, and understanding Evol-Instruct training effects.
What WizardLM 13B Is NOT Good For
- *Factual accuracy: With 54.6% MMLU, the model hallucinates frequently on knowledge-intensive tasks. Do not rely on it for factual claims without verification.
- *Production deployment: Newer models like Llama 3 8B (~66% MMLU) and Mistral 7B v0.3 (~63% MMLU) outperform WizardLM 13B while using less VRAM.
- *Code generation: Dedicated coding models like CodeLlama 13B or DeepSeek Coder 6.7B are better for programming tasks.
- *Long context: The 4,096 token context window is limiting by 2026 standards. Newer models offer 8K-128K context.
Honest 2026 Assessment
WizardLM 13B was released in July 2023 and is nearly three years old. The local AI landscape has changed dramatically since then. Here is an honest evaluation of where it stands in 2026.
Still Relevant For
- * Understanding Evol-Instruct training methodology
- * Running on older/limited hardware (8GB VRAM is accessible)
- * Historical comparison and benchmarking reference
- * Learning about instruction-tuned models
- * Offline privacy-focused use where quality is not critical
Better Alternatives in 2026
- * Llama 3 8B -- ~66% MMLU, 8K context, ~6GB VRAM
- * Mistral 7B v0.3 -- ~63% MMLU, 32K context, ~6GB VRAM
- * Phi-3 Mini 3.8B -- ~71% MMLU, 128K context, ~3GB VRAM
- * Gemma 2 9B -- ~71% MMLU, 8K context, ~7GB VRAM
- * Qwen 2.5 7B -- ~74% MMLU, 128K context, ~6GB VRAM
Bottom Line
WizardLM 13B is historically significant as the model that popularized Evol-Instruct training. For new deployments in 2026, smaller and newer models deliver substantially better performance per VRAM. If you are starting fresh, consider Llama 3 8B or Mistral 7B instead. If you are already using WizardLM 13B and it meets your needs, there is no urgent reason to switch, but upgrading will yield meaningfully better results.
Ready to Go Beyond Tutorials?
25 structured courses with hands-on chapters - build RAG chatbots, AI agents, and ML pipelines on your own hardware.
Frequently Asked Questions
What are WizardLM 13B's actual benchmark scores?
On the original HuggingFace Open LLM Leaderboard, WizardLM 13B v1.2 scored 54.6% on MMLU, 82.2% on HellaSwag and 59.0% on ARC-Challenge. That puts it level with Llama 2 13B Chat (54.6% MMLU) and just behind Vicuna 13B v1.5 (56.7% MMLU) in the 13B parameter class.
How much VRAM does WizardLM 13B need?
WizardLM 13B needs approximately 8 GB VRAM at Q4_K_M quantization, 9-10 GB at Q5_K_M, 14 GB at Q8_0, and 26 GB at full FP16 precision. A 16GB GPU (RTX 4060 Ti 16GB) or Apple M1/M2 with 16GB unified memory can run Q4_K_M or Q5_K_M comfortably. Install via Ollama: ollama run wizardlm:13b-llama2-q4_0 (there is no plain wizardlm:13b tag).
What is Evol-Instruct and how does it train WizardLM?
Evol-Instruct is a novel training methodology introduced in the WizardLM paper (arXiv:2304.12244). It evolves simple instructions into increasingly complex ones through two strategies: in-depth evolution (adding constraints, deepening reasoning, concretizing) and in-breadth evolution (generating new related topics). This creates diverse, high-complexity training data without expensive human annotation.
Is WizardLM 13B still worth using in 2026?
WizardLM 13B is a 2023 model that has been surpassed by newer alternatives. For instruction-following, consider Llama 3 8B (~66% MMLU, 8GB VRAM) or Mistral 7B v0.3 (~63% MMLU, 6GB VRAM), both of which outperform WizardLM 13B while using less VRAM. WizardLM 13B remains historically significant for pioneering the Evol-Instruct methodology.
What license does WizardLM 13B use?
WizardLM 13B v1.2 uses the Llama 2 Community License from Meta, which permits commercial use provided you comply with Meta's acceptable use policy and have fewer than 700 million monthly active users. Earlier versions (v1.0, v1.1) used the original LLaMA license which was more restrictive.
Resources & References
Official Sources
Research Papers
Benchmarks & Tools
Go from reading about AI to building with AI
25 structured courses. Hands-on projects. Runs on your machine. Start free.

Written by
Barsha Mohapatra
Founder and Editor, Local AI Master · Founder, Little AI Master
Founder of Little AI Master and the editor behind every course and guide on Local AI Master. Years of tutoring students taught her where AI education actually fails.
Related Guides
Continue your local AI journey with these comprehensive guides
Continue Learning: 13B Parameter Models
- PILLARLocal AI Hardware Requirements (2026): Complete Guide
- Best Mac for Local AI: Every Apple Silicon Chip Ranked M1–M6
- Ollama System Requirements: Minimum RAM, GPU, Disk Size
- Run an LLM on Your Phone: Offline AI on Android & iPhone
- Gemma 4 Hardware Requirements: VRAM/RAM per Model
- Mistral Nemo 12B: 128K Context, VRAM, Ollama Setup
- Llama 2 13B & 7B: Specs, VRAM, Ollama (llama2:13b)
- "No Kernel Image Is Available" on RTX 50: sm_120 Fix
- Llama 3.1 Nemotron 70B Instruct: Ollama, VRAM, Chat Template
- TinyLlama 1.1B: Model Card, RAM, Ollama & Raspberry Pi
Grab the AI Starter Kit — career roadmap, cheat sheet, setup guide
No spam. Unsubscribe with one click.
Found your model? Now build something with it.
25 hands-on courses — RAG, agents, fine-tuning — all running locally. First chapter free, no card.