Vicuna-33B: LMSys ShareGPT Model
Updated: November 2, 2026
LLaMA 1 33B fine-tuned on 70K ShareGPT conversations by LMSys. A historically significant model that pioneered LLM-as-judge evaluation and the ChatGPT Arena.
What Is Vicuna-33B?
Vicuna-33B v1.3 is a 33-billion parameter language model created by LMSys (Large Model Systems Organization) — a collaboration between UC Berkeley, CMU, Stanford, and UC San Diego. Released in June 2023, it was fine-tuned from Meta's LLaMA 1 33B on around 125,000 user conversations (LMSYS model card; the first Vicuna in March 2023 used about 70,000) collected from ShareGPT.
Technical Specs
Key Facts
License Warning: Some sites call Vicuna-33B “Apache 2.0”; that is the licence of the FastChat code, not the model. The model card for lmsys/vicuna-33b-v1.3 says “Non-commercial license”, and the model is fine-tuned from LLaMA 1, whose weights Meta released for non-commercial research only. Commercial use is not permitted. Vicuna v1.5 (7B/13B only) uses LLaMA 2 with a more permissive license, but no v1.5 33B exists.
Historical Significance
Vicuna is one of the most historically important open-source LLMs. It contributed two innovations that became industry standards:
1. ShareGPT Training Data
Vicuna was one of the first models to demonstrate that fine-tuning on real user conversations(collected from ShareGPT, where users shared their ChatGPT conversations) produced models that felt significantly more natural and helpful than those trained on synthetic instruction data. This approach influenced the entire field.
2. LLM-as-Judge Evaluation
The Vicuna team pioneered using GPT-4 as an automated evaluator — comparing model outputs head-to-head and having GPT-4 score them. This “LLM-as-judge” approach became the standard evaluation methodology across the industry. The accompanying paper is “Judging LLM-as-a-Judge” (arXiv:2306.05685).
Chatbot Arena Legacy
LMSys also created the Chatbot Arena — a crowdsourced platform where users compare model outputs in blind A/B tests. Vicuna was a founding model on this platform. The Arena's Elo-based rankings remain one of the most trusted LLM evaluation benchmarks in 2026.
Published Benchmarks
MMLU Comparison
MMLU (5-shot) as each developer published it, from different evaluation setups. Note how modern 7B models now outperform Vicuna 33B.
MMLU Score (%)
MMLU
Multi-task language understanding (5-shot)
HellaSwag
Commonsense reasoning (10-shot, normalised accuracy)
ARC-Challenge
Science question answering (25-shot, normalised accuracy)
TruthfulQA
Avoiding common falsehoods (0-shot, mc2)
WinoGrande
Commonsense coreference (5-shot)
HumanEval
Code generation (LMSYS reported no HumanEval score; not a code-focused model)
Source: Hugging Face's Open LLM Leaderboard (v1, now archived), runs of lmsys/vicuna-33b-v1.3 dated 23 August 2023 (MMLU, HellaSwag, ARC, TruthfulQA) and 17 September 2023 (WinoGrande; the same run scored 13.7 on GSM8K 5-shot, so do not use it for arithmetic). The 59.2 MMLU matches the figure LMSYS lists. LMSYS's own launch evaluation used GPT-4 as a judge rather than standard benchmarks; its March 2023 blog post headline claimed “90%* ChatGPT quality”, with the asterisk marking that judge-based method.
VRAM & Quantization Guide
Vicuna-33B is a large model. Quantization is essential for consumer hardware. File sizes are the Ollama registry's (2 November 2026; the same files as TheBloke/vicuna-33B-GGUF on Hugging Face). “VRAM needed” = file + 3.3 GB of KV cache for the full 2,048-token context + about 1 GB of runtime overhead; “RAM (CPU)” adds about 4 GB for the operating system. Both are arithmetic, not measurements. Every row is an Ollama tag: vicuna:33b-q2_K, vicuna:33b-q3_K_M, vicuna:33b-q4_K_M, vicuna:33b-q5_K_M, vicuna:33b-q8_0 and vicuna:33b-fp16.
| Quantization | File Size | VRAM Needed | RAM (CPU) | Quality | GPU Compatibility |
|---|---|---|---|---|---|
| Q2_K | 13.5GB | ~18GB | ~22GB | Noticeable degradation | 24GB card (RTX 3090/4090) |
| Q3_K_M | 15.8GB | ~20GB | ~24GB | Acceptable | RTX 3090/4090 (24GB) |
| Q4_0 (vicuna:33b) | 18.4GB | ~23GB | ~27GB | Good (Ollama default) | RTX 3090/4090 (24GB), just |
| Q4_K_M | 19.6GB | ~24GB | ~28GB | Good | 24GB only with a shorter context; otherwise 32GB+ |
| Q5_K_M | 23.1GB | ~27GB | ~31GB | Very good | RTX 5090 (32GB), 2x RTX 3090 or A6000 |
| Q8_0 | 34.6GB | ~39GB | ~43GB | Near-lossless | A6000 (48GB) |
| FP16 | 65.1GB | ~69GB | ~73GB | Full precision | A100 80GB / 2x A6000 |
Hardware Recommendations
System Requirements
Installation (Ollama and llama.cpp)
Vicuna-33B is on Ollama
Earlier versions of this page said otherwise. The Ollama registry has vicuna:33b (18.4 GB, 4-bit), so ollama run vicuna:33b is the quickest route; with its 2,048-token context it needs roughly 23 GB (LLaMA 1 has no grouped-query attention, so the full cache is about 3.3 GB), so a 24 GB card just holds it. Other quantizations are tags too, for example ollama run vicuna:33b-q3_K_M (15.8 GB). Speed has a hard ceiling set by memory bandwidth: reading the 18.4 GB file once per token caps an RTX 4090 (1,008 GB/s) at ~55 tok/s and an RTX 3090 (936 GB/s) at ~51 tok/s. Those are ceilings, not measurements; real generation is slower.
Using llama.cpp
Note: Vicuna uses a specific chat template. The prompt format is: “A chat between a curious user and an assistant. USER: [message] ASSISTANT:” — getting this wrong significantly degrades output quality.
Using Python (Transformers)
4-bit loading through bitsandbytes needs roughly 20GB of VRAM (about half a byte per parameter plus overhead). The FP16 weights alone are 65GB (A100 80GB or a multi-GPU setup).
Vicuna-33B vs Modern Alternatives
| Model | Size | Memory (4-bit to FP16) | Relative speed | MMLU (source) | Licence |
|---|---|---|---|---|---|
| Vicuna-33B v1.3 | 33B | 18-65GB | Slow | 59.2 (LMSYS) | Non-commercial |
| Llama 3.1 8B Instruct | 8B | 5-16GB | Fast | 69.4 (Meta) | Meta Community |
| Mistral 7B | 7B | 4-14GB | Fast | 60.1 (Mistral 7B paper, v0.1) | Apache 2.0 |
| Qwen 2.5 7B | 7B | 4-14GB | Fast | 74.2 (Qwen, base) | Apache 2.0 |
| Vicuna-13B v1.5 | 13B | 8-26GB | Medium | 55.8 (LMSYS) | Llama 2 Community |
MMLU is each developer's published 5-shot figure, from different setups. Relative speed follows parameter count: a 7-8B model reads roughly a quarter of the weights per token that Vicuna-33B does.
Should You Use Vicuna-33B in 2026?
Reasons NOT to Use It
- Outperformed by smaller models: Llama 3.1 8B Instruct scores 69.4 on MMLU (Meta) against 59.2 (LMSYS) with about a quarter of the parameters
- Non-commercial license: LLaMA 1 base restricts commercial use
- Small context window: Only 2048 tokens vs 8K-128K in modern models
- Large download for its age: vicuna:33b is 18.4 GB and needs a 24 GB card
- No safety training: No RLHF or constitutional AI alignment
- Weak at code: a chat model with no code tuning, and LMSYS published no HumanEval score for it
Reasons You Might Still Want It
- Research / Historical study: Understanding the evolution of open-source LLMs
- Benchmark comparison: As a baseline when evaluating newer models
- Uncensored output: Less content filtering than modern models (for research)
- ShareGPT conversation style: Natural conversational feel due to training data source
Recommendation
For new projects in 2026, use Qwen 2.5 7B, Llama 3.1 8B, or Mistral 7B instead. They're faster, more capable, have permissive licenses, larger context windows, and run on Ollama with a single command. Vicuna's legacy is in the innovations it brought to the field, not in its ongoing competitiveness.
Frequently Asked Questions
Is Vicuna-33B available on Ollama?
Yes. The Ollama library has vicuna:33b, an 18.4 GB 4-bit download (checked against the Ollama registry on 2 November 2026), alongside vicuna:7b (3.8 GB) and vicuna:13b (7.4 GB). It is based on LLaMA 1, so the non-commercial licence still applies. llama.cpp with a GGUF conversion from Hugging Face works too, and gives you more choice of quantization.
Can I use Vicuna-33B commercially?
No. Vicuna-33B is fine-tuned from LLaMA 1 33B, which was released under Meta's original LLaMA license that restricts commercial use. The Vicuna delta weights are Apache 2.0, but you need the LLaMA 1 base weights (non-commercial) to use the model. For commercial use, consider LLaMA 3 models or Mistral, which have permissive licenses.
What made Vicuna important historically?
Vicuna was one of the first open models that its makers reported as approaching ChatGPT in conversations, using GPT-4 as the judge. Created by LMSys (UC Berkeley, CMU, Stanford, UCSD), it pioneered two important concepts: (1) fine-tuning on real user conversations from ShareGPT, and (2) using GPT-4 as an automated judge for evaluation — the 'LLM-as-judge' approach that became standard in the field.
How much VRAM does Vicuna-33B need?
The default Ollama build, vicuna:33b (Q4_0), is an 18.4 GB file; with the 3.3 GB KV cache for its full 2,048-token context and about 1 GB of overhead it needs roughly 23 GB, so a 24 GB RTX 3090 or 4090 just holds it. Q3_K_M (15.8 GB file) needs about 20 GB, Q2_K (13.5 GB) about 18 GB, and FP16 (65.1 GB) about 69 GB. File sizes are from the Ollama registry; totals are arithmetic. CPU-only inference works but is very slow.
What's better than Vicuna-33B today?
In 2026, almost every modern 7B-14B model outperforms Vicuna-33B while using far less resources. On their developers' own figures, Llama 3.1 8B Instruct scores 69.4 on MMLU (Meta), Mistral 7B 60.1 (Mistral 7B paper, v0.1) and Qwen 2.5 7B 74.2 (Qwen, base model), against 59.2 for Vicuna-33B (LMSYS). These models also have more permissive licenses and larger context windows.
Sources
- LMSys. “Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality.” Blog Post (March 2023)
- Zheng, L., et al. (2023). “Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena.” arXiv:2306.05685
- HuggingFace. “lmsys/vicuna-33b-v1.3.” Model Card
Build Real AI on Your Machine
RAG, agents, NLP, vision, and MLOps - chapters across 25 courses that take you from reading about AI to building AI.
Related Guides
Continue your local AI journey with these comprehensive guides
Go from reading about AI to building with AI
25 structured courses. Hands-on projects. Runs on your machine. Start free.

Written by
Barsha Mohapatra
Founder and Editor, Local AI Master · Founder, Little AI Master
Founder of Little AI Master and the editor behind every course and guide on Local AI Master. Years of tutoring students taught her where AI education actually fails.