★ Reading this for free? Get 25 structured AI courses + per-chapter AI tutor — the first chapter of every course free, no card.Start free in 30 secondsOr own every course: $149 once

Vicuna-33B: LMSys ShareGPT Model

Updated: November 2, 2026

LLaMA 1 33B fine-tuned on 70K ShareGPT conversations by LMSys. A historically significant model that pioneered LLM-as-judge evaluation and the ChatGPT Arena.

LLaMA 1 BaseNon-Commercial Licenseollama run vicuna:33bLegacy Model (2023)

What Is Vicuna-33B?

Vicuna-33B v1.3 is a 33-billion parameter language model created by LMSys (Large Model Systems Organization) — a collaboration between UC Berkeley, CMU, Stanford, and UC San Diego. Released in June 2023, it was fine-tuned from Meta's LLaMA 1 33B on around 125,000 user conversations (LMSYS model card; the first Vicuna in March 2023 used about 70,000) collected from ShareGPT.

Technical Specs

Base Model: LLaMA 1 33B (Meta, Feb 2023)
Parameters: 32.5 billion (sold as 33B)
Context Window: 2048 tokens (LLaMA 1 default)
Training Data: ~125K ShareGPT conversations (model card)
Version: v1.3 (22 June 2023)
Architecture: LLaMA 1 transformer: 60 layers, 6,656 hidden, 52 heads, RoPE, SwiGLU; no grouped-query attention

Key Facts

Developer: LMSys (UC Berkeley, CMU, Stanford, UCSD)
License: Non-commercial (model card); LLaMA 1 base
Ollama: vicuna:33b, 18.4 GB (4-bit)
HuggingFace: lmsys/vicuna-33b-v1.3
Status: Legacy — superseded by modern models

License Warning: Some sites call Vicuna-33B “Apache 2.0”; that is the licence of the FastChat code, not the model. The model card for lmsys/vicuna-33b-v1.3 says “Non-commercial license”, and the model is fine-tuned from LLaMA 1, whose weights Meta released for non-commercial research only. Commercial use is not permitted. Vicuna v1.5 (7B/13B only) uses LLaMA 2 with a more permissive license, but no v1.5 33B exists.

Historical Significance

Vicuna is one of the most historically important open-source LLMs. It contributed two innovations that became industry standards:

1. ShareGPT Training Data

Vicuna was one of the first models to demonstrate that fine-tuning on real user conversations(collected from ShareGPT, where users shared their ChatGPT conversations) produced models that felt significantly more natural and helpful than those trained on synthetic instruction data. This approach influenced the entire field.

2. LLM-as-Judge Evaluation

The Vicuna team pioneered using GPT-4 as an automated evaluator — comparing model outputs head-to-head and having GPT-4 score them. This “LLM-as-judge” approach became the standard evaluation methodology across the industry. The accompanying paper is “Judging LLM-as-a-Judge” (arXiv:2306.05685).

Chatbot Arena Legacy

LMSys also created the Chatbot Arena — a crowdsourced platform where users compare model outputs in blind A/B tests. Vicuna was a founding model on this platform. The Arena's Elo-based rankings remain one of the most trusted LLM evaluation benchmarks in 2026.

Published Benchmarks

MMLU Comparison

MMLU (5-shot) as each developer published it, from different evaluation setups. Note how modern 7B models now outperform Vicuna 33B.

MMLU Score (%)

Qwen 2.5 7B (Qwen, base)74.2 Score
74.2
Llama 3.1 8B Instruct (Meta)69.4 Score
69.4
Mistral 7B (v0.1 paper)60.1 Score
60.1
Vicuna-33B v1.3 (LMSYS)59.2 Score
59.2
Vicuna-13B v1.5 (LMSYS)55.8 Score
55.8

MMLU

59.2

Multi-task language understanding (5-shot)

HellaSwag

83.1

Commonsense reasoning (10-shot, normalised accuracy)

ARC-Challenge

61.6

Science question answering (25-shot, normalised accuracy)

TruthfulQA

56.1

Avoiding common falsehoods (0-shot, mc2)

WinoGrande

77.0

Commonsense coreference (5-shot)

HumanEval

Not published

Code generation (LMSYS reported no HumanEval score; not a code-focused model)

Source: Hugging Face's Open LLM Leaderboard (v1, now archived), runs of lmsys/vicuna-33b-v1.3 dated 23 August 2023 (MMLU, HellaSwag, ARC, TruthfulQA) and 17 September 2023 (WinoGrande; the same run scored 13.7 on GSM8K 5-shot, so do not use it for arithmetic). The 59.2 MMLU matches the figure LMSYS lists. LMSYS's own launch evaluation used GPT-4 as a judge rather than standard benchmarks; its March 2023 blog post headline claimed “90%* ChatGPT quality”, with the asterisk marking that judge-based method.

VRAM & Quantization Guide

Vicuna-33B is a large model. Quantization is essential for consumer hardware. File sizes are the Ollama registry's (2 November 2026; the same files as TheBloke/vicuna-33B-GGUF on Hugging Face). “VRAM needed” = file + 3.3 GB of KV cache for the full 2,048-token context + about 1 GB of runtime overhead; “RAM (CPU)” adds about 4 GB for the operating system. Both are arithmetic, not measurements. Every row is an Ollama tag: vicuna:33b-q2_K, vicuna:33b-q3_K_M, vicuna:33b-q4_K_M, vicuna:33b-q5_K_M, vicuna:33b-q8_0 and vicuna:33b-fp16.

QuantizationFile SizeVRAM NeededRAM (CPU)QualityGPU Compatibility
Q2_K13.5GB~18GB~22GBNoticeable degradation24GB card (RTX 3090/4090)
Q3_K_M15.8GB~20GB~24GBAcceptableRTX 3090/4090 (24GB)
Q4_0 (vicuna:33b)18.4GB~23GB~27GBGood (Ollama default)RTX 3090/4090 (24GB), just
Q4_K_M19.6GB~24GB~28GBGood24GB only with a shorter context; otherwise 32GB+
Q5_K_M23.1GB~27GB~31GBVery goodRTX 5090 (32GB), 2x RTX 3090 or A6000
Q8_034.6GB~39GB~43GBNear-losslessA6000 (48GB)
FP1665.1GB~69GB~73GBFull precisionA100 80GB / 2x A6000

Hardware Recommendations

System Requirements

▸
Operating System
Windows 10/11, macOS 12+, Ubuntu 20.04+
▸
RAM
32GB for the 18.4 GB default build on CPU; 64GB for Q8_0
▸
Storage
13.5-65GB depending on quantization level
▸
GPU
RTX 3090/4090 24GB for vicuna:33b (Q4_0). A6000 48GB for Q8_0. CPU-only possible but slow.
▸
CPU
Intel i7/AMD Ryzen 7 or better. ARM (Apple Silicon M1+) works well with llama.cpp.

Installation (Ollama and llama.cpp)

Vicuna-33B is on Ollama

Earlier versions of this page said otherwise. The Ollama registry has vicuna:33b (18.4 GB, 4-bit), so ollama run vicuna:33b is the quickest route; with its 2,048-token context it needs roughly 23 GB (LLaMA 1 has no grouped-query attention, so the full cache is about 3.3 GB), so a 24 GB card just holds it. Other quantizations are tags too, for example ollama run vicuna:33b-q3_K_M (15.8 GB). Speed has a hard ceiling set by memory bandwidth: reading the 18.4 GB file once per token caps an RTX 4090 (1,008 GB/s) at ~55 tok/s and an RTX 3090 (936 GB/s) at ~51 tok/s. Those are ceilings, not measurements; real generation is slower.

Using llama.cpp

Terminal
$git clone https://github.com/ggml-org/llama.cpp && cd llama.cpp && cmake -B build && cmake --build build --config Release -j
# Build llama.cpp (add -DGGML_CUDA=ON to the first cmake for NVIDIA GPUs; # Metal is on by default on Apple Silicon)
$# Download a GGUF file from HuggingFace (community upload)
# Example: TheBloke/vicuna-33B-GGUF (Q4_K_M is 19.6 GB) # wget https://huggingface.co/TheBloke/vicuna-33B-GGUF/resolve/main/vicuna-33b.Q4_K_M.gguf # Run with llama.cpp: ./build/bin/llama-cli -m vicuna-33b.Q4_K_M.gguf \ -n 512 \ --temp 0.7 \ -p "A chat between a curious user and an assistant.\n\nUSER: What is the significance of the Turing test?\nASSISTANT:"
$_

Note: Vicuna uses a specific chat template. The prompt format is: “A chat between a curious user and an assistant. USER: [message] ASSISTANT:” — getting this wrong significantly degrades output quality.

Using Python (Transformers)

Terminal
$pip install transformers torch accelerate
from transformers import AutoModelForCausalLM, AutoTokenizer import torch model_name = "lmsys/vicuna-33b-v1.3" tokenizer = AutoTokenizer.from_pretrained(model_name) model = AutoModelForCausalLM.from_pretrained( model_name, torch_dtype=torch.float16, device_map="auto", load_in_4bit=True, # Requires bitsandbytes ) prompt = "A chat between a curious user and an assistant.\n\nUSER: Explain quantum entanglement simply.\nASSISTANT:" inputs = tokenizer(prompt, return_tensors="pt").to(model.device) outputs = model.generate(**inputs, max_new_tokens=256, temperature=0.7) print(tokenizer.decode(outputs[0], skip_special_tokens=True))
$_

4-bit loading through bitsandbytes needs roughly 20GB of VRAM (about half a byte per parameter plus overhead). The FP16 weights alone are 65GB (A100 80GB or a multi-GPU setup).

Vicuna-33B vs Modern Alternatives

ModelSizeMemory (4-bit to FP16)Relative speedMMLU (source)Licence
Vicuna-33B v1.333B18-65GBSlow59.2 (LMSYS)Non-commercial
Llama 3.1 8B Instruct8B5-16GBFast69.4 (Meta)Meta Community
Mistral 7B7B4-14GBFast60.1 (Mistral 7B paper, v0.1)Apache 2.0
Qwen 2.5 7B7B4-14GBFast74.2 (Qwen, base)Apache 2.0
Vicuna-13B v1.513B8-26GBMedium55.8 (LMSYS)Llama 2 Community

MMLU is each developer's published 5-shot figure, from different setups. Relative speed follows parameter count: a 7-8B model reads roughly a quarter of the weights per token that Vicuna-33B does.

Should You Use Vicuna-33B in 2026?

Reasons NOT to Use It

  • Outperformed by smaller models: Llama 3.1 8B Instruct scores 69.4 on MMLU (Meta) against 59.2 (LMSYS) with about a quarter of the parameters
  • Non-commercial license: LLaMA 1 base restricts commercial use
  • Small context window: Only 2048 tokens vs 8K-128K in modern models
  • Large download for its age: vicuna:33b is 18.4 GB and needs a 24 GB card
  • No safety training: No RLHF or constitutional AI alignment
  • Weak at code: a chat model with no code tuning, and LMSYS published no HumanEval score for it

Reasons You Might Still Want It

  • Research / Historical study: Understanding the evolution of open-source LLMs
  • Benchmark comparison: As a baseline when evaluating newer models
  • Uncensored output: Less content filtering than modern models (for research)
  • ShareGPT conversation style: Natural conversational feel due to training data source

Recommendation

For new projects in 2026, use Qwen 2.5 7B, Llama 3.1 8B, or Mistral 7B instead. They're faster, more capable, have permissive licenses, larger context windows, and run on Ollama with a single command. Vicuna's legacy is in the innovations it brought to the field, not in its ongoing competitiveness.

Frequently Asked Questions

Is Vicuna-33B available on Ollama?

Yes. The Ollama library has vicuna:33b, an 18.4 GB 4-bit download (checked against the Ollama registry on 2 November 2026), alongside vicuna:7b (3.8 GB) and vicuna:13b (7.4 GB). It is based on LLaMA 1, so the non-commercial licence still applies. llama.cpp with a GGUF conversion from Hugging Face works too, and gives you more choice of quantization.

Can I use Vicuna-33B commercially?

No. Vicuna-33B is fine-tuned from LLaMA 1 33B, which was released under Meta's original LLaMA license that restricts commercial use. The Vicuna delta weights are Apache 2.0, but you need the LLaMA 1 base weights (non-commercial) to use the model. For commercial use, consider LLaMA 3 models or Mistral, which have permissive licenses.

What made Vicuna important historically?

Vicuna was one of the first open models that its makers reported as approaching ChatGPT in conversations, using GPT-4 as the judge. Created by LMSys (UC Berkeley, CMU, Stanford, UCSD), it pioneered two important concepts: (1) fine-tuning on real user conversations from ShareGPT, and (2) using GPT-4 as an automated judge for evaluation — the 'LLM-as-judge' approach that became standard in the field.

How much VRAM does Vicuna-33B need?

The default Ollama build, vicuna:33b (Q4_0), is an 18.4 GB file; with the 3.3 GB KV cache for its full 2,048-token context and about 1 GB of overhead it needs roughly 23 GB, so a 24 GB RTX 3090 or 4090 just holds it. Q3_K_M (15.8 GB file) needs about 20 GB, Q2_K (13.5 GB) about 18 GB, and FP16 (65.1 GB) about 69 GB. File sizes are from the Ollama registry; totals are arithmetic. CPU-only inference works but is very slow.

What's better than Vicuna-33B today?

In 2026, almost every modern 7B-14B model outperforms Vicuna-33B while using far less resources. On their developers' own figures, Llama 3.1 8B Instruct scores 69.4 on MMLU (Meta), Mistral 7B 60.1 (Mistral 7B paper, v0.1) and Qwen 2.5 7B 74.2 (Qwen, base model), against 59.2 for Vicuna-33B (LMSYS). These models also have more permissive licenses and larger context windows.

Sources

  • LMSys. “Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality.” Blog Post (March 2023)
  • Zheng, L., et al. (2023). “Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena.” arXiv:2306.05685
  • HuggingFace. “lmsys/vicuna-33b-v1.3.” Model Card

Build Real AI on Your Machine

RAG, agents, NLP, vision, and MLOps - chapters across 25 courses that take you from reading about AI to building AI.

Reading now
Join the discussion

Related Guides

Continue your local AI journey with these comprehensive guides

🎯
AI Learning Path

Go from reading about AI to building with AI

25 structured courses. Hands-on projects. Runs on your machine. Start free.

Or own it for life — Lifetime $149 $599, pay once
Barsha Mohapatra

Written by

Barsha Mohapatra

Founder and Editor, Local AI Master · Founder, Little AI Master

Founder of Little AI Master and the editor behind every course and guide on Local AI Master. Years of tutoring students taught her where AI education actually fails.

📅 Published: September 28, 2025🔄 Last Updated: November 2, 2026✓ Manually Reviewed
More on AI Models Directory
See the full AI Models Directory guide.
📚
Free · no account required

Grab the AI Starter Kit — career roadmap, cheat sheet, setup guide

No spam. Unsubscribe with one click.

🎯
AI Learning Path

Found your model? Now build something with it.

25 hands-on courses — RAG, agents, fine-tuning — all running locally. First chapter free, no card.

Or own it for life — Lifetime $149 $599, pay once
Free Tools & Calculators