10 Dimensions · Task-Based · Side-by-Side
| Model | Provider | Context | Multimodal | Open Source |
|---|---|---|---|---|
| GPT-4o | OpenAI | 128K | Yes | No |
| GPT-4o-mini | OpenAI | 128K | Yes | No |
| Claude 3.5 Sonnet | Anthropic | 200K | Yes | No |
| Claude 3 Haiku | Anthropic | 200K | Yes | No |
| Gemini 1.5 Pro | 2M | Yes | No | |
| Gemini 1.5 Flash | 1M | Yes | No | |
| Llama 3.1 405B | Meta | 128K | No | Yes |
| Mistral Large | Mistral | 128K | No | Partial |
| Task | Best Model | Why |
|---|---|---|
| Complex reasoning | Claude 3.5 Sonnet / GPT-4o | Strongest on benchmarks |
| Coding | Claude 3.5 Sonnet | Best SWE-Bench scores |
| Speed + cheap | GPT-4o-mini / Gemini Flash | Sub-second, fraction of cost |
| Long documents | Gemini 1.5 Pro | 2M context window |
| Self-hosted / privacy | Llama 3.1 | Run locally, full control |
| Creative writing | Claude 3.5 Sonnet | Natural, nuanced prose |