Claude 3 Haiku
Anthropic · 1 configuration
Intelligence5.6
Input / 1M$0.25
Output / 1M$1.25
Context200K
Tariff: Anthropic · Source: artificial-analysis · USD per million tokens
Thinking configuration
What does more thinking buy you?
Compare this model’s measured thinking configurations.
Scroll the chart ↔ · tap a point for details
Efficient frontier: best measured score at each cost1 measured configurations · 0 without both values
Selected: thinking default · Click a point to switch configuration
Fast Claude model for responsive assistance, classification, and lightweight agents
Intelligence IndexArtificial Analysis composite index, not a percentage. Different versions of the index are not directly comparable.
5.6 pointsGPQA DiamondGraduate-level scientific questions. Measures specialist reasoning rather than web-search quality.
37.4 %Humanity’s Last ExamDifficult questions across many disciplines, compared under the same evaluation setup.
4.1 %τ²-BenchTool use and interaction in assistance scenarios. Does not replace an evaluation of your integration.
21.1 %IFBenchVerifiable instruction following. A proxy for precision rather than a benchmark of creative style.
36.1 %MMMU-ProMultimodal understanding of academic problems that include images.
30.8 %Omniscience accuracyFactual accuracy in Artificial Analysis's Omniscience evaluation.
17.6 %Specifications from the catalog
Inputtext, image, pdf
Outputtext
Tool callingYes
Structured outputNot available
SpeedNot available
First tokenNot available
Maximum output8.2K
Catalog listing date2024-03-09