stackledger. Open repository
STACK LEDGER / OPEN RESEARCH

Capability within reach.

Model companies and open communities build LLMs and other models. Harnesses connect them to context and tools; agent systems organize their capabilities into useful work.

INSIDE THE LAYER / HOW IT FITS TOGETHER

From compute to a capable service.

A model is developed, evaluated and served. Tools and context can extend what it does; testing determines where it is useful.

1Data & objectives2Training & adaptation3Evaluation4Serving / inference5Context & tools6Application interface
Power / energyData / processHeat removalReview / feedback

Original conceptual illustration, not a site plan or engineering specification. Arrows show selected relationships, not measured flows or capacity. Numbered components are explained below; select one in the diagram to jump to it.

01 Data & objectives

Curated data and learning objectives shape training. Data rights, coverage and quality require review.

02 Training & adaptation

Compute updates model parameters; further training can adapt behavior and task performance.

03 Evaluation

Capability, reliability and safety evaluations test a particular model and deployment configuration.

04 Serving / inference

Serving systems execute the model for new inputs, trading off latency, throughput and cost.

05 Context & tools

Retrieval supplies relevant information; tools let a system interact with software under defined permissions.

06 Application interface

An API or product delivers capabilities to a workflow. Production feedback informs further evaluation.

Technical context: NVIDIA: AI is a 5-layer cake ↗ · Anthropic: Building effective agents ↗

MODELS / CAPABILITY THROUGH TIME

A broader frontier of capability.

Explore Epoch AI ↗

Epoch’s Capabilities Index brings multiple benchmarks onto a common scale. Follow model releases across organizations and open- or closed-weight availability.

ECI points · model release date · all scores from one dataset snapshot

Epoch Capabilities Index over model release datesPublished model scores, not productivity or percent intelligence. The frontier follows the highest score available by release date.4060801001201401601802023202420252026GPT-6 Astra · 2026-09-03 · ECI 166.57; 90% interval 163.34–171.7Claude Fable 5.1 · 2026-09-01 · ECI 164.24; 90% interval 161.3–167.85Claude Fable 5 · 2026-06-09 · ECI 163.41; 90% interval 160.68–167.1Claude Opus 5 · 2026-07-24 · ECI 162.59; 90% interval 160.09–165.69GPT-5.5 Pro · 2026-04-23 · ECI 162.26; 90% interval 159.3–165.37GPT-5.6 Sol · 2026-07-09 · ECI 161.76; 90% interval 159.53–164.88GPT-5.6 Terra · 2026-07-09 · ECI 159.15; 90% interval 156.64–161.84GPT-5.5 · 2026-04-23 · ECI 159.14; 90% interval 156.91–161.87GPT-5.4 Pro · 2026-03-05 · ECI 158.93; 90% interval 156.35–161.87Claude Opus 4.8 · 2026-05-28 · ECI 158.32; 90% interval 156.33–160.46Kimi K3 · 2026-07-16 · ECI 157.64; 90% interval 155.01–160.58Gemini 3.7 Flash · 2026-08-13 · ECI 157.44; 90% interval 155.52–160.08GPT-5.4 · 2026-03-05 · ECI 156.86; 90% interval 155.05–158.79Qwen 3.8 Max · 2026-08-02 · ECI 156.62; 90% interval 154.45–158.45GPT-5.3 Codex · 2026-02-05 · ECI 156.59; 90% interval 154.13–159.41Claude Opus 4.7 · 2026-04-16 · ECI 156.34; 90% interval 154.45–158.34Grok 4.6 · 2026-08-12 · ECI 156.34; 90% interval 154.57–158.47GPT-5.6 Luna · 2026-07-09 · ECI 156.31; 90% interval 153.75–158.49Claude Sonnet 5 · 2026-06-30 · ECI 156.23; 90% interval 153.39–158.5Muse Spark 1.2 · 2026-08-05 · ECI 155.49; 90% interval 153.76–158.7DeepSeek V4 Pro 0813 · 2026-08-13 · ECI 155.44; 90% interval 153.65–157.54Claude Opus 4.6 · 2026-02-05 · ECI 155.34; 90% interval 153.51–157.14GPT-5.2 Pro · 2025-12-11 · ECI 155.34; 90% interval 153.04–157.88GLM-5.3 · 2026-08-14 · ECI 155.25; 90% interval 153.15–157.51Gemini 3.1 Pro · 2026-02-19 · ECI 155; 90% interval 152.77–157.56Gemini 3.5 Flash · 2026-05-19 · ECI 154.69; 90% interval 152.76–156.78Muse Spark 1.1 · 2026-07-09 · ECI 154.64; 90% interval 152.26–157.96DeepSeek V4 Flash 0731 · 2026-07-31 · ECI 154.49; 90% interval 152.05–156.45Gemini 3.6 Flash · 2026-07-21 · ECI 154.32; 90% interval 152.6–156.05Grok 4.5 · 2026-07-08 · ECI 153.92; 90% interval 152.32–155.71Qwen3.7-Max · 2026-05-19 · ECI 153.72; 90% interval 151.87–155.95GPT-5.2 · 2025-12-11 · ECI 153.49; 90% interval 151.77–155.17Gemini 3 Pro · 2025-11-18 · ECI 153.01; 90% interval 151.16–154.96Claude Sonnet 4.6 · 2026-02-17 · ECI 152.29; 90% interval 149.78–154.35Muse Spark · 2026-04-08 · ECI 152.13; 90% interval 150.18–155.41Grok 4.20 · 2026-02-17 · ECI 152.03; 90% interval 149.08–154.45GLM-5.2 · 2026-06-16 · ECI 151.88; 90% interval 150.11–153.88Gemini 3 Flash · 2025-12-17 · ECI 151.84; 90% interval 150.5–153.45GLM-5.3-Flash · 2026-08-20 · ECI 151.45; 90% interval 148.96–153.42Kimi K2.6 · 2026-04-20 · ECI 151.01; 90% interval 149.07–152.65GPT-5 Pro · 2025-10-07 · ECI 150.28; 90% interval 148.77–152.52Claude Opus 4.5 · 2025-11-24 · ECI 150.11; 90% interval 148–152.85Kimi K2.7 Code · 2026-06-12 · ECI 150.1; 90% interval 148.39–151.76GPT-5 · 2025-08-07 · ECI 150; interval not supplied for this anchorGLM-5.1 · 2026-04-07 · ECI 149.73; 90% interval 147.65–151.48GPT-5.1 · 2025-11-13 · ECI 149.65; 90% interval 148.34–151.05Qwen 3.6 Max (Preview) · 2026-04-20 · ECI 149.3; 90% interval 147.55–152.27Grok 4.3 Beta · 2026-04-17 · ECI 149.18; 90% interval 147.59–150.59DeepSeek-V4-Pro · 2026-04-24 · ECI 149.1; 90% interval 147.29–150.44GPT-5.4 Mini · 2026-03-17 · ECI 148.98; 90% interval 147.08–150.7Kimi K2.5 · 2026-01-27 · ECI 148.03; 90% interval 146.24–149.09Qwen 3.6 Plus · 2026-03-31 · ECI 147.69; 90% interval 145.8–149.26o3-pro · 2025-06-10 · ECI 147.45; 90% interval 145.86–150.15Qwen3.7-Plus · 2026-06-02 · ECI 147.42; 90% interval 145.83–148.78Qwen3.5 397B-A17B · 2026-02-13 · ECI 146.98; 90% interval 145.27–148.83o3 · 2025-04-16 · ECI 146.91; 90% interval 144.99–148.44Claude Sonnet 4.5 · 2025-09-29 · ECI 146.85; 90% interval 145.32–148.21Qwen 3.5 Plus (hosted 397B-A17B) · 2026-02-16 · ECI 146.75; 90% interval 144.6–147.94Qwen3.6 27B · 2026-04-22 · ECI 146.51; 90% interval 144.53–147.8Grok 4 · 2025-07-09 · ECI 146.45; 90% interval 144.39–148.14DeepSeek-V3.2 · 2025-12-01 · ECI 146.2; 90% interval 144.34–147.39DeepSeek-V4-Flash · 2026-04-24 · ECI 146.12; 90% interval 143.67–147.87GPT-5.4 Nano · 2026-03-17 · ECI 145.87; 90% interval 143.46–147.52GLM-5 · 2026-02-11 · ECI 145.87; 90% interval 143.94–147.8Kimi K2 Thinking · 2025-11-06 · ECI 145.77; 90% interval 143.31–147.12o4-mini · 2025-04-16 · ECI 145.66; 90% interval 143.29–147.27GPT-5 mini · 2025-08-07 · ECI 145.54; 90% interval 143.51–147.11Gemini 2.5 Pro (Jun 2025) · 2025-06-05 · ECI 145.27; 90% interval 143.59–146.71Gemini 3.5 Flash-Lite · 2026-07-21 · ECI 145.14; 90% interval 142.4–146.7DeepSeek-V3.2-Exp · 2025-09-29 · ECI 145.03; 90% interval 142.53–147Qwen3.7 Flash · 2026-07-27 · ECI 144.64; 90% interval 142.69–147.52Grok 4 Fast · 2025-09-19 · ECI 144.22; 90% interval 141.74–146.28Gemini 2.5 Pro (Mar 2025) · 2025-03-31 · ECI 144.17; 90% interval 141.94–146.84Claude Opus 4.1 · 2025-08-05 · ECI 144.12; 90% interval 141.76–145.99Qwen 3.5 Flash (hosted 35B-A3B) · 2026-02-25 · ECI 144.01; 90% interval 141.92–145.67Qwen3-235B-A22B-Thinking (Jul 2025) · 2025-07-25 · ECI 143.88; 90% interval 141.77–145.36Qwen 3.6 35B-A3B · 2026-04-14 · ECI 143.87; 90% interval 141.31–146GLM-4.7 · 2025-12-22 · ECI 143.47; 90% interval 141.16–145.49Qwen 3.6 Flash · 2026-04-27 · ECI 143.28; 90% interval 140.98–144.78Gemini 2.5 Flash (Sep 2025) · 2025-09-25 · ECI 143; 90% interval 139.77–146.62Claude Opus 4 · 2025-05-22 · ECI 142.68; 90% interval 140.58–144.11Gemma 4 31B IT · 2026-04-02 · ECI 142.68; 90% interval 140.28–144.75Qwen3.5-35B-A3B · 2026-02-24 · ECI 142.54; 90% interval 140.22–144.87GPT-5.5 Instant · 2026-05-05 · ECI 142.52; 90% interval 139.99–145.21Gemini 2.5 Pro (May 2025) · 2025-05-06 · ECI 142.48; 90% interval 139.15–145.14Qwen3-Max · 2025-09-24 · ECI 142.44; 90% interval 140.12–144.73Claude Haiku 4.5 · 2025-10-15 · ECI 142.39; 90% interval 139.47–144.03Gemma 4 26B A4B · 2026-04-02 · ECI 141.87; 90% interval 138.55–143.58o1 · 2024-12-17 · ECI 141.87; 90% interval 139.83–143.14Claude Sonnet 4 · 2025-05-22 · ECI 141.69; 90% interval 138.85–143.08Gemini 2.5 Flash (May 2025) · 2025-05-20 · ECI 141.55; 90% interval 139.51–142.98DeepSeek-R1 (May 2025) · 2025-05-28 · ECI 141.3; 90% interval 139.17–142.91Mistral Medium 3.5 · 2026-04-28 · ECI 141.29; 90% interval 138.78–143.1Claude 3.7 Sonnet · 2025-02-24 · ECI 141.17; 90% interval 139.01–142.68Gemini 2.5 Flash (Jun 2025) · 2025-06-17 · ECI 140.53; 90% interval 138.18–141.98o3-mini · 2025-01-31 · ECI 140.36; 90% interval 137.47–141.8Grok-3 mini · 2025-06-24 · ECI 140.36; 90% interval 137.67–142.02Kimi K2 (Jul 2025) · 2025-07-12 · ECI 140.12; 90% interval 136.65–142.03gpt-oss-120b · 2025-08-05 · ECI 140.11; 90% interval 135.39–142.42Gemini 2.5 Flash (Apr 2025) · 2025-04-17 · ECI 139.98; 90% interval 136.37–142.05DeepSeek-V3.1 · 2025-08-21 · ECI 139.93; 90% interval 135.79–143.19Qwen3-30B-A3B-Thinking (Jul 2025) · 2025-07-30 · ECI 139.65; 90% interval 135.15–141.06Qwen3.5-9B · 2026-02-24 · ECI 139.45; 90% interval 136.59–141.07GPT-5 nano · 2025-08-07 · ECI 139.4; 90% interval 134.43–141.52Qwen3-235B-A22B · 2025-04-28 · ECI 139.36; 90% interval 135.59–140.99DeepSeek-R1 · 2025-01-20 · ECI 138.98; 90% interval 136.62–140.38Qwen3-235B-A22B-Instruct (Jul 2025) · 2025-07-25 · ECI 138.93; 90% interval 136.19–140.82Qwen3-32B · 2025-04-29 · ECI 138.52; 90% interval 135.14–140.32Grok 3 · 2025-04-09 · ECI 138.3; 90% interval 135.61–139.8Qwen3-14B · 2025-04-29 · ECI 138.25; 90% interval 133.68–139.84gpt-oss-20b · 2025-08-05 · ECI 137.81; 90% interval 132.89–139.56QwQ-32B · 2025-03-05 · ECI 137.6; 90% interval 133.05–141.72DeepSeek-R1-Distill-Qwen-32B · 2025-01-20 · ECI 137.43; 90% interval 126.69–138.7Qwen3-30B-A3B-Instruct (Jul 2025) · 2025-07-29 · ECI 137.43; 90% interval 132.32–139.54GPT-4.1 · 2025-04-14 · ECI 136.8; 90% interval 134.21–138.54GPT-4.5 · 2025-02-27 · ECI 136.75; 90% interval 133.97–138.6Qwen3-30B-A3B · 2025-04-29 · ECI 136.19; 90% interval 130.82–138.76Qwen3-8B · 2025-04-28 · ECI 136.18; 90% interval 129.58–138.07DeepSeek-V3 (Mar 2025) · 2025-03-24 · ECI 135.95; 90% interval 132.46–138.04o1-mini · 2024-09-12 · ECI 135.83; 90% interval 132.4–137.38DeepSeek-R1-Distill-Qwen-14B · 2025-01-20 · ECI 135.43; 90% interval 127.36–138.05Gemini 2.0 Pro · 2025-02-05 · ECI 135.06; 90% interval 131.28–136.85GPT-4.1 mini · 2025-04-14 · ECI 135.02; 90% interval 131.5–136.71o1-preview · 2024-09-12 · ECI 134.79; 90% interval 131.47–138.65Mistral Medium 3 · 2025-05-07 · ECI 134.08; 90% interval 130.69–135.57Gemini 2.5 Flash-Lite (Jun 2025) · 2025-06-17 · ECI 133.93; 90% interval 130.4–136.41Claude 3.5 Sonnet (October 2024) · 2024-10-22 · ECI 133.55; 90% interval 128.63–137.61Magistral Small 1.0 · 2025-06-10 · ECI 133.19; 90% interval 129.42–134.52Qwen2.5-Max · 2025-01-25 · ECI 132.54; 90% interval 128.45–135.82DeepSeek-V3 · 2024-12-26 · ECI 132.35; 90% interval 128.05–135.89Llama 4 Maverick · 2025-04-06 · ECI 132.2; 90% interval 128.31–134.35Mistral Small 3.2 · 2025-06-20 · ECI 131.74; 90% interval 127.19–133.73Gemini 1.5 Pro (Sept 2024) · 2024-09-24 · ECI 131.73; 90% interval 128.35–133.24Magistral Small 1.2 · 2025-09-18 · ECI 131.41; 90% interval 126.27–133.53Grok-2 (Dec 2024) · 2024-12-12 · ECI 130.48; 90% interval 126.47–132.12Gemma 3 27B · 2025-03-12 · ECI 130.04; 90% interval 124.64–132.17Claude 3.5 Sonnet · 2024-06-20 · ECI 130; interval not supplied for this anchorLlama 4 Scout · 2025-04-05 · ECI 129.64; 90% interval 124.84–131.45GPT-4.1 nano · 2025-04-14 · ECI 129.62; 90% interval 124.04–132Gemini 1.5 Flash (Sep 2024) · 2024-09-24 · ECI 129.36; 90% interval 124.03–131.09Qwen2.5-72B · 2024-09-19 · ECI 129; 90% interval 123.98–130.7GPT-4o (May 2024) · 2024-05-13 · ECI 128.97; 90% interval 124.43–131.59GPT-4o (Nov 2024) · 2024-11-20 · ECI 128.81; 90% interval 124.92–130.93GPT-4o (Aug 2024) · 2024-08-06 · ECI 128.77; 90% interval 124.39–130.6Llama 3.1-405B · 2024-07-23 · ECI 128.75; 90% interval 124.39–130.57Qwen2.5-32B · 2024-09-17 · ECI 128.52; 90% interval 123.16–130.09Mistral Large 2 (Nov 2024) · 2024-11-18 · ECI 128.52; 90% interval 124.19–130.55Mistral Large 2 (Jul 2024) · 2024-07-24 · ECI 127.54; 90% interval 123.07–129.64Mistral Small 3.1 · 2025-03-17 · ECI 127.48; 90% interval 122.92–129.28Llama 3.3 70B · 2024-12-06 · ECI 127.32; 90% interval 122.68–129.67GPT-4 Turbo (Apr 2024) · 2024-04-09 · ECI 127.25; 90% interval 122.46–128.93Claude 3.5 Haiku · 2024-10-22 · ECI 127.15; 90% interval 121.02–129.64Mistral Small 3 · 2025-01-30 · ECI 127.07; 90% interval 122.41–129.01Claude 3 Opus · 2024-02-29 · ECI 126.91; 90% interval 121.74–130.11Gemini 1.5 Pro (May 2024) · 2024-05-14 · ECI 126.9; 90% interval 122.52–129.03GPT-4o mini · 2024-07-18 · ECI 126.56; 90% interval 121.2–128.53GPT-4 Turbo (Nov 2023) · 2024-01-25 · ECI 126.45; 90% interval 121.78–128.95Llama 3.1-70B · 2024-07-23 · ECI 125.91; 90% interval 121.1–128.39GPT-4 (Mar 2023) · 2023-03-14 · ECI 125.88; 90% interval 120.22–130.04Llama 3.2 90B · 2024-09-24 · ECI 125.5; 90% interval 120.49–127.47Qwen2-72B · 2024-06-07 · ECI 125.27; 90% interval 119.75–126.9DeepSeek-V2 (MoE-236B, May 2024) · 2024-05-07 · ECI 124.77; 90% interval 118.57–127.57Gemma 3 12B · 2025-03-12 · ECI 123.46; 90% interval 116.21–128.73GPT-4 (Jun 2023) · 2023-06-13 · ECI 123.1; 90% interval 117.72–126.7Llama 3-70B · 2024-04-18 · ECI 122.91; 90% interval 117.38–125.73Gemini 1.5 Flash (May 2024) · 2024-05-23 · ECI 122.57; 90% interval 116.81–124.7Gemma 2 27B · 2024-06-24 · ECI 122.05; 90% interval 115.94–124.18Mixtral 8x22B · 2024-04-17 · ECI 122; 90% interval 115.86–124.39Mistral Large · 2024-02-26 · ECI 121.99; 90% interval 114.74–124.93phi-3-small 7.4B · 2024-04-23 · ECI 121.8; 90% interval 114.95–124.24phi-3-medium 14B · 2024-04-23 · ECI 121.19; 90% interval 115.17–123.87Claude 3 Sonnet · 2024-02-29 · ECI 120.68; 90% interval 113.89–123.5Claude Instant · 2023-08-09 · ECI 120.21; 90% interval 113.43–122.93Claude 2 · 2023-07-11 · ECI 120.09; 90% interval 114.21–123.8Gemma 2 9B · 2024-06-24 · ECI 119.8; 90% interval 112.44–122.31Qwen2.5-Coder-32B · 2024-09-18 · ECI 119.43; 90% interval 110.31–125.07Claude 2.1 · 2023-11-21 · ECI 119.22; 90% interval 113.07–121.92Mistral NeMo · 2024-07-18 · ECI 118.65; 90% interval 111.96–121.85GPT-3.5 Turbo (Nov 2023) · 2023-11-06 · ECI 118.5; 90% interval 108.73–121.55Qwen2.5-7B · 2024-09-19 · ECI 118.45; 90% interval 111.07–121.28Mixtral 8x7B · 2023-12-11 · ECI 118.4; 90% interval 111.79–121.15Claude 3 Haiku · 2024-03-07 · ECI 118.3; 90% interval 111.75–121.5Ministral 3B · 2024-10-16 · ECI 118.06; 90% interval 107.01–121.85phi-3-mini 3.8B · 2024-04-23 · ECI 117.27; 90% interval 109.44–120.54Gemini 1.0 Pro · 2023-12-13 · ECI 116.97; 90% interval 110.31–119.74Llama 3.1-8B · 2024-07-23 · ECI 116.51; 90% interval 105.95–121.71Llama 3-8B · 2024-04-18 · ECI 116.36; 90% interval 108.36–119.1Qwen2.5-Coder-14B · 2024-09-18 · ECI 116.3; 90% interval 106.61–122.34Gemma 3 4B · 2025-03-12 · ECI 115.97; 90% interval 97.45–123.39GPT-3.5 Turbo (Jan 2024) · 2024-01-25 · ECI 115.62; 90% interval 107.2–119.14PaLM 2-L · 2023-05-17 · ECI 114.9; 90% interval 105.47–127.71Llama 2-70B · 2023-07-18 · ECI 113.65; 90% interval 106.09–117.31GPT-3.5 Turbo (Jun 2023) · 2023-06-13 · ECI 113.21; 90% interval 105.97–117.89Qwen2.5-Coder (7B) · 2024-09-18 · ECI 113; 90% interval 101.97–118.44Qwen-14B · 2023-09-24 · ECI 112.88; 90% interval 105.14–117.16Mistral 7B v0.1 · 2023-09-27 · ECI 112.05; 90% interval 103.93–116.19Falcon-180B · 2023-09-06 · ECI 111.97; 90% interval 104.16–118.52internlm-20b · 2023-09-18 · ECI 111.92; 90% interval 103.27–117.01Gemma 7B · 2024-02-21 · ECI 111.82; 90% interval 103.19–116.2DeepSeek LLM 67B · 2023-11-29 · ECI 110.55; 90% interval 93.83–117.03LLaMA-65B · 2023-02-24 · ECI 109.98; 90% interval 102.15–114.27Falcon 2 11B · 2024-05-09 · ECI 109.36; 90% interval 101.39–115.43Mistral 7B v0.3 · 2024-05-27 · ECI 108.81; 90% interval 98.65–112.44DeepSeek-Coder-V2-Lite-Base · 2024-06-13 · ECI 108.68; 90% interval 99.7–113.87PaLM 2-M · 2023-05-17 · ECI 108.08; 90% interval 99.26–115.99Phi-2 · 2023-12-12 · ECI 107.73; 90% interval 88.55–113.35Qwen2.5-Coder-3B · 2024-09-18 · ECI 107.52; 90% interval 94.3–115.58Yi-9B · 2024-03-01 · ECI 107.39; 90% interval 98.62–114.57LLaMA-33B · 2023-02-24 · ECI 107.18; 90% interval 99–112.24Qwen-7B · 2023-09-28 · ECI 106.59; 90% interval 95.55–112.2Llama 2-13B · 2023-07-18 · ECI 105.93; 90% interval 96.7–111.03PaLM 2-S · 2023-05-17 · ECI 105.92; 90% interval 97.66–113.71Llama 2-34B · 2023-07-18 · ECI 104.94; 90% interval 95.48–110.32Falcon-40B · 2023-05-25 · ECI 104.18; 90% interval 94.62–109.74Qwen2.5-Coder (1.5B) · 2024-09-18 · ECI 102.71; 90% interval 88.02–110.25internlm-7b · 2023-07-05 · ECI 102.58; 90% interval 91.92–109.22Llama 3.2 1B · 2024-09-24 · ECI 102.43; 90% interval 91.24–109.91LLaMA-13B · 2023-02-24 · ECI 100.26; 90% interval 89.93–106.41Llama 2-7B · 2023-07-18 · ECI 98.72; 90% interval 88.42–105.23chatglm2-6b · 2023-06-24 · ECI 98.6; 90% interval 83.28–105.31LLaMA-7B · 2023-02-24 · ECI 96.32; 90% interval 85.32–103.57Falcon-7B · 2023-04-24 · ECI 94.7; 90% interval 83.52–101.96CodeQwen1.5-7B · 2024-04-15 · ECI 94.46; 90% interval 81.41–102.8vicuna-13b-v1.1 · 2023-04-12 · ECI 94.26; 90% interval 80.79–102.31Gemma 2B · 2024-02-21 · ECI 93.8; 90% interval 82.78–100.32Qwen-1_8B · 2023-11-30 · ECI 92.51; 90% interval 70.92–100.95open_llama_7b · 2023-06-07 · ECI 91.21; 90% interval 79.11–99.45Phi-1.5 · 2023-09-11 · ECI 91.08; 90% interval 68.51–100.38RedPajama-INCITE-7B-Base · 2023-05-04 · ECI 89.96; 90% interval 76.67–98.05Qwen2.5-Coder-0.5B · 2024-09-18 · ECI 87.66; 90% interval 62.09–99.7stablelm-tuned-alpha-7b · 2023-04-19 · ECI 54.83; 90% interval 31.39–72.75
OpenAIAlibabaGoogle DeepMindAnthropicMeta AIUnknownMistral AIDeepSeekxAIMoonshotZ.ai (Zhipu AI)MicrosoftTechnology Innovation Institute

Default: developers with more than three models; unlisted developers hidden. All records remain in the evidence table.

Select a point or choose a model to inspect its score and uncertainty.

ECI is an index, not a percentage or a direct measure of reliable work. The step line is the best score by release date within the selected group, not a forecast. No future capability is extrapolated.

Model scores, uncertainty & methodology

Source: Epoch AI · publication date unlisted ↗ · Epoch AI · publication date unlisted ↗. Retrieved 2026-09-09. Data © Epoch AI and contributors, reused with attribution. 90% confidence intervals come from the same download; two calibration anchors have no supplied interval.

Country comes from Epoch’s “Country (of organization)” field; it is not the training location or the nationality of every contributor. Unknown values remain unlisted. Developer labels retain Epoch’s attribution, including collaborations. Historical scores can change when Epoch refits its index. This page uses one complete snapshot rather than combining vintages. Benchmark coverage and developer-reported results can affect comparability; overlapping intervals do not establish a reliable ranking. Open weights do not necessarily mean unrestricted open source.

Epoch Capabilities Index · reviewed snapshot
ModelDeveloperCountry of organizationRelease dateECI90% intervalAvailability
GPT-6 AstraOpenAIUnited States of America2026-09-03166.57163.34–171.7Closed weights
Claude Fable 5.1AnthropicUnited States of America2026-09-01164.24161.3–167.85Closed weights
Claude Fable 5AnthropicUnited States of America2026-06-09163.41160.68–167.1Closed weights
Claude Opus 5AnthropicUnited States of America2026-07-24162.59160.09–165.69Closed weights
GPT-5.5 ProOpenAIUnited States of America2026-04-23162.26159.3–165.37Closed weights
GPT-5.6 SolOpenAIUnited States of America2026-07-09161.76159.53–164.88Closed weights
GPT-5.6 TerraOpenAIUnited States of America2026-07-09159.15156.64–161.84Closed weights
GPT-5.5OpenAIUnited States of America2026-04-23159.14156.91–161.87Closed weights
GPT-5.4 ProOpenAIUnited States of America2026-03-05158.93156.35–161.87Closed weights
Claude Opus 4.8AnthropicUnited States of America2026-05-28158.32156.33–160.46Closed weights
Kimi K3MoonshotChina2026-07-16157.64155.01–160.58Open weights
Gemini 3.7 FlashGoogle DeepMindUnited States of America2026-08-13157.44155.52–160.08Closed weights
GPT-5.4OpenAIUnited States of America2026-03-05156.86155.05–158.79Closed weights
Qwen 3.8 MaxAlibabaChina2026-08-02156.62154.45–158.45Closed weights
GPT-5.3 CodexOpenAIUnited States of America2026-02-05156.59154.13–159.41Closed weights
Claude Opus 4.7AnthropicUnited States of America2026-04-16156.34154.45–158.34Closed weights
Grok 4.6xAIUnited States of America2026-08-12156.34154.57–158.47Closed weights
GPT-5.6 LunaOpenAIUnited States of America2026-07-09156.31153.75–158.49Closed weights
Claude Sonnet 5AnthropicUnited States of America2026-06-30156.23153.39–158.5Closed weights
Muse Spark 1.2Meta AIUnited States of America2026-08-05155.49153.76–158.7Closed weights
DeepSeek V4 Pro 0813DeepSeekChina2026-08-13155.44153.65–157.54Open weights
Claude Opus 4.6AnthropicUnited States of America2026-02-05155.34153.51–157.14Closed weights
GPT-5.2 ProOpenAIUnited States of America2025-12-11155.34153.04–157.88Closed weights
GLM-5.3Z.ai (Zhipu AI)China2026-08-14155.25153.15–157.51Closed weights
Gemini 3.1 ProGoogle DeepMindUnited States of America2026-02-19155152.77–157.56Closed weights
Gemini 3.5 FlashGoogle DeepMindUnited States of America2026-05-19154.69152.76–156.78Closed weights
Muse Spark 1.1Meta AIUnited States of America2026-07-09154.64152.26–157.96Closed weights
DeepSeek V4 Flash 0731DeepSeekChina2026-07-31154.49152.05–156.45Open weights
Gemini 3.6 FlashGoogle DeepMindUnited States of America2026-07-21154.32152.6–156.05Closed weights
Grok 4.5xAIUnited States of America2026-07-08153.92152.32–155.71Closed weights
Qwen3.7-MaxAlibabaChina2026-05-19153.72151.87–155.95Closed weights
GPT-5.2OpenAIUnited States of America2025-12-11153.49151.77–155.17Closed weights
Gemini 3 ProGoogle DeepMindUnited States of America2025-11-18153.01151.16–154.96Closed weights
Claude Sonnet 4.6AnthropicUnited States of America2026-02-17152.29149.78–154.35Closed weights
Muse SparkMeta AIUnited States of America2026-04-08152.13150.18–155.41Closed weights
Grok 4.20xAIUnited States of America2026-02-17152.03149.08–154.45Closed weights
GLM-5.2Z.ai (Zhipu AI)China2026-06-16151.88150.11–153.88Open weights
Gemini 3 FlashGoogle DeepMindUnited States of America2025-12-17151.84150.5–153.45Closed weights
GLM-5.3-FlashZ.ai (Zhipu AI)China2026-08-20151.45148.96–153.42Open weights
Kimi K2.6MoonshotChina2026-04-20151.01149.07–152.65Open weights
GPT-5 ProOpenAIUnited States of America2025-10-07150.28148.77–152.52Closed weights
Inkling-SmallThinking MachinesUnited States of America2026-07-15150.17147.44–151.96Open weights
Claude Opus 4.5AnthropicUnited States of America2025-11-24150.11148.0–152.85Closed weights
Kimi K2.7 CodeMoonshotChina2026-06-12150.1148.39–151.76Open weights
GPT-5OpenAIUnited States of America2025-08-07150Anchor; interval not suppliedClosed weights
GLM-5.1Z.ai (Zhipu AI)China2026-04-07149.73147.65–151.48Open weights
GPT-5.1OpenAIUnited States of America2025-11-13149.65148.34–151.05Closed weights
Qwen 3.6 Max (Preview)AlibabaChina2026-04-20149.3147.55–152.27Other
Grok 4.3 BetaxAIUnited States of America2026-04-17149.18147.59–150.59Closed weights
DeepSeek-V4-ProDeepSeekChina2026-04-24149.1147.29–150.44Open weights
GPT-5.4 MiniOpenAIUnited States of America2026-03-17148.98147.08–150.7Closed weights
InklingThinking MachinesUnited States of America2026-07-15148.64145.93–150.5Open weights
Kimi K2.5MoonshotChina2026-01-27148.03146.24–149.09Open weights
Qwen 3.6 PlusAlibabaChina2026-03-31147.69145.8–149.26Closed weights
o3-proOpenAIUnited States of America2025-06-10147.45145.86–150.15Closed weights
Qwen3.7-PlusAlibabaChina2026-06-02147.42145.83–148.78Other
Qwen3.5 397B-A17BAlibabaChina2026-02-13146.98145.27–148.83Open weights
o3OpenAIUnited States of America2025-04-16146.91144.99–148.44Closed weights
Claude Sonnet 4.5AnthropicUnited States of America2025-09-29146.85145.32–148.21Closed weights
Qwen 3.5 Plus (hosted 397B-A17B)AlibabaChina2026-02-16146.75144.6–147.94Other
MiniMax-M2.5MiniMaxChina2026-02-12146.52138.5–147.57Open weights
Qwen3.6 27BAlibabaChina2026-04-22146.51144.53–147.8Open weights
MiniMax-M3MiniMaxChina2026-06-01146.5142.31–149.19Open weights
Grok 4xAIUnited States of America2025-07-09146.45144.39–148.14Closed weights
Nemotron 3 UltraNVIDIAUnited States of America2026-06-04146.29143.85–148.27Open weights
DeepSeek-V3.2DeepSeekChina2025-12-01146.2144.34–147.39Open weights
DeepSeek-V4-FlashDeepSeekChina2026-04-24146.12143.67–147.87Open weights
GPT-5.4 NanoOpenAIUnited States of America2026-03-17145.87143.46–147.52Closed weights
GLM-5Z.ai (Zhipu AI)China2026-02-11145.87143.94–147.8Open weights
MiniMax-M2.7MiniMaxChina2026-03-18145.81138.38–147.74Open weights
Kimi K2 ThinkingMoonshotChina2025-11-06145.77143.31–147.12Open weights
o4-miniOpenAIUnited States of America2025-04-16145.66143.29–147.27Closed weights
GPT-5 miniOpenAIUnited States of America2025-08-07145.54143.51–147.11Closed weights
Gemini 2.5 Pro (Jun 2025)Google DeepMindUnited States of America2025-06-05145.27143.59–146.71Closed weights
Gemini 3.5 Flash-LiteGoogle DeepMindUnited States of America2026-07-21145.14142.4–146.7Closed weights
DeepSeek-V3.2-ExpDeepSeekChina2025-09-29145.03142.53–147.0Open weights
Qwen3.7 FlashAlibabaChina2026-07-27144.64142.69–147.52Closed weights
Gemini 3.1 Flash-LiteGoogleUnited States of America2026-03-03144.5142.72–145.98Closed weights
Grok 4 FastxAIUnited States of America2025-09-19144.22141.74–146.28Closed weights
Gemini 2.5 Pro (Mar 2025)Google DeepMindUnited States of America2025-03-31144.17141.94–146.84Closed weights
Claude Opus 4.1AnthropicUnited States of America2025-08-05144.12141.76–145.99Closed weights
Qwen 3.5 Flash (hosted 35B-A3B)AlibabaChina2026-02-25144.01141.92–145.67Other
Qwen3-235B-A22B-Thinking (Jul 2025)AlibabaChina2025-07-25143.88141.77–145.36Open weights
Qwen 3.6 35B-A3BAlibabaChina2026-04-14143.87141.31–146.0Open weights
GLM-4.7Z.ai (Zhipu AI)China2025-12-22143.47141.16–145.49Open weights
Qwen 3.6 FlashAlibabaChina2026-04-27143.28140.98–144.78Other
Gemini 2.5 Flash (Sep 2025)Google DeepMindUnited States of America2025-09-25143139.77–146.62Closed weights
Claude Opus 4AnthropicUnited States of America2025-05-22142.68140.58–144.11Closed weights
Gemma 4 31B ITGoogle DeepMindUnited States of America2026-04-02142.68140.28–144.75Open weights
Qwen3.5-35B-A3BAlibabaChina2026-02-24142.54140.22–144.87Open weights
GPT-5.5 InstantOpenAIUnited States of America2026-05-05142.52139.99–145.21Closed weights
Gemini 2.5 Pro (May 2025)Google DeepMindUnited States of America2025-05-06142.48139.15–145.14Closed weights
Qwen3-MaxAlibabaChina2025-09-24142.44140.12–144.73Closed weights
Claude Haiku 4.5AnthropicUnited States of America2025-10-15142.39139.47–144.03Closed weights
Gemma 4 26B A4BGoogle DeepMindUnited States of America2026-04-02141.87138.55–143.58Open weights
o1OpenAIUnited States of America2024-12-17141.87139.83–143.14Closed weights
Claude Sonnet 4AnthropicUnited States of America2025-05-22141.69138.85–143.08Closed weights
Gemini 2.5 Flash (May 2025)Google DeepMindUnited States of America2025-05-20141.55139.51–142.98Closed weights
DeepSeek-R1 (May 2025)DeepSeekChina2025-05-28141.3139.17–142.91Open weights
Mistral Medium 3.5Mistral AIFrance2026-04-28141.29138.78–143.1Open weights
Claude 3.7 SonnetAnthropicUnited States of America2025-02-24141.17139.01–142.68Closed weights
GLM-4.6Z.ai (Zhipu AI),Tsinghua UniversityChina2025-09-30140.79134.21–142.64Open weights
Gemini 2.5 Flash (Jun 2025)Google DeepMindUnited States of America2025-06-17140.53138.18–141.98Closed weights
o3-miniOpenAIUnited States of America2025-01-31140.36137.47–141.8Closed weights
Grok-3 minixAIUnited States of America2025-06-24140.36137.67–142.02Closed weights
Kimi K2 (Jul 2025)MoonshotChina2025-07-12140.12136.65–142.03Open weights
gpt-oss-120bOpenAIUnited States of America2025-08-05140.11135.39–142.42Open weights
Gemini 2.5 Flash (Apr 2025)Google DeepMindUnited States of America2025-04-17139.98136.37–142.05Closed weights
DeepSeek-V3.1DeepSeekChina2025-08-21139.93135.79–143.19Open weights
Qwen3-30B-A3B-Thinking (Jul 2025)AlibabaChina2025-07-30139.65135.15–141.06Open weights
Qwen3.5-9BAlibabaChina2026-02-24139.45136.59–141.07Open weights
GPT-5 nanoOpenAIUnited States of America2025-08-07139.4134.43–141.52Closed weights
Qwen3-235B-A22BAlibabaChina2025-04-28139.36135.59–140.99Open weights
DeepSeek-R1DeepSeekChina2025-01-20138.98136.62–140.38Open weights
Qwen3-235B-A22B-Instruct (Jul 2025)AlibabaChina2025-07-25138.93136.19–140.82Open weights
Qwen3-32BAlibabaChina2025-04-29138.52135.14–140.32Open weights
Grok 3xAIUnited States of America2025-04-09138.3135.61–139.8Closed weights
Qwen3-14BAlibabaChina2025-04-29138.25133.68–139.84Open weights
gpt-oss-20bOpenAIUnited States of America2025-08-05137.81132.89–139.56Open weights
QwQ-32BAlibabaChina2025-03-05137.6133.05–141.72Open weights
DeepSeek-R1-Distill-Qwen-32BDeepSeekChina2025-01-20137.43126.69–138.7Open weights
Qwen3-30B-A3B-Instruct (Jul 2025)AlibabaChina2025-07-29137.43132.32–139.54Open weights
GPT-4.1OpenAIUnited States of America2025-04-14136.8134.21–138.54Closed weights
GPT-4.5OpenAIUnited States of America2025-02-27136.75133.97–138.6Closed weights
Qwen3-30B-A3BAlibabaChina2025-04-29136.19130.82–138.76Open weights
Qwen3-8BAlibabaChina2025-04-28136.18129.58–138.07Open weights
DeepSeek-V3 (Mar 2025)DeepSeekChina2025-03-24135.95132.46–138.04Open weights
o1-miniOpenAIUnited States of America2024-09-12135.83132.4–137.38Closed weights
DeepSeek-R1-Distill-Qwen-14BDeepSeekChina2025-01-20135.43127.36–138.05Open weights
Gemini 2.0 Flash Thinking (Jan 2025)Google DeepMind,GoogleUnited States of America2025-01-21135.37130.11–137.99Closed weights
Gemini 2.0 ProGoogle DeepMindUnited States of America2025-02-05135.06131.28–136.85Closed weights
GPT-4.1 miniOpenAIUnited States of America2025-04-14135.02131.5–136.71Closed weights
o1-previewOpenAIUnited States of America2024-09-12134.79131.47–138.65Closed weights
Gemini 2.0 Flash (Dec 2024)Google DeepMind,GoogleUnited States of America2024-12-11134.71124.35–136.59Closed weights
Gemini 2.0 Flash (Feb 2025)Google DeepMind,GoogleUnited States of America2025-02-05134.69131.46–136.36Closed weights
Mistral Medium 3Mistral AIFrance2025-05-07134.08130.69–135.57Closed weights
Gemini 2.5 Flash-Lite (Jun 2025)Google DeepMindUnited States of America2025-06-17133.93130.4–136.41Closed weights
Claude 3.5 Sonnet (October 2024)AnthropicUnited States of America2024-10-22133.55128.63–137.61Closed weights
Magistral Small 1.0Mistral AIFrance2025-06-10133.19129.42–134.52Open weights
Qwen2.5-MaxAlibabaChina2025-01-25132.54128.45–135.82Closed weights
DeepSeek-V3DeepSeekChina2024-12-26132.35128.05–135.89Open weights
Llama 4 MaverickMeta AIUnited States of America2025-04-06132.2128.31–134.35Open weights
Mistral Small 3.2Mistral AIFrance2025-06-20131.74127.19–133.73Open weights
Gemini 1.5 Pro (Sept 2024)Google DeepMindUnited States of America2024-09-24131.73128.35–133.24Closed weights
Magistral Small 1.2Mistral AIFrance2025-09-18131.41126.27–133.53Open weights
Grok-2 (Dec 2024)xAIUnited States of America2024-12-12130.48126.47–132.12Closed weights
Phi-4Microsoft ResearchUnited States of America2024-12-12130.42125.5–132.1Open weights
Gemma 3 27BGoogle DeepMindUnited States of America2025-03-12130.04124.64–132.17Open weights
Claude 3.5 SonnetAnthropicUnited States of America2024-06-20130Anchor; interval not suppliedClosed weights
Llama 4 ScoutMeta AIUnited States of America2025-04-05129.64124.84–131.45Open weights
GPT-4.1 nanoOpenAIUnited States of America2025-04-14129.62124.04–132.0Closed weights
Gemini 1.5 Flash (Sep 2024)Google DeepMindUnited States of America2024-09-24129.36124.03–131.09Closed weights
Qwen2.5-72BAlibabaChina2024-09-19129123.98–130.7Open weights
GPT-4o (May 2024)OpenAIUnited States of America2024-05-13128.97124.43–131.59Closed weights
GPT-4o (Nov 2024)OpenAIUnited States of America2024-11-20128.81124.92–130.93Closed weights
GPT-4o (Aug 2024)OpenAIUnited States of America2024-08-06128.77124.39–130.6Closed weights
Llama 3.1-405BMeta AIUnited States of America2024-07-23128.75124.39–130.57Open weights
Qwen2.5-32BAlibabaChina2024-09-17128.52123.16–130.09Open weights
Mistral Large 2 (Nov 2024)Mistral AIFrance2024-11-18128.52124.19–130.55Open weights
Mistral Large 2 (Jul 2024)Mistral AIFrance2024-07-24127.54123.07–129.64Open weights
Mistral Small 3.1Mistral AIFrance2025-03-17127.48122.92–129.28Open weights
Llama 3.3 70BMeta AIUnited States of America2024-12-06127.32122.68–129.67Open weights
GPT-4 Turbo (Apr 2024)OpenAIUnited States of America2024-04-09127.25122.46–128.93Closed weights
Claude 3.5 HaikuAnthropicUnited States of America2024-10-22127.15121.02–129.64Closed weights
Mistral Small 3Mistral AIFrance2025-01-30127.07122.41–129.01Open weights
Claude 3 OpusAnthropicUnited States of America2024-02-29126.91121.74–130.11Closed weights
Gemini 1.5 Pro (May 2024)Google DeepMindUnited States of America2024-05-14126.9122.52–129.03Closed weights
GPT-4o miniOpenAIUnited States of America2024-07-18126.56121.2–128.53Closed weights
GPT-4 Turbo (Nov 2023)OpenAIUnited States of America2024-01-25126.45121.78–128.95Closed weights
Llama 3.1-70BMeta AIUnited States of America2024-07-23125.91121.1–128.39Open weights
GPT-4 (Mar 2023)OpenAIUnited States of America2023-03-14125.88120.22–130.04Closed weights
Llama 3.2 90BMeta AIUnited States of America2024-09-24125.5120.49–127.47Open weights
Qwen2-72BAlibabaChina2024-06-07125.27119.75–126.9Open weights
DeepSeek-V2 (MoE-236B, May 2024)DeepSeekChina2024-05-07124.77118.57–127.57Open weights
Amazon Nova ProAmazonUnited States of America2024-12-03123.78107.53–126.62Closed weights
Gemma 3 12BGoogle DeepMindUnited States of America2025-03-12123.46116.21–128.73Open weights
GPT-4 (Jun 2023)OpenAIUnited States of America2023-06-13123.1117.72–126.7Closed weights
Llama 3-70BMeta AIUnited States of America2024-04-18122.91117.38–125.73Open weights
Gemini 1.5 Flash (May 2024)Google DeepMindUnited States of America2024-05-23122.57116.81–124.7Closed weights
Gemma 2 27BGoogle DeepMindUnited States of America2024-06-24122.05115.94–124.18Open weights
Mixtral 8x22BMistral AIFrance2024-04-17122115.86–124.39Open weights
Mistral LargeMistral AIFrance2024-02-26121.99114.74–124.93Closed weights
phi-3-small 7.4BMicrosoftUnited States of America2024-04-23121.8114.95–124.24Open weights
phi-3-medium 14BMicrosoftUnited States of America2024-04-23121.19115.17–123.87Open weights
Claude 3 SonnetAnthropicUnited States of America2024-02-29120.68113.89–123.5Closed weights
Claude InstantAnthropicUnited States of America2023-08-09120.21113.43–122.93Closed weights
Claude 2AnthropicUnited States of America2023-07-11120.09114.21–123.8Closed weights
Gemma 2 9BGoogle DeepMindUnited States of America2024-06-24119.8112.44–122.31Open weights
Qwen2.5-Coder-32BAlibabaChina2024-09-18119.43110.31–125.07Open weights
Command R+Cohere,Cohere Labs (formerly Cohere for AI)Canada2024-08-30119.25110.28–125.06Open weights
Claude 2.1AnthropicUnited States of America2023-11-21119.22113.07–121.92Closed weights
Mistral NeMoMistral AIFrance2024-07-18118.65111.96–121.85Open weights
GPT-3.5 Turbo (Nov 2023)OpenAIUnited States of America2023-11-06118.5108.73–121.55Closed weights
Qwen2.5-7BAlibabaChina2024-09-19118.45111.07–121.28Open weights
Mixtral 8x7BMistral AIFrance2023-12-11118.4111.79–121.15Open weights
Claude 3 HaikuAnthropicUnited States of America2024-03-07118.3111.75–121.5Closed weights
Ministral 3BMistral AIFrance2024-10-16118.06107.01–121.85Closed weights
Yi-34B01.AIChina2023-11-02117.31108.1–120.22Open weights
phi-3-mini 3.8BMicrosoftUnited States of America2024-04-23117.27109.44–120.54Open weights
Stable Beluga 2Stability AIUnited Kingdom2023-07-20117.02110.39–120.14Open weights
Gemini 1.0 ProGoogle DeepMindUnited States of America2023-12-13116.97110.31–119.74Closed weights
Llama 3.1-8BMeta AIUnited States of America2024-07-23116.51105.95–121.71Open weights
Llama 3-8BMeta AIUnited States of America2024-04-18116.36108.36–119.1Open weights
Qwen2.5-Coder-14BUnknownUnknown2024-09-18116.3106.61–122.34Other
Gemma 3 4BGoogle DeepMindUnited States of America2025-03-12115.9797.45–123.39Open weights
GPT-3.5 Turbo (Jan 2024)OpenAIUnited States of America2024-01-25115.62107.2–119.14Closed weights
PaLM 2-LUnknownUnknown2023-05-17114.9105.47–127.71Other
Llama 2-70BMeta AIUnited States of America2023-07-18113.65106.09–117.31Open weights
GPT-3.5 Turbo (Jun 2023)OpenAIUnited States of America2023-06-13113.21105.97–117.89Closed weights
Qwen2.5-Coder (7B)AlibabaChina2024-09-18113101.97–118.44Open weights
Qwen-14BAlibabaChina2023-09-24112.88105.14–117.16Open weights
Mistral 7B v0.1Mistral AIFrance2023-09-27112.05103.93–116.19Open weights
Falcon-180BTechnology Innovation InstituteUnited Arab Emirates2023-09-06111.97104.16–118.52Open weights
internlm-20bUnknownUnknown2023-09-18111.92103.27–117.01Other
Gemma 7BGoogle DeepMindUnited States of America2024-02-21111.82103.19–116.2Open weights
DeepSeek LLM 67BDeepSeekChina2023-11-29110.5593.83–117.03Open weights
LLaMA-65BMeta AIUnited States of America2023-02-24109.98102.15–114.27Open weights
Falcon 2 11BTechnology Innovation InstituteUnited Arab Emirates2024-05-09109.36101.39–115.43Open weights
Mistral 7B v0.3Mistral AIFrance2024-05-27108.8198.65–112.44Open weights
DeepSeek-Coder-V2-Lite-BaseUnknownUnknown2024-06-13108.6899.7–113.87Other
PaLM 2-MUnknownUnknown2023-05-17108.0899.26–115.99Other
Phi-2MicrosoftUnited States of America2023-12-12107.7388.55–113.35Open weights
Qwen2.5-Coder-3BUnknownUnknown2024-09-18107.5294.3–115.58Other
Nemotron-4 15BNVIDIAUnited States of America2024-02-26107.4999.12–112.96Closed weights
Yi-9BUnknownUnknown2024-03-01107.3998.62–114.57Other
LLaMA-33BMeta AIUnited States of America2023-02-24107.1899.0–112.24Open weights
Qwen-7BAlibabaChina2023-09-28106.5995.55–112.2Open weights
Llama 2-13BMeta AIUnited States of America2023-07-18105.9396.7–111.03Open weights
PaLM 2-SUnknownUnknown2023-05-17105.9297.66–113.71Other
Llama 2-34BMeta AIUnited States of America2023-07-18104.9495.48–110.32Closed weights
StarCoder 2 15BHugging Face,ServiceNow,NVIDIA,BigCodeUnited States of America2024-02-20104.7492.95–111.43Open weights
Yi 6B01.AIChina2023-11-22104.5195.54–110.28Open weights
Falcon-40BTechnology Innovation InstituteUnited Arab Emirates2023-05-25104.1894.62–109.74Open weights
Baichuan2-13BBaichuanChina2023-09-06102.9191.79–110.02Open weights
Qwen2.5-Coder (1.5B)AlibabaChina2024-09-18102.7188.02–110.25Open weights
internlm-7bUnknownUnknown2023-07-05102.5891.92–109.22Other
Llama 3.2 1BMeta AIUnited States of America2024-09-24102.4391.24–109.91Open weights
INTELLECT-1Prime Intellect,Hugging Face,Arcee AIUnited States of America2024-11-29100.5590.42–106.13Other
MPT-30BMosaicMLUnited States of America2023-06-22100.3490.51–106.09Open weights
LLaMA-13BMeta AIUnited States of America2023-02-24100.2689.93–106.41Open weights
Llama 2-7BMeta AIUnited States of America2023-07-1898.7288.42–105.23Open weights
chatglm2-6bUnknownUnknown2023-06-2498.683.28–105.31Other
LLaMA-7BMeta AIUnited States of America2023-02-2496.3285.32–103.57Open weights
Baichuan 2-7BBaichuanChina2023-09-2095.9585.1–104.4Open weights
DeepSeek Coder 33BDeepSeek,Peking UniversityChina2023-11-0295.9483.94–102.96Open weights
Falcon-7BTechnology Innovation InstituteUnited Arab Emirates2023-04-2494.783.52–101.96Open weights
CodeQwen1.5-7BUnknownUnknown2024-04-1594.4681.41–102.8Other
vicuna-13b-v1.1UnknownUnknown2023-04-1294.2680.79–102.31Other
MPT-7BMosaicMLUnited States of America2023-05-0594.1981.83–101.65Open weights
Gemma 2BGoogle DeepMindUnited States of America2024-02-2193.882.78–100.32Open weights
StarCoder 2 7BHugging Face,ServiceNow,NVIDIA,BigCodeUnited States of America2024-02-2093.1577.74–101.69Open weights
XGen-7BSalesforceUnited States of America2023-06-2792.9882.08–100.15Open weights
Qwen-1_8BUnknownUnknown2023-11-3092.5170.92–100.95Other
open_llama_7bUnknownUnknown2023-06-0791.2179.11–99.45Other
Phi-1.5MicrosoftUnited States of America2023-09-1191.0868.51–100.38Open weights
Baichuan1-7BBaichuanChina2023-06-0190.0177.3–98.98Open weights
RedPajama-INCITE-7B-BaseUnknownUnknown2023-05-0489.9676.67–98.05Other
Dolly 2.0-12bDatabricksUnited States of America2023-04-1189.275.7–97.11Open weights
DeepSeek Coder 6.7BDeepSeek,Peking UniversityChina2023-11-0289.1575.47–97.29Open weights
StarCoder 2 3BHugging Face,ServiceNow,NVIDIA,BigCodeUnited States of America2024-02-2288.2873.61–97.17Open weights
Qwen2.5-Coder-0.5BUnknownUnknown2024-09-1887.6662.09–99.7Other
Cerebras-GPT-13BCerebras SystemsUnited States of America2023-03-2082.6867.57–91.55Open weights
DeepSeek Coder 1.3BDeepSeek,Peking UniversityChina2023-11-0262.7346.12–76.59Open weights
stablelm-tuned-alpha-7bUnknownUnknown2023-04-1954.8331.39–72.75Other

Download reviewed model snapshot ↗ · Dataset licensing & original authors ↗