> ## Content Index
> Fetch the complete content index at: https://aiadoption.org/llms.txt
> Use this file to discover other available public pages before exploring further.

# Arabic.AI's LLM-X topped HELM Arabic with a mean score of 0.86, ahead of Gemini 2.5 Flash at 0.82
- URL: https://aiadoption.org/data/helm-arabic-llm-scores/
- Published: 2026-10-19T17:08:14.000Z
- Updated: 2026-10-20T22:56:18.000Z
- Description: On HELM Arabic, Arabic.AI's LLM-X scored 0.86, ahead of Gemini 2.5 Flash (0.82) and GPT-5.1 (0.81). Scores of the 29 models ranged down to 0.37.
- Author: Manu
- Tags: Data, AI Benchmarks, Large Language Models, #chart, #ai-index-2026, #hub-benchmarks

0.86

#1 of 29

mean HELM Arabic score of Arabic.AI's LLM-X, the highest of 29 models; Gemini 2.5 Flash 0.82, GPT-5.1 0.81

Arabic.AI LLM-X0.86

Gemini 2.5 Flash0.82

GPT-5.10.81

## What the chart shows

HELM Arabic, built by Stanford’s Center for Research on Foundation Models with Arabic.ai, averages model performance across seven Arabic-language benchmarks covering academic assessment, grammar and region-specific safety. Of the 29 models evaluated, Arabic.AI’s LLM-X, a regionally developed model, scored highest at 0.86, ahead of Gemini 2.5 Flash (0.82) and GPT-5.1 (0.81).

The 15 models the AI Index groups under 2025 scored between 0.69 and 0.86\. Among the 14 grouped under 2024, Arabic-focused models such as Jais and AceGPT ranged from 0.53 to 0.74, and Falcon3-7B-Instruct scored lowest at 0.37.

## Key numbers

| Measure              | Value |
| -------------------- | ----- |
| Arabic.AI LLM-X      | 0.863 |
| Gemini 2.5 Flash     | 0.817 |
| GPT-5.1 (2025-11-13) | 0.809 |
| GPT-4.1 (2025-04-14) | 0.805 |
| Falcon3-7B-Instruct  | 0.37  |

## How to read it

- The score is HELM’s mean across seven Arabic-language benchmarks, from 0 to 1.
- The AI Index groups the models into 2024 and 2025; the year is in the data file.
- Results apply to these 29 models on these benchmarks. The AI Index notes that rankings from English-centric evaluations do not necessarily hold when benchmarks reflect local usage, dialect and cultural references.

**Source:** [HELM](https://aiadoption.org/sources/#helm-arabic), 2026, via the AI Index Report 2026 (Stanford HAI), figure 3.7.5: *HELM Arabic: mean score*. Chart and text by AI Adoption.  
Numbers checked against the published data on 20 October 2026.  
[Download the data (CSV)](https://charts.aiadoption.org/ai-index/csv/helm-arabic-llm-scores.csv?ref=aiadoption.org) · [Cite this chart](#source)