> ## Content Index
> Fetch the complete content index at: https://aiadoption.org/llms.txt
> Use this file to discover other available public pages before exploring further.

# Gemini 2.5 Pro scored 38.8% on PaperArena as a multi-agent system, the best of nine models tested
- URL: https://aiadoption.org/data/paperarena-single-vs-multi-agent/
- Published: 2026-10-19T16:36:57.000Z
- Updated: 2026-10-21T06:05:15.000Z
- Description: On PaperArena, which asks agents to answer research questions using several papers and tools, Gemini 2.5 Pro scored 38.8% as a multi-agent system. The AI Index puts PhD experts at 83.5%.
- Author: Manu
- Tags: Data, AI Research, AI Agents, #chart, #ai-index-2026, #hub-research, #topic-ai-agents

38.8%

#1 of 9

Gemini 2.5 Pro's PaperArena accuracy as a multi-agent system, 36.1% as a single agent; the AI Index reports a PhD expert baseline of 83.5%

Multi-agent accuracy

Gemini 2.5 Pro38.8%

OpenAI o4-mini-high37.4%

Claude Sonnet 436.7%

## What the chart shows

PaperArena asks AI agents to answer research questions that need evidence from several papers, using external tools for parsing, retrieval and calculation. Gemini 2.5 Pro scored best, with 38.8% average accuracy in a multi-agent set-up, ahead of OpenAI’s o4-mini-high (37.4%) and Claude Sonnet 4 (36.7%). The AI Index reports a PhD expert baseline of 83.5%.

Every model scored higher with several agents than with one, by between 2.5 and 5.4 percentage points. Kimi-K2-Instruct scored lowest in both set-ups, at 22.3% alone and 26.3% with several agents.

## Key numbers

| Measure                          | Value  |
| -------------------------------- | ------ |
| Gemini 2.5 Pro, multi-agent      | 38.78% |
| Gemini 2.5 Pro, single agent     | 36.10% |
| OpenAI o4-mini-high, multi-agent | 37.37% |
| Claude Sonnet 4, multi-agent     | 36.73% |
| Kimi-K2-Instruct, multi-agent    | 26.28% |
| Kimi-K2-Instruct, single agent   | 22.32% |

## How to read it

- Accuracy is the share of PaperArena questions answered correctly (Wang et al., 2026).
- The PhD expert baseline (83.5%) is from the AI Index text; it is not in the data file.
- The AI Index text says multi-agent gains were typically 2 to 4 percentage points; in the data they range from 2.5 to 5.4 points. We use the data.

**Source:** [Wang et al.](https://aiadoption.org/sources/#wang-2025-paperarena), 2026, via the AI Index Report 2026 (Stanford HAI), figure 5.3.2: *PaperArena: single vs. multiagent performance*. Chart and text by AI Adoption.  
Numbers checked against the published data on 20 October 2026.  
[Download the data (CSV)](https://charts.aiadoption.org/ai-index/csv/paperarena-single-vs-multi-agent.csv?ref=aiadoption.org) · [Cite this chart](#source)