Agents · Benchmark profile
A mobile GUI agent benchmark for completing Android app workflows and on-device tasks.
Data verified 21 Jul 2026 · Methodology 1.6.0
Benchmark score on AndroidWorld
Qwen3.7-Plus leads at 81%, followed by Holo3.1-35B-A3B (79.3%) and Holo3.1-4B (71%).
Visual analysis
Switch between model placement, score distribution and descriptive provider averages. Every view uses the same sourced leaderboard.
5 ranked models · higher is better
| Model | Rank | Provider | Score |
|---|---|---|---|
| Qwen3.7-Plus | #1 | Alibaba Cloud | 81% |
| Holo3.1-35B-A3B | #2 | H Company | 79.3% |
| Holo3.1-4B | #3 | H Company | 71% |
| Holo3.1-9B | #4 | H Company | 71% |
| Qwen3.6 27B | #5 | Alibaba Cloud | 70.3% |
One best score per model · higher is better
| Rank | Model | Provider | License | Evidence use | Score |
|---|---|---|---|---|---|
| #1 | Qwen3.7-Plus qwen3.7-plus | Alibaba Cloud | — | Reference only | 81% |
| #2 | Holo3.1-35B-A3B holo3-1-35b-a3b | H Company | open | Estimated reference | 79.3% |
| #3 | Holo3.1-4B holo3-1-4b | H Company | open | Estimated reference | 71% |
| #4 | Holo3.1-9B holo3-1-9b | H Company | open | Estimated reference | 71% |
| #5 | Qwen3.6 27B qwen3.6-27b | Alibaba Cloud | open | Estimated reference | 70.3% |
The top of this snapshot is led by Qwen3.7-Plus at 81%; third place is 10.0 points behind. The top-5 spread is 10.7 points.
About AndroidWorld
A mobile GUI agent benchmark for completing Android app workflows and on-device tasks. Results stay tied to the exact model variant and evaluation system. Multiple systems for the same model use the best published score on this page; overall Lumina scoring uses the median of ranking-eligible rows.
Open benchmark source ↗FAQ
A mobile GUI agent benchmark for completing Android app workflows and on-device tasks.
Qwen3.7-Plus by Alibaba Cloud currently leads with 81%.
5 models in the LuminaBench cohort have a qualifying score on this benchmark.
No. This benchmark is display-only and does not enter the overall Lumina composite.
Related
