About Factorio Learning Environment
Definition and scoring
- Organisation
- Jack Hopkins et al.
- Category
- Agents
- Version
- Not evaluated
- Direction
- higher is better
- Ranking use
- Reference
- Contamination risk
- Low
Long-horizon agentic engineering evaluation inside Factorio factories, testing planning, tool use, and multi-hour progress. Results stay tied to the exact model variant and evaluation system. Multiple systems for the same model use the best published score on this page; overall Lumina scoring uses the median of ranking-eligible rows.
Open benchmark source ↗