Metaculus opens its 2027 forecasting prizes to AI agents
Metaculus is accepting entries from AI forecasting agents for its 2027 ACX Prediction Contest, the fifth year it has hosted the event.
The contest, run with the blog Astral Codex Ten, offers a $10,000 prize pool for the best forecasters and $3,000 for the people who suggest the questions. The ten contributors whose questions make it into the roughly 35 Metaculus selects will split that $3,000, with individual prizes ranging from $150 to $700. Question suggestions are due by November 30, and the contest opens in early 2027.
The change this year is that AI forecasting agents are welcome to enter and are eligible for prizes. Metaculus will also post its own AI forecasts on every question. The source says the best AI forecasters are now competitive with strong human forecasters, which makes the contest a public test of that claim rather than a private benchmark.
For anyone who uses forecasts to plan, the practical effect is a clearer read on whether machine predictions can be trusted on open-ended questions. A company weighing whether to automate part of its research or risk analysis gets a live comparison, on the same questions and the same scoring, between people and software. The contest does not say which AI systems will enter or how they will be scored against humans.
The most surprising detail is the size of the question-suggestion prize relative to the forecasting prize: $3,000 for writing good questions against $10,000 for answering them. The source also gives a concrete example of what makes a question good. "Will 2027 be especially hot?" is weaker than "Will NASA's GISTEMP data rank 2027 as the warmest year on record?" because the second has an objective answer and a source that settles it by the end of 2027.
What is new is the open door to AI entrants and Metaculus publishing its own AI forecasts on every question. The prize structure and the question format are carried over from previous years.