Metaculus
Metaculus is an online forecasting platform that aggregates quantitative predictions on topics of global importance, including AI progress, biosecurity, climate change, and geopolitics. Structured as a public benefit corporation, it uses reputation-based scoring rather than real-money betting to incentivize accurate forecasting.
Score generated by AI agents based on publicly cited evidence and reviewed by the project maintainer. Not independently validated.
Score History
Timeline events are AI-curated from public reporting. Score trajectory is derived from documented events.
Metaculus launched as a niche science and technology prediction platform built by three academics. The platform had no formal governance structure, no revenue model, and minimal users. Small-scale and volunteer-run, it had inherent limitations in algorithmic transparency (the aggregation method was undisclosed) and user switching costs (no API, no data export), but the minimal footprint meant minimal potential for harm.
After launching the Metaculus Prediction aggregation system in mid-2017, the platform grew steadily but remained a small-scale academic project without institutional backing. The proprietary Metaculus Prediction algorithm added a layer of algorithmic opacity (users could see the output but not the weighting methodology), while accumulating prediction histories began creating soft lock-in. Community governance was informal, and the platform had no formal revenue model.
COVID-19 transformed Metaculus from a niche academic platform into a consequential forecasting tool. The Li Wenliang Prize, pandemic subdomain, and pro-bono public health forecasting demonstrated the platform's value at scale. Community predictions outperformed expert models on some COVID metrics. However, rapid growth amplified existing issues: scoring rule controversies surfaced in community discussions, the proprietary aggregation remained opaque, and growing prediction histories deepened lock-in.
Metaculus became a Public Benefit Corporation, secured $5.5M from Open Philanthropy, and reached 1 million predictions. Institutional partnerships expanded through the biosecurity tournament, Red Lines in Ukraine project, and Improve the News collaboration. The $20,000 FTX Future Fund grant shortly before FTX's collapse introduced minimal but nonzero association with the EA funding crisis. Scoring system complexity drew community criticism, and the platform's growing reliance on Open Philanthropy funding concentrated governance risk slightly.
The complete platform rewrite and open-sourcing under BSD-2-Clause license was a transformative moment for transparency and interoperability. The codebase became publicly inspectable, a dozen organizations forked it, and a third of code contributors became external. New Peer and Baseline scores addressed scoring controversies. The orderly CEO transition from Dempsey to Turan showed governance maturity. The CDC partnership for respiratory disease forecasting marked a new level of institutional credibility.
Metaculus has matured into a well-established forecasting public good with 40,000+ forecasters, CDC and GiveWell partnerships, and the FutureEval AI benchmarking program. The Bridgewater contest attracted 17,000+ competitors (10x year-over-year growth) and international expansion reached Spanish, Portuguese, Czech, and Chinese speakers. Open-source codebase, public API, and constructive competitive behavior keep scores extremely low. Remaining minor concerns include scoring system complexity, soft lock-in from accumulated track records, and mild GDPR considerations for European users.
Alternatives
CFTC-regulated prediction market using real USD. Legal in the US with straightforward deposit/withdrawal. Covers politics, economics, and current events. Scored 28 here (Early Warning). Good if you want financial skin in the game, but lacks Metaculus's long-horizon scientific and AI forecasting focus.
Real-money prediction market using cryptocurrency, offering financial incentives for accuracy. Much larger market for political and current events questions. Very different model — requires crypto wallet and financial risk. Scored 38 here (Actively Enshittifying). Not a direct replacement for Metaculus's calibration-focused, non-monetary approach.
Play-money prediction market with a social, gamified interface. Lower barrier to entry than real-money markets and more casual than Metaculus. Open source with active community. Easy switch — just sign up. Lacks Metaculus's institutional partnerships and academic rigor but offers faster market creation and resolution.
Dimensional Breakdown
Summaries below were written by AI agents based on the cited evidence. They are editorial interpretations, not independent research findings.
Dimension History
Timeline (38 events)
Metaculus Founded by Three Academic Scientists
Astrophysicist Anthony Aguirre (UC Santa Cruz, co-founder of Future of Life Institute), cosmologist Greg Laughlin (Yale), and data scientist Max Wainwright launched Metaculus as a reputation-based prediction platform focused on science and technology questions. The platform was designed to aggregate probabilistic forecasts from the public without real-money betting.
Yale News Features Metaculus Prediction Capabilities
Yale News profiled Metaculus as a novel prediction platform, highlighting its early successes: the community correctly predicted the LIGO gravitational wave discovery announcement, AlphaGo's defeat of a professional Go player, and the non-discovery of a new particle at the Large Hadron Collider. The platform was positioned as filling a gap between polling and prediction markets with its science-focused approach.
Metaculus Prediction Aggregation System Launched
Metaculus introduced its proprietary 'Metaculus Prediction' system, a skill-weighted forecast aggregation that outperforms the simple community median. The system weights forecasts based on forecasters' past performance and applies extremization to compensate for systematic human cognitive biases. This became the platform's core differentiator from simple polling or unweighted averages.
Open Philanthropy Awards First $100,000 Grant to Metaculus
Open Philanthropy recommended a $100,000 contract with Metaculus to support forecasting work related to the future of machine learning, falling within their focus on potential risks from advanced AI. This was Metaculus's first grant from a major funder and marked a shift from purely volunteer-run operations toward institutional backing.
Metaculus Introduces Community Moderator Elections
Metaculus launched its first elected community moderator program, allowing users to vote for moderators who would be responsible for reviewing user-submitted questions, mediating resolution disputes, and guiding community discussions. Moderators were reviewed every six months, establishing a grassroots governance model.
Li Wenliang Prize Series Launched for COVID-19 Forecasting
Metaculus launched the Li Wenliang Prize Series, named after the Chinese ophthalmologist who first warned about COVID-19, to incentivize accurate pandemic forecasting. The first tournament ran from February 17 to June 17, 2020, with prizes for forecasting accuracy, question writing, and community contributions. This marked the beginning of Metaculus's rapid pandemic-era growth.
Pandemic Subdomain Launched as COVID Forecasting Hub
Metaculus created pandemic.metaculus.com as a dedicated subdomain for COVID-19 questions, allowing fine-grained pandemic forecasting without overwhelming the main site. The platform created a consolidated prediction dashboard with interactive visualizations and time series data, providing pro-bono predictions to frontline public health organizations.
Metaculus COVID Forecasters Outperform Expert Models
By early May 2020, Metaculus forecasters predicted a median of 197,000 U.S. COVID-19 deaths by end of 2020, with the actual figure proving close to this estimate. A PLOS ONE study later found that a group on Metaculus outperformed expert infectious disease models on multiple COVID-related forecasts, validating the platform's aggregation approach during a crisis.
Gaia Dempsey Appointed CEO of Metaculus
Gaia Dempsey became CEO of Metaculus after joining the organization in 2019, drawn by the founding group of scientists. Under her leadership, the platform would transition from a small academic project to an institutionally backed public benefit corporation, securing major grants and building partnerships with government agencies.
EA Infrastructure Fund Awards $308,000 Grant to Metaculus
The Effective Altruism Infrastructure Fund awarded two grants totaling $308,043 to Metaculus to support 6 staff members (3.15 FTEs). The funding enabled EA-relevant forecasting tournaments, an annual impact survey, a full-time EA question author, and prize pools for EA-related competitions and fortified essays.
Metaculus Launches API for External Developer Access
Metaculus introduced public API access, enabling researchers and external tools to query and analyze its database of aggregate forecasts across thousands of questions. The API returns question data, forecast distributions, and resolution information, significantly reducing lock-in by allowing data portability.
Ukraine Conflict Forecasting Tournament Launched
Just 48 hours after Russia invaded Ukraine, Metaculus launched a forecasting tournament to monitor the conflict, with the community rapidly producing probabilistic assessments of outcomes including nuclear risk, territorial changes, and conflict duration. The platform's speed in establishing structured forecasting during a crisis demonstrated its operational maturity.
Open Philanthropy Awards $5.5 Million Grant to Metaculus
Open Philanthropy recommended a $5,500,000 grant to Metaculus for platform development and high-impact forecasting programs on AI, biosecurity, climate change, and nuclear security. This was the platform's largest funding round by far, enabling significant hiring, infrastructure improvements, and expansion of forecasting programs.
Metaculus Restructures as Public Benefit Corporation
Metaculus formally became a Public Benefit Corporation, embedding its public interest mission into its corporate charter. The charter commits to fostering forecasting communities, supporting stakeholders serving the public good, and increasing public access to forecasts of public interest. This restructuring was announced alongside reaching 1 million individual predictions.
Metaculus Reaches One Million Individual Predictions
Metaculus surpassed 1,000,000 individual predictions across more than 7,000 questions, marking a significant growth milestone. Monthly forecaster participation had grown 80% relative to 2021. The milestone demonstrated the platform's scaling beyond its academic origins into a substantial forecasting community.
FTX Future Fund Awards $20,000 Grant Shortly Before Collapse
Metaculus received a $20,000 grant from the FTX Future Fund in October 2022, three weeks before FTX's bankruptcy in November. The grant was minimal relative to Metaculus's other funding sources, and the platform was not materially entangled in the resulting legal proceedings. The incident highlighted the governance risk of EA ecosystem funding concentration.
Red Lines in Ukraine Nuclear Early-Warning Project Deployed
Metaculus partnered with nuclear security expert Peter Scoblic of New America to deploy the Red Lines in Ukraine project, using conditional forecasting as an early-warning system for potential Russian nuclear use. The project tracked whether Western aid crossing Putin's stated red lines would escalate to nuclear weapons use, with forecasts declining from approximately 10% to 2% over the project's duration.
Biosecurity Tournament Launched with Institute for Progress
Metaculus executed a $25,000 Biosecurity Tournament with the Institute for Progress and Guarding Against Pandemics, the first forecasting tournament focused on mapping future biosecurity risks. The multi-year tournament aimed to direct resource allocation to highest-impact interventions and focused on global catastrophic biological risks.
Forecasting Our World in Data Tournament Launches
Metaculus launched the Forecasting Our World in Data tournament with support from the FTX Future Fund, collecting forecasts on 30 Our World in Data metrics including CO2 emissions, supercomputer performance, and nuclear stockpiles over 1 to 100-year horizons. A $20,000 prize pool was offered and 20 Pro Forecasters participated alongside the public community.
Metaculus Partners with Improve the News for Embedded Forecasts
Metaculus collaborated with physicist Max Tegmark's Improve the News platform (later rebranded Verity) to embed prediction data in over 800 news articles. The partnership brought forecasting context to fast-moving news stories, helping readers understand probabilities around events described in the articles.
Conditional Pair Questions Feature Introduced
Metaculus launched conditional pair questions, enabling forecasters to predict the probability of an event conditional on another event's outcome. The feature allows users to make explicit their mental models of causal relationships between events, a capability previously unavailable on the platform. Initially only admins could create conditional questions.
Conditional Continuous Questions Expand Forecasting Toolkit
Metaculus extended conditional questions to continuous variables, enabling forecasters to predict distributions conditional on binary outcomes. For example, forecasters could now predict when Mars landing would occur conditional on SpaceX reaching orbit vs. not reaching orbit, making implicit probabilistic relationships explicit and scoreable.
Academic Study Validates Metaculus Forecasting Accuracy
An academic paper published on arXiv analyzed Metaculus's forecasting skill, finding that the platform's aggregated predictions demonstrated proper calibration and outperformed baselines on exchange rate forecasts. The study provided independent scholarly validation of Metaculus's aggregation methodology and community forecasting quality.
New Forecast Scores, Leaderboard, and Medals System Introduced
Metaculus overhauled its scoring system, replacing legacy Metaculus Points with new Peer and Baseline scores. Peer scores measure performance relative to other forecasters (average is 0), while Baseline scores track absolute accuracy. New medals recognize multiple contribution types including forecasting and commenting. The changes addressed long-standing community concerns about the scoring system.
Peer-Score-Based Tournament Scoring Replaces Legacy System
Metaculus introduced a new tournament scoring method based on Peer scores, where tournament rank equals the sum of weighted Peer scores across all questions. This replaced the previous scoring system and was described as clearer, more consistent, and better at rewarding forecasting skill across more participants.
CEO Transition: Deger Turan Succeeds Gaia Dempsey
Metaculus announced an orderly leadership transition with Deger Turan becoming CEO and Gaia Dempsey moving to Special Advisor and board member. Dempsey had led Metaculus for three and a half years. Turan previously led the AI Objectives Institute and founded Cerebra, a platform forecasting trends in public discourse for over 300 million people.
Metaculus Open-Sources Entire Codebase Under BSD-2-Clause
Metaculus released its complete rewritten codebase under the BSD-2-Clause open source license, making the full platform code publicly available on GitHub. A dozen organizations forked the repository, and a third of code contributors became external to the organization. This was the culmination of a massive rewrite that modernized the platform and dramatically accelerated feature development.
2024 International Elections Hub Launched with El Pais Journalist
Metaculus launched the 2024 International Elections Hub in partnership with journalist Kiko Llaneras of El Pais, covering outcomes in a historic year where countries representing half the world's population held elections. The initiative expanded Metaculus's international reach and demonstrated the platform's value for political forecasting beyond US-centric questions.
CDC Includes Metaculus Forecasts in Respiratory Disease Outlook
The CDC for the first time included Metaculus aggregate probability estimates in its 2024-2025 Respiratory Disease Season Outlook. Nineteen subject-matter experts collaborated with Metaculus Pro Forecasters on questions about COVID-19, influenza, and RSV hospitalization forecasts. This marked a milestone in institutional adoption of crowd forecasting for public health policy.
AI Forecasting Benchmark Tournament Series Begins
Metaculus launched the AI Forecasting Benchmark Tournament series, running quarterly competitions (Q3 2024, Q4 2024, and continuing) with $30,000 prize pools per season. The tournaments pit AI forecasting bots against human forecasters, with Pro Forecasters winning every season so far. Bot makers must share their code, enabling open benchmarking.
Good Judgment Inc and Metaculus Launch First Collaboration
Metaculus and Good Judgment Inc, two of the largest human judgment forecasting communities, announced their first collaboration comparing results and methodologies on identical forecasting questions about Our World in Data metrics. Cohorts of Superforecasters and Metaculus Pro Forecasters made predictions on technological advances, global development, and social progress.
Automatic Translation Introduced for Four Languages
Metaculus introduced automatic translation into Spanish, Portuguese, Czech, and Chinese as part of its international expansion efforts. The feature made the platform more accessible to non-English speakers and supported the launch of language-specific tournaments in Spanish and Portuguese.
Bridgewater Contest Attracts 17,000+ Competitors Globally
The Bridgewater x Metaculus Forecasting Contest registered over 17,000 competitors globally in 2025, more than 10x the prior year's count. The contest tested probabilistic forecasting across binary, continuous, multiple choice, and conditional question types, with a $30,000 prize pool and potential career opportunities at Bridgewater for top performers.
ACX 2025 Prediction Contest Draws Over 3,000 Forecasters
The Astral Codex Ten 2025 prediction contest, hosted on Metaculus with questions curated by Scott Alexander, became the platform's fastest-growing series with over 3,000 forecasters, double the prior year's turnout. The contest includes a $10,000 prize pool and features AI bots competing alongside human forecasters.
First Portuguese-Language Tournament Launched in Brazil
Metaculus launched its first Portuguese-language forecasting tournament with $1,500 in prizes, developed in collaboration with a leading Rio de Janeiro tech journalist. The tournament welcomed thousands of Brazilian forecasters to the platform, marking significant international expansion beyond English-speaking markets.
GiveWell Partnership for Charity Impact Forecasting
Metaculus partnered with GiveWell to improve charity funding decisions through forecasting. The collaboration invited forecasters to share reasoning to help GiveWell find charities delivering the greatest impact per dollar, with a $5,500 comment prize for insights that could sharpen GiveWell's grant outcome expectations.
Metaculus Cup Series Launched with $5,000 Prize Pool
Metaculus launched the Metaculus Cup series as an evolution of the Quarterly Cup tournaments, running three four-month tournaments annually (spring, summer, fall) with $5,000 prize pools. Each tournament adds new current-events questions weekly and rewards both forecasting accuracy and insightful commenting.
FutureEval Benchmark for AI Forecasting Accuracy Launched
Metaculus launched FutureEval, a continuously updated benchmark measuring how accurately AI systems predict real-world events compared to human forecasters. The benchmark spans science, technology, health, geopolitics, and AI, with $175,000 in annual Bot Tournament prizes. Current projections suggest AI could surpass the community by April 2026 and Pro Forecasters by mid-2027.