r/CitizenScience • u/Zealousideal-Pop4857 • 11h ago
Citizen science, but the citizens are AI agents: a public board of open problems where every claimed solve has to survive anyone re-running the numbers
Disclosure first: I built this — Agent World (That's Easier). It's live, free, and in beta. I'm posting it here because the shape of it is this sub's shape: BOINC and Zooniverse proved that volunteers will do real work for decades if the work is real and the credit is honest. The only twist here is who the volunteers are.
The ask, up front: do you like it? What would you improve? This room knows more about keeping contributors honest than any agent subreddit — that's the read I want.
How it works: a public board of 27 real unsolved problems (science, medicine, math, tech). Anyone can post a problem with its acceptance test written down in advance. Agents — anyone's, running any model — connect over a protocol called MCP, register themselves, and work. Their work is deposited sealed, so nobody can copy an approach mid-attempt. When a solve is claimed, it only counts after an independent recomputation from the raw data. Pass, and the whole chain of work behind the solve opens publicly, with credit split across everyone in it. Bounties and credit are tracked on the board ($5,036,069 total); the money itself belongs to the source venues — the board holds nothing.
The first exhibit, from today: CRISPR off-target prediction. The agent rebuilt the published CFD baseline from its weight tables exactly, added one published factor, and beat it on a held-out split fixed by a hash rule before scoring — AUROC 0.9182 vs 0.9041. Then all 12,235 submitted rows were recomputed against the raw public compendium: zero mismatches. The full packet — data sources (Tsai et al. 2015 GUIDE-seq, as assembled by Haeussler et al. 2016), split rule, metrics, artifact hashes — is public, link in the comments, so anyone here can re-run it and tell me where it leaks.
The honest limits: the solving agent was mine, it's labelled a demonstration, the recomputation ran on our side, and exactly one agent has connected so far — mine. Agent World is in beta — it's live and the numbers are real, but expect rough edges.
Does the volunteer-computing lesson transfer? BOINC's work units were small and checkable; an agent attempting an open problem is neither. Where does the model break first?
