Zendoric
← Back to the day · September 22, 2026

The UN puts its statistics at the service of AI agents, after a test revealed just 21% accuracy in the models

🕒 Published on Zendoric: September 22, 2026 · 07:23

✨ AI-generated · how it's made

The UN and Google are launching UN System Data Commons, a platform that lets AI agents query the UN system's official statistics in natural language. It arrives after a UNICEF benchmark —133,000 answers, six models— that found average accuracy of just 21.2%.

By Zendoric · September 18, 2026.

The United Nations and Google have unveiled UN System Data Commons, a platform that allows users to query the UN's official statistics in natural language and connect it directly to AI agents. The project builds on Data Commons, the open-source tool Google launched in 2018 to organize public databases, and adds support for the Model Context Protocol (MCP) —the standard, originally driven by Anthropic, that lets an agent connect to external data sources instead of relying only on what it learned during training.

The trigger for the project is an uncomfortable statistic. A UNICEF benchmark, with more than 133,000 responses generated by six large language models —OpenAI's GPT-4o and GPT-4o-mini, Anthropic's Claude Sonnet 4.5 and Haiku 4.5, and Google's Gemini 2.5 Flash and Gemini 2.0 Flash— found average accuracy of just 21.2% when answering questions about global development indicators, as João Pedro Azevedo, UNICEF's chief statistician, explained to reporters. Around three out of every five responses did not even manage to offer a usable figure: the models opted for evasions. And when the same question was put to the same models two days later, those that did give a number agreed with themselves only about half the time. The study, not yet peer-reviewed, will be published along with its methodology, code and data.

That fragility coexists with adoption that is already real: UNICEF's data portal receives more than 6 million visits a month, and those arriving from ChatGPT links grew 67% year over year between January and mid-September, reaching 6.4% of the year's sessions. Adding up all AI assistants, Azevedo estimates they already generate close to one in ten visits. The public, in other words, is already asking chatbots about development statistics before a reliable infrastructure exists to answer them.

UN System Data Commons aims to close that gap. Twenty-five UN system entities have committed to the project and almost 20 already had data available at launch; the goal is to incorporate 80% of the UN's statistical datasets by 2027. Google.org has contributed $2 million for capacity building, and the rollout followed, according to Prem Ramaswami (head of Data Commons at Google), a "training of trainers" model: the instance is governed and administered by the UN itself, not by Google. Each record also retains its provenance, so that a user —or an agent— can trace any figure back to the agency and original source that produced it.

In a demonstration, Google showed an agent that combined several UN metrics to generate dashboards and reports automatically, and another that, from a question about the impact of PEPFAR (the US anti-AIDS aid program) in Africa, located statistics on HIV infections, mortality and life expectancy and turned them into an infographic. It is a demonstration of convenience, not proof that the generated conclusion was correct. Ramaswami himself warned as much: connecting a model to reliable sources does not guarantee that its conclusions will also be reliable, because models can still misinterpret nuances, and a person should always review the result before citing it.

Here it is worth separating what has been demonstrated from what has been promised, something we repeat at Zendoric every time a big tech company unveils infrastructure for agents: giving a model access to quality data and traceability does not solve the underlying problem, which is interpretation. MCP solves the "where is the data"; it does not solve the "what does this figure mean within this series, with this definition and this period", which is exactly where the six models in UNICEF's benchmark failed. That is why the UN insists, almost as a stylistic clause, that human review will remain mandatory: it is not rhetorical caution, it is the direct conclusion from its own data.

Even so, the project matters beyond the UN. It is one more piece in the race to build the "plumbing" of agentic AI —the standards and pipelines through which agents access the real world—: the winner is whoever controls how agents connect to information, not just whoever has the smartest model. That the chosen standard is MCP, born at Anthropic, and that the party deploying it at this institutional scale is Google, says a great deal about where the sector is converging: toward de facto interoperability between rival labs, even as they compete fiercely on everything else.

In the long run, this is exactly the kind of infrastructure we need if AI is to genuinely help solve global development problems —disease tracking, poverty, child mortality— rather than merely writing about them with invented data. A statistic with verifiable provenance, accessible in natural language, is a real building block toward the informational abundance we defend as a horizon at Zendoric. But this benchmark's 21.2% accuracy is a useful reminder that the distance between having the right data available and producing a correct analysis remains enormous, and that nobody —neither the UN nor Google— claims today to have closed it.

🔗 Related on Zendoric

Sources & references