Japan’s AI Safety Institute plans to complete model evaluations using its own benchmarks within fiscal 2026, director Akiko Murakami told ITmedia. The October 15 interview also describes plans to examine deployment-level safety, including agent harnesses.
This article aggregates reporting from 1 news source. The TL;DR is AI-generated from original reporting. Race to AGI's analysis provides editorial context on implications for AGI development.
Japan’s proposed evaluation work matters because the safety of an agent depends on more than its underlying model. Murakami explicitly includes implementation-level checks and harnesses in the institute’s direction. The interview leaves the model selection and disclosure scope unsettled, making this a statement of institutional intent rather than a finished testing regime. ([itmedia.co.jp](https://www.itmedia.co.jp/aiplus/article/2610/15/2000002280/))
My assessment is that independent evaluation capacity can change competition without changing raw model capability. Buyers need ways to compare systems under realistic permissions, tools and operating conditions. A credible national testing program could reward developers that make their systems inspectable and expose weaknesses that headline benchmarks overlook. It could also give Japan a stronger voice in defining what acceptable deployment looks like, rather than relying entirely on vendors’ assessments. For Race to AGI readers, the important next milestone is published methodology and reproducible results. Until those appear, this announcement should not be counted as either an acceleration or a slowdown of the AGI timeline.


