{"id":10063,"date":"2026-09-20T13:26:59","date_gmt":"2026-09-20T13:26:59","guid":{"rendered":"https:\/\/justfineinfotech.com\/measurements-for-understanding-the-pace-of-ai-development-inside-frontier-labs\/"},"modified":"2026-09-20T13:27:00","modified_gmt":"2026-09-20T13:27:00","slug":"measurements-for-understanding-the-pace-of-ai-development-inside-frontier-labs","status":"publish","type":"post","link":"https:\/\/justfineinfotech.com\/fr\/measurements-for-understanding-the-pace-of-ai-development-inside-frontier-labs\/","title":{"rendered":"Measurements for understanding the pace of AI development inside frontier labs"},"content":{"rendered":"
\n<img src="https:\/\/justfineinfotech.com\/wp-content\/uploads\/2026<\/a>\/09\/image-2.webp” alt=”Chart showing Claude now leads 26% of Anthropic’s model R&D tasks, up from under 1% in February 2026.”>
\n<\/figure>\n\n\n\n\n\n\n\n
Online monitors<\/strong><\/td>\nOffline monitors<\/strong><\/td>\n<\/tr>\n
Description<\/strong><\/td>\nOnline monitors check the actions of agents in real-time<\/em> and either block dangerous actions or steer agent misbehavior automatically. They\u2019re built to address harms that would happen quickly and could not be undone, such as an agent copying model weights out of our systems.<\/td>\nOffline monitors read agent activities after the fact<\/em>. They are built to help address dangerous behaviors that develop slowly and can be reversed, like signs of model misalignment. We use flagged activities to improve our mitigations, like classifiers and deterministic controls. If the situation caused a large imminent danger, we would shut down the dangerous parts of the agent\u2019s deployment.<\/td>\n<\/tr>\n
Coverage<\/strong><\/td>\n100% of these agents\u2019 actions pass through the online monitor before they are executed, usually within seconds.<\/td>\n100% of these agents\u2019 actions are ingested by the monitor after they are taken.<\/td>\n<\/tr>\n
Review latency<\/strong><\/td>\nAutomated review happens before an agent takes action; humans review any blocked actions within one week.<\/td>\nThe monitor flags roughly 100,000 transcripts per week that are then reviewed by multiple classifiers for false-positives and initial oversight review. Most of the flags are resolved by this process, and the highest priority flags (approximately ~50 per week) are escalated to human review.<\/td>\n<\/tr>\n
Blocking \/ escalation rate<\/strong><\/td>\nWe analyzed over a billion decisions from our research & engineering agents over August 2026 and found that 0.002% of them (about 1 in 47,000) were blocked by this monitor.<\/td>\nThe monitor flags roughly one to two transcripts in every thousand for further review.<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n
You\u2019re helping to perform an internal audit at the frontier AI company Anthropic to track where our research compute goes. The aim of the audit is to produce a public-facing breakdown of the usage of all of our AI accelerator chips into a handful of buckets. One split we particularly care about is the division between compute which was spent on safety research versus other R&D. Your job is to look at one research job at a time, figure out what it was doing, and assign it to one of those two buckets.\n\n[...]\n\nSafety and\/or security<\/a> research is work whose dominant purpose is making AI systems safer, more understandable, or more secure. This work can be broken down into a few main categories:\n\n[...]\n\nOn the other hand, the following work falls<\/a> outside of the scope of safety research:\n\n[...]\n\nHere are some boundary cases, along with how to think about them:\n\n[...]<\/code><\/pre>\n
\n
\n    Related:<\/strong>
\n    
\n      Digital Automation Training Benin: 5 Winning Skills Employers Demand in 2026
\n    <\/a>\n  <\/p>\n
\n    
\n      WhatsApp Marketing Automation Africa: 6 Dangerous Mistakes Brands Make in Nigeria
\n    <\/a>\n  <\/p>\n<\/div>\n
\n
Want to learn this practically?<\/h3>\n
Join Justfine Infotech<\/strong> and build real digital skills in AI, automation, web development, digital marketing, office productivity, e-commerce, freelancing and cybersecurity.<\/p>\n
Available Programmes:<\/strong>
\n  6 Weeks Certificate \u2022 3 Months Professional Certificate \u2022 6 Months Diploma \u2022 Full Professional Diploma<\/p>\n
WhatsApp:<\/strong>
\n  +229 01 57 57 99 15
\n  +229 01 66 68 11 60<\/p>\n
Enroll Now<\/a><\/p>\n<\/div>\n
Source: www.anthropic.com<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"
Online monitors Offline monitors Description Online monitors check the actions of agents in real-time and either block dangerous actions or steer agent misbehavior automatically. They\u2019re built to address harms that would happen quickly and could not be undone, such as an agent copying model weights out of our systems. Offline monitors read agent activities after…<\/p>","protected":false},"author":1,"featured_media":10066,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[64],"tags":[570,926,1849,1851,1850],"class_list":["post-10063","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-automation-business-systems","tag-development","tag-inside","tag-measurements","tag-pace","tag-understanding"],"_links":{"self":[{"href":"https:\/\/justfineinfotech.com\/fr\/wp-json\/wp\/v2\/posts\/10063","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/justfineinfotech.com\/fr\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/justfineinfotech.com\/fr\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/justfineinfotech.com\/fr\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/justfineinfotech.com\/fr\/wp-json\/wp\/v2\/comments?post=10063"}],"version-history":[{"count":1,"href":"https:\/\/justfineinfotech.com\/fr\/wp-json\/wp\/v2\/posts\/10063\/revisions"}],"predecessor-version":[{"id":10065,"href":"https:\/\/justfineinfotech.com\/fr\/wp-json\/wp\/v2\/posts\/10063\/revisions\/10065"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/justfineinfotech.com\/fr\/wp-json\/wp\/v2\/media\/10066"}],"wp:attachment":[{"href":"https:\/\/justfineinfotech.com\/fr\/wp-json\/wp\/v2\/media?parent=10063"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/justfineinfotech.com\/fr\/wp-json\/wp\/v2\/categories?post=10063"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/justfineinfotech.com\/fr\/wp-json\/wp\/v2\/tags?post=10063"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}