Google\u2019s John Mueller responded to a post on Bluesky that lamented all the effort being wasted on AI agent accessibility instead of focusing on the more productive activity of making sites accessible for humans<\/p>\n
One of the consistent aspects of the history of SEO is that practitioners tend to follow tactical trends<\/a> if it\u2019s apparent that everyone else is doing it. I guess it\u2019s human nature<\/p>\n Back in the early days there was a guy who built a directory and purchased enough high PageRank links to the home page to get it to about a PageRank of 7 (on a scale of 1-10). SEOs were practically pushing each other out of the way to hand this guy their money. He sold thousands of links from his directory, and nobody thought to check if any of the links actually made a ranking difference. It was easy to check, but nobody did.<\/p>\n The latest tactic is LLMs.txt and creating markdown pages for AI agent consumption. Cloudflare announced in February that their infrastructure can automatically create markdown files, largely as a way for developers to save LLM token consumption. Their announcement stated that OAI-SearchBot, OpenAI\u2019s search crawler, was consuming markdown pages<\/p>\n OpenAI\u2019s official documentation explicitly positions its OAI-SearchBot as crawling websites and does not mention or recommend markdown files<\/p>\n \u201cOAI-SearchBot is for search. OAI-SearchBot is used to surface websites in search results in ChatGPT\u2019s search features. Sites that are opted out of OAI-SearchBot will not be shown in ChatGPT search answers, though can still appear as navigational links. To help ensure your site appears in search results, we recommend allowing OAI-SearchBot in your site\u2019s robots.txt file and allowing requests from our published IP ranges below.\u201d<\/p>\n<\/blockquote>\n Yes, it can crawl markdown if it\u2019s pointed to it but that\u2019s not what it\u2019s out there for<\/p>\n Stephanie Walter posted<\/a>:<\/p>\n \u201cSad truth: we are making the web accessible for AIs, not for people. Google\u2019s John Mueller responded<\/a>:<\/p>\n \u201cA properly made website works well for AI agents \u2026 and search engines, and LLMs, and above all, for actual people<\/p>\n If you\u2019re trying to fix accessibility issues by making a separate \u201cagent-friendly\u201d version, you are just building technical debt. You\u2019ll have to redo it multiple times. Just fix it.\u201d<\/p>\n<\/blockquote>\n It\u2019s a relatively tri over thirty years. Making sites accessible for everyone makes sense, especially since it\u2019s user behavior signals that have always driven search engine rankings. From links to users searching with a brand name, Google has consistently used user signals for ranking purposes<\/p>\n So, from the perspective of SEO, it makes a load of sense to make websites accessible for everyone<\/p>\n CategoryNewsSEO<\/p>\n \n Related:<\/strong> \n <a href="https:\/\/yoursite.com\/automation-africa\/" title="WhatsApp<\/a> Marketing Automation Africa: 6 Dangerous Mistakes Brands<\/a> Make in Nigeria”> Join Justfine Infotech<\/strong> and build real digital skills in AI, automation, web development, digital marketing, office productivity, e-commerce, freelancing and cybersecurity.<\/p>\n Available Programmes:<\/strong> WhatsApp:<\/strong>\n
\n
\nSome sites now offer a text version for LLMs, but still skip real accessibility needs like proper heading structure, landmarks that screen reader users need.\u201d<\/p>\n<\/blockquote>\n\n
AI Agents Crawl HTML<\/h2>\n
\n
\n Digital Automation Training Benin: 5 Winning Skills Employers Demand in 2026
\n <\/a>\n <\/p>\n
\n WhatsApp Marketing Automation Africa: 6 Dangerous Mistakes Brands Make in Nigeria
\n <\/a>\n <\/p>\n<\/div>\nWant to learn this practically?<\/h3>\n
\n 6 Weeks Certificate \u2022 3 Months Professional Certificate \u2022 6 Months Diploma \u2022 Full Professional Diploma<\/p>\n
\n +229 01 57 57 99 15
\n +229 01 66 68 11 60<\/p>\n