San Jose, California: how many business websites block AI.

Of 973 reachable business websites in San Jose in the census, 11.9% block at least one major AI crawler.

973San Jose business websites checked and reachable

11.9%block at least one major AI crawler (116 sites)

2.4%block the crawlers AI assistants use to answer live questions

10.3%turn the AI crawler away at the door with a bot wall

Is your website on the wrong side of this? Run the free AIOInsights check: about 20 seconds, no account, and it says in plain words whether AI crawlers can read your site.

Check my website

How the census was taken

AIOInsights took every business in California that lists a website in OpenStreetMap (map data as of 2026-11-01; contributors credited under the Open Database License), kept one record per website, and checked each site between 2026-11-01 and the publish date. For each site it read /robots.txt with the same rules the free AIOInsights check uses, and loaded the homepage twice: once as a browser and once identifying as GPTBot, OpenAI's crawler. A site counts as reachable when the browser visit loads; only reachable sites are in the percentages.

Blocks AI: robots.txt shuts out every crawler, or names a major AI crawler (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended and their kin) and disallows the whole site, or the site turns the AI crawler away with a bot challenge or a 401/403 while letting a browser in.
Blocks AI search: shuts out the crawlers AI assistants use to answer live questions (OAI-SearchBot, ChatGPT-User, Claude-SearchBot, PerplexityBot), or every crawler.
Blocks every crawler: User-agent: * with Disallow: /, which also shuts out Google.

This census publishes totals only. It never names a business. Any business can check its own site free, with no email, at aioinsights.com.