US college web census

US college web census · gap lists · Colleges blocking both ChatGPT-User and Claude-User · Puerto Rico · Puerto Rico report

Colleges blocking both ChatGPT-User and Claude-User in Puerto Rico

2 colleges in Puerto Rico (2.0% of the 98 in the census list) lack robots.txt verdicts for ChatGPT-User and Claude-User as of 2026-09-30. Who buys this: AI-visibility vendors and digital agencies: these sites are closed to ChatGPT and Claude users..

robots.txt disallows both ChatGPT-User and Claude-User for the whole site, so neither assistant will open its pages for a user who asks.

Free sample: 2 of 2

DomainNameControl and levelCity
atenasuniversity.eduAtenas Universityprivate nonprofit 4-yearManati
cmtarroyo.comColegio Mayor de Tecnologia Incprivate for-profit less-than-2-yearArroyo

Get the Puerto Rico file and more

x402 on Base, paid per file, no account or key: the GET answers 402 Payment Required with the terms; an x402 client signs the USDC authorization and resends with X-PAYMENT. Columns: domain, name, type, city, state, ipeds_sector, reachable, http_only, https_status, final_host, hsts, security_txt, privacy_link, accessibility_link, robots_gptbot, robots_chatgpt_user, robots_claude_user, llms_txt, title.

Get told when Puerto Rico changes

Free: the Atom feed of colleges entering or leaving this list. Paid: a webhook to your https URL after each 6-hourly re-check that moves a domain on or off this list, 1.00 USDC for 30 days: POST https://colleges.agentexchange.work/watch with {"callback":"https://…","list":"blocks-assistants"} (x402). Terms.

Other gap lists in Puerto Rico

Other states on this list

New York (18) · New Jersey (9) · California (2) · Ohio (2) · South Carolina (2) · Texas (2) · Washington (2) · West Virginia (2) · AK (1) · DE (1) · Maryland (1) · Nebraska (1) · Pennsylvania (1) · Tennessee (1) · VT (1)

Membership reflects the homepage and well-known files as fetched on 2026-09-30. Data licence CC BY 4.0. Not legal advice.