US college web census · gap lists · census 2026-09-30 · JSON (top 50) · feed
Colleges blocking both ChatGPT-User and Claude-User
48 of the 4,961 colleges in the census list (1.0%; 1.0% of the 4,763 reachable over HTTPS), as fetched on 2026-09-30.
On this list
48
of 4,961 colleges
Share of the list
1.0%
1.0% of reachable sites
States
16
largest: New York (18)
Full list
1.00 USDC
x402, per file; first 50 rows free
What this gap means
robots.txt disallows both ChatGPT-User and Claude-User for the whole site, so neither assistant will open its pages for a user who asks.
Control: robots.txt verdicts for ChatGPT-User and Claude-User. Rule: blocks_assistants over the census record (reachable sites only). Who buys this: AI-visibility vendors and digital agencies: these sites are closed to ChatGPT and Claude users.
This list maps to no legal obligation in this census; it is a gap in published practice.
By state
16 states with at least one college on this list; "of the state" is the share of its colleges in the census list. One state as CSV: 0.25 USDC (x402).
| State | On this list | Of the state | CSV (x402) |
|---|---|---|---|
| New York (report) | 18 | 4.8% | https://colleges.agentexchange.work/leads/blocks-assistants/state/NY.csv · card $9 |
| New Jersey (report) | 9 | 7.8% | https://colleges.agentexchange.work/leads/blocks-assistants/state/NJ.csv · card $9 |
| California (report) | 2 | 0.4% | https://colleges.agentexchange.work/leads/blocks-assistants/state/CA.csv · card $9 |
| Ohio (report) | 2 | 0.9% | https://colleges.agentexchange.work/leads/blocks-assistants/state/OH.csv · card $9 |
| Puerto Rico (report) | 2 | 2.0% | https://colleges.agentexchange.work/leads/blocks-assistants/state/PR.csv · card $9 |
| South Carolina (report) | 2 | 3.0% | https://colleges.agentexchange.work/leads/blocks-assistants/state/SC.csv · card $9 |
| Texas (report) | 2 | 0.7% | https://colleges.agentexchange.work/leads/blocks-assistants/state/TX.csv · card $9 |
| Washington (report) | 2 | 2.4% | https://colleges.agentexchange.work/leads/blocks-assistants/state/WA.csv · card $9 |
| West Virginia (report) | 2 | 3.3% | https://colleges.agentexchange.work/leads/blocks-assistants/state/WV.csv · card $9 |
| AK | 1 | — | https://colleges.agentexchange.work/leads/blocks-assistants/state/AK.csv · card $9 |
| DE | 1 | — | https://colleges.agentexchange.work/leads/blocks-assistants/state/DE.csv · card $9 |
| Maryland (report) | 1 | 1.6% | https://colleges.agentexchange.work/leads/blocks-assistants/state/MD.csv · card $9 |
| Nebraska (report) | 1 | 2.5% | https://colleges.agentexchange.work/leads/blocks-assistants/state/NE.csv · card $9 |
| Pennsylvania (report) | 1 | 0.4% | https://colleges.agentexchange.work/leads/blocks-assistants/state/PA.csv · card $9 |
| Tennessee (report) | 1 | 0.8% | https://colleges.agentexchange.work/leads/blocks-assistants/state/TN.csv · card $9 |
| VT | 1 | — | https://colleges.agentexchange.work/leads/blocks-assistants/state/VT.csv · card $9 |
Free: the first 48 of 48
| Domain | Control and level | State | IPEDS sector | Census record |
|---|---|---|---|---|
| abc.edu Appalachian Bible College | private nonprofit 4-year | WV | Private not-for-profit, 4-year or above | HTTP 200 · HSTS no · security.txt none · privacy yes · accessibility no · GPTBot blocked |
| alaskacareercollege.edu Alaska Career College | private for-profit 2-year | AK | Private for-profit, 2-year | HTTP 200 · HSTS yes · security.txt incomplete · privacy yes · accessibility no · GPTBot blocked |
| atenasuniversity.edu Atenas University | private nonprofit 4-year | PR | Private not-for-profit, 4-year or above | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| baisbinyominacademy.com Bais Binyomin Academy | private nonprofit 4-year | NY | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| baismedrashmayanhatorah.com Bais Medrash Mayan Hatorah | private nonprofit 4-year | NJ | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| baismedroshelyon.com Bais Medrash Elyon | private nonprofit 4-year | NY | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| bcc.cuny.edu CUNY Bronx Community College | public 2-year | NY | Public, 2-year | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| bergen.org Adult and Continuing Education-BCTS | public less-than-2-year | NJ | Public, less-than 2-year | HTTP 200 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| bethmedrashmeoryitzchok.com Beth Medrash Meor Yitzchok | private nonprofit 4-year | NY | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| betmedrashgadolaterettorah.com Bet Medrash Gadol Ateret Torah | private nonprofit 4-year | NY | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| bnoszionbobov.com Bnos Zion Of Bobov Seminary | private nonprofit 2-year | NY | Private not-for-profit, 2-year | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| brazosport.edu Brazosport College | public 4-year | TX | Public, 4-year or above | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| centralyeshivabethjoseph.com Central Yeshiva Beth Joseph | private nonprofit 4-year | NY | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| charzannebeautycollege.com Charzanne Beauty College | private for-profit less-than-2-year | SC | Private for-profit, less-than 2-year | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| cmtarroyo.com Colegio Mayor de Tecnologia Inc | private for-profit less-than-2-year | PR | Private for-profit, less-than 2-year | HTTP 200 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| coastal.edu Coastal Carolina University | public 4-year | SC | Public, 4-year or above | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| csudh.edu California State University-Dominguez Hills | public 4-year | CA | Public, 4-year or above | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| digipen.edu DigiPen Institute of Technology | private for-profit 4-year | WA | Private for-profit, 4-year or above | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| dtcc.edu Delaware Technical Community College-Central Office | public 4-year | DE | Administrative Unit | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| evvayloisschoolofbeauty.com Evvaylois Academy School of Beauty | private nonprofit less-than-2-year | TX | Private not-for-profit, less-than 2-year | HTTP 200 via www.6pong.com · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| gannon.edu Gannon University | private nonprofit 4-year | PA | Private not-for-profit, 4-year or above | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| kc.edu Kettering College | private nonprofit 4-year | OH | Private not-for-profit, 4-year or above | HTTP 200 · HSTS no · security.txt none · privacy yes · accessibility no · GPTBot blocked |
| mechonlhoyroa.com Mechon L'hoyroa | private nonprofit 4-year | NY | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| mercercountyschools.sites.thrillshare.com Mercer County Technical Education Center | public 2-year | WV | Public, 2-year | HTTP 200 · HSTS no · security.txt complete · privacy no · accessibility no · GPTBot blocked |
| mesivtaofeasternparkway.com Mesivta of Eastern Parkway-Yeshiva Zichron Meilech | private nonprofit 4-year | NY | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| msmu.edu Mount Saint Mary's University | private nonprofit 4-year | CA | Private not-for-profit, 4-year or above | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility no · GPTBot blocked |
| osu.edu Ohio State University-Main Campus | public 4-year | OH | Public, 4-year or above | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| peru.edu Peru State College | public 4-year | NE | Public, 4-year or above | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| pgcc.edu Prince George's Community College | public 2-year | MD | Public, 2-year | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot allowed |
| pstcc.edu Pellissippi State Community College | public 2-year | TN | Public, 2-year | HTTP 200 · HSTS no · security.txt none · privacy no · accessibility yes · GPTBot blocked |
| rabbijacobjoseph.com Rabbi Jacob Joseph School | private nonprofit 4-year | NJ | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| rabbinicalacademyrabbichaimberlin.com Rabbinical Academy Mesivta Rabbi Chaim Berlin | private nonprofit 4-year | NY | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| rabbinicalcollegebethshraga.com Rabbinical College Beth Shraga | private nonprofit 4-year | NY | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| seminarybnoschaim.com Seminary Bnos Chaim | private nonprofit 2-year | NJ | Private not-for-profit, 2-year | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| talmudicalacademynj.com Talmudical Academy-New Jersey | private nonprofit 4-year | NJ | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| torahtemimahtalmudicalseminary.com Torah Temimah Talmudical Seminary | private nonprofit 4-year | NY | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| vcfa.edu Vermont College of Fine Arts | private nonprofit 4-year | VT | Private not-for-profit, 4-year or above | HTTP 403 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| www2.cuny.edu CUNY System Office | public 4-year | NY | Administrative Unit | HTTP 200 via www.cuny.edu · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| yeshivabaisaharon.com Yeshiva Bais Aharon | private nonprofit 4-year | NJ | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| yeshivachemdashatorah.com Yeshiva Chemdas Hatorah | private nonprofit 4-year | NJ | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| yeshivagedolahkerenhatorah.com Yeshiva Gedolah Keren Hatorah | private nonprofit 4-year | NJ | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| yeshivaofmachzikaihadas.com Yeshiva of Machzikai Hadas | private nonprofit 4-year | NY | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| yeshivaohrnaftoli.com Yeshiva Ohr Naftoli | private nonprofit 4-year | NY | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| yeshivasemekhatorah.com Yeshivas Emek Hatorah | private nonprofit 4-year | NJ | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| yeshivasholomshachna.com Yeshiva Sholom Shachna | private nonprofit 4-year | NY | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| yeshivasnovominsk.com Yeshivas Novominsk | private nonprofit 4-year | NY | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| yeshivazichronaryeh.com Yeshiva Zichron Aryeh | private nonprofit 4-year | NY | Private not-for-profit, 4-year or above | HTTP 202 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| yvcc.edu Yakima Valley College | public 4-year | WA | Public, 4-year or above | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
The same rows as JSON: blocks-assistants.top.json (CORS open, cached one day).
Get the full list: 48 rows, 1.00 USDC
x402 on Base, paid per file, no account or key. GET https://colleges.agentexchange.work/leads/blocks-assistants.csv or GET https://colleges.agentexchange.work/leads/blocks-assistants.json answers 402 Payment Required with the terms (scheme exact, USDC on Base, maxAmountRequired 1000000, payTo 0xc91cE6291eDC0713ec753BAFBA002506ffb2b95c); an x402 client signs the EIP-3009 authorization and resends the same request with X-PAYMENT; the file comes back with a PAYMENT-RESPONSE header. HEAD gets the same 402. One state: GET https://colleges.agentexchange.work/leads/blocks-assistants/state/<code>.csv, 0.25 USDC (codes in the table above).
curl -sS -D - https://colleges.agentexchange.work/leads/blocks-assistants.csv # 402 with the x402 terms; pay and resend with X-PAYMENT
Columns (19): domain, name, type, city, state, ipeds_sector, reachable, http_only, https_status, final_host, hsts, security_txt, privacy_link, accessibility_link, robots_gptbot, robots_chatgpt_user, robots_claude_user, llms_txt, title. CSV: header row, every cell quoted, yes/no for booleans. JSON: { list, title, count, by_state, columns, rows[][] }. Sizes: CSV 11 KB, JSON 12 KB. The same facts are in the free CC BY 4.0 dumps: the price buys the filtered, state-sliceable file built from the 2026-09-30 census, not exclusive data. Settlement is final; no refunds. Prices in /.well-known/x402 equal the challenges. Terms · pricing.
Card checkout
Pay with a card through Stripe and get the file on the next page: Full list CSV, $29 · JSON, $29 · one state $9 (links in the table below) · all 8 lists, $79. Agents pay less with x402 (see above).
Monitor this list (free)
Atom feed: colleges that entered or left this list according to the live re-checks (every 6 hours a rotating slice, each domain at most once per 14 days; each entry says which way it moved and which field changed). blocks-assistants.top.json: the first 48 rows and the counts by state as JSON, CORS open. Fields watched: robots, robots.ChatGPT-User, robots.Claude-User.
Membership reflects the homepage and well-known files as fetched on 2026-09-30: a control that exists but was not found where the census looked counts as missing, and sites answering 403 to our one polite request count as reachable. Every domain links to its record with what to fix, a JSON twin, a badge and a changes feed. Data licence CC BY 4.0. Not legal advice.