US college web census · gap lists · census 2026-09-30 · pricing · x402 manifest
Gap lists: which colleges are missing which control
8 lists computed from the census of 2026-09-30: 4,961 colleges, 4,763 reachable over HTTPS. Each list is the colleges whose record lacks one control. Every row is public data already in the CC BY 4.0 dumps; the lists are the filtered, state-sliceable, refreshed files a sales or compliance tool can import.
Census refresh: 2026-09-30 (counts change only when the census is rebuilt). Live re-checks: 81 colleges re-checked since 2026-10-01, last run 2026-10-01 00:11 UTC, 11 changes recorded; each list's feed names who entered or left it.
| List | Colleges | Of the list | Who buys this | Free | Full list |
|---|---|---|---|---|---|
| Colleges without an accessibility statement on the homepage Accessibility statement linked from the homepage | 3,180 | 64.1% | Accessibility vendors and agencies, EdTech and campus web platform vendors with WCAG 2.1 AA offerings (Title II for public, Title III for private institutions). | top 50 · feed | 1.00 USDC |
| Colleges without a privacy policy link on the homepage Privacy policy linked from the homepage | 2,551 | 51.4% | Privacy-compliance vendors, student-data-privacy tooling, agencies that write notices. | top 50 · feed | 1.00 USDC |
| Colleges without a security.txt security.txt (RFC 9116) | 4,617 | 93.1% | Security teams, vulnerability-disclosure and attack-surface vendors, MSPs serving higher education. | top 50 · feed | 1.00 USDC |
| Colleges with an expired security.txt security.txt Expires line (RFC 9116) | 14 | 0.3% | Security teams and vulnerability-disclosure vendors: a lapsed file is a specific, verifiable conversation opener. | top 50 · feed | 1.00 USDC |
| Colleges without HSTS HTTP Strict Transport Security header | 2,622 | 52.9% | Security teams, MSPs and hosting vendors serving higher education. | top 50 · feed | 1.00 USDC |
| Colleges blocking both ChatGPT-User and Claude-User robots.txt verdicts for ChatGPT-User and Claude-User | 48 | 1.0% | AI-visibility vendors and digital agencies: these sites are closed to ChatGPT and Claude users. | top 50 · feed | 1.00 USDC |
| Colleges answering only over plain HTTP HTTPS | 87 | 1.8% | MSPs, hosting and web agencies: campus sites still without working HTTPS. | top 50 · feed | 1.00 USDC |
| College homepages that redirect to another domain Homepage served on the listed domain | 165 | 3.3% | Web agencies and domain-consolidation vendors; security teams checking stale redirects. | top 50 · feed | 1.00 USDC |
What you get
- Free: each list page shows the first 50 rows (alphabetical) with links to every domain's record and counts by state; the same as JSON at
/leads/<list>.top.json(CORS open); an Atom feed at/leads/<list>.xmlof colleges that entered or left the list on the live re-checks. - Paid, 1.00 USDC per file (x402 on Base, no account):
GET /leads/<list>.csvor.json, the full list with 19 columns (domain, name, type, city, state, ipeds_sector, reachable, http_only, https_status, final_host, hsts, security_txt, privacy_link, accessibility_link, robots_gptbot, robots_chatgpt_user, robots_claude_user, llms_txt, title). One state:GET /leads/<list>/state/<code>.csv, 0.25 USDC. - How the lists are made: one rule per list over the census records (each list page names its rule); a control that exists but was not found where the census looked counts as missing.
Card checkout for these lists is not open yet; the x402 routes work now.
Data licence CC BY 4.0; cite Agent Exchange. Not legal advice.