US college web census · fetched 2026-09-30

Terms

What this is

An independent, dated measurement of public web properties (4,961 colleges), made by fetching each site's public pages and well-known files once and, for a rotating slice, again every six hours. It reports what a site publishes; it is not legal advice, not a security audit and not an endorsement of any site or listing.

Paid routes: payment, replay, limits, uptime

Payment. Paid routes use x402: an unpaid request answers 402 with the exact terms (scheme exact, USDC on Base, atomic amount, payTo 0xc91cE6291eDC0713ec753BAFBA002506ffb2b95c); the client signs an EIP-3009 authorization and resends with X-PAYMENT; the PayAI facilitator verifies and settles it on-chain; the response carries PAYMENT-RESPONSE. Prices are identical in the 402, in /.well-known/x402 and in /openapi.json. Replay. Settlement is final and on-chain. If a paid response fails after settlement (HTTP 5xx), the identical request with the same X-PAYMENT is served again within 10 minutes without a second charge; after that a used authorization is rejected. Refunds. None: there is no account to refund to. What stands in for them: the free sample before every purchase (the first 50 rows of every list, every census record, every feed) and the replay rule above. Limits. Unpaid POST /listings calls are limited to 30 per minute per client (429 with Retry-After); other unpaid requests simply receive the terms. Each paid file is a single response; no streaming. Uptime. No guarantee. The host runs on Cloudflare's edge with no origin server; census files are static; live re-checks depend on the target site answering within 8 seconds; current state at /live.json.

Data licence

Census data (pages, JSON records, CSV, NDJSON, feeds) is licensed CC BY 4.0; cite "Agent Exchange US college web census 2026-09" with a link. Measurement errors happen: a site that blocks our one polite request shows as unreachable or inconclusive, and rules are heuristics described on the report page. Corrections: use the live re-check or the feed for a domain to see the current state.

Paid routes

Payments are made with the x402 protocol in USDC on Base to 0xc91cE6291eDC0713ec753BAFBA002506ffb2b95c and settled by a third-party facilitator; settlement is final and there are no accounts, subscriptions or refunds. A listing runs 30 days from settlement, shows the name, URL and description you sent (placeholder hosts are shown unlinked as test listings), carries rel="sponsored" and may be removed if it is unlawful, deceptive or malicious, without refund. A live re-check returns whatever the checked site answered at that moment. A gap list download returns the file computed from the 2026-09-30 census (CC BY 4.0 data filtered to the colleges missing one control); the same facts are in the free dumps and the first 50 rows of every list are free. Unpaid requests to paid routes are rate limited (30 per minute per address for listings).

Crawling and use

Automated reading is welcome: robots.txt allows every crawler, JSON records are CORS-open, and feeds are meant for machines. Bulk use of the dumps is preferred over crawling every page. No personal data is collected; the only server-side counters are anonymous per-route request tallies used to order the sitemap.

Operator

Agent Exchange, one operator, one wallet. All properties are listed at network.agentexchange.work; the payment address above is the only one used.