OpenRecords crawler policy

OpenRecords is the open-data fetcher run by Ciolation Systems Inc. This page says what it does, how to stop it, and how to recognise it.

Identity

Every request carries the user agent OpenRecords/1.0 (+https://openrecords.dev). We never present another crawler's or a browser's identity. Robots.txt rules are matched against the token OpenRecords, then *.

What we fetch

Public datasets and records that a publisher offers under an open licence (public-domain, CC0, CC-BY, ODbL, open-government licences and similar) or that the publisher's own terms allow us to index.
Public feature, pricing and status pages, only to note which features a service offers; the page text is not kept.
Every source is listed with its licence and terms link before the first request. A source without a licence line is not fetched. Datasets under non-commercial or no-derivatives licences are indexed by metadata only.
We do not log in, bypass paywalls or access controls, collect personal contact data, or fetch pages that forbid it.

How we behave

Rule	Value
robots.txt	read before any page on a host; Disallow honoured
Crawl-delay	honoured; our own floor is one request per second per host
429 / 503	we back off on that host
noindex, noai, noimageai (header or meta)	honoured
Private and internal addresses	refused

Opt out

Add this to your robots.txt:

User-agent: OpenRecords
Disallow: /

or write to [email protected] with the site or URLs. We stop fetching and remove what we hold for the sites you name.

Where requests come from

Requests come from the address(es) listed in /ip-ranges.txt (plain text, one address or range per line). Changes are published there before they take effect.

Contact

[email protected]. Operator: Ciolation Systems Inc.