About our crawler

Our crawler identifies itself with a user agent that starts with MontereyEventsBot and includes a link to this page. It visits the public event calendars of organizations in Monterey and Santa Cruz counties a few times a day to keep this directory current.

How it behaves

It reads robots.txt once a day per site and obeys Disallow rules.
It waits several seconds between requests to the same site and uses conditional requests so unchanged pages cost nothing to serve.
It prefers structured feeds (iCal, RSS, JSON-LD, calendar APIs) over page scraping, and never tries to bypass login pages or CAPTCHAs.
It stores the event details, a link back to your page and, where allowed, the event image with attribution.

If you would rather we didn't

Add User-agent: MontereyEventsBot with Disallow: / to your robots.txt, or contact us and we will stop. Better still, connect your calendar: you keep full control of your listings and we stop crawling your pages.