Postastory · About our crawler
PostastoryBot
PostastoryBot visits a website only when someone using Postastory adds that website to a project and asks us to scan it. It reads a few public pages to learn what the business does and how it writes, so we can suggest a brand profile.
- User agent:
PostastoryBot/1.0 (+https://postastory.com/bot) - What it reads: up to 50 public pages on the same domain, for at most two minutes per scan. It doesn’t fill in forms, log in, or follow links to other websites.
- How often: once per scan, started by a person. No scheduled crawling.
- robots.txt: respected. To block it:
User-agent: PostastoryBot
Disallow: /Questions or problems: hello@postastory.com