Find out what they changed, the week they changed it.
Competitor monitoring is usually either a spreadsheet somebody stopped updating or a scraper that gets you blocked. This is a weekly diff of the pages that matter, built to be unobjectionable to the site on the other end.
What it reports
| Tracked | Why it is worth knowing |
|---|---|
| Title tags | The clearest signal that someone has re-targeted a page at a different query. |
| Meta descriptions | Usually a click-through experiment. Worth knowing when a competitor runs one. |
| Headings | A restructured H2 set is a rewritten argument, even when the word count barely moves. |
| Body copy | What actually changed on the page, not that something did. |
| Pricing | The change most likely to need a response the same week. |
| Links | New internal routes show what they are consolidating around; new external ones show who they are citing. |
Reports are diffs, not snapshots. "This H2 changed from X to Y on Tuesday" is actionable; "here is their current page" is a browser.
Polite by construction
The constraints below are not settings. They are how the crawler is built, and they exist because pointing automated traffic at a third party is a thing you should have to justify.
| Limit | Detail |
|---|---|
| Up to 3 competitor sites | Per brand. Enough to watch the people you actually lose to. |
| 12 pages per site | It does not walk a competitor’s whole site, and it is not trying to mirror one. |
| One request at a time | No parallel fetching, ever. It is not capable of loading anyone’s server. |
| Once a week | The scheduler runs on a 168-hour interval. |
| robots.txt obeyed | Including crawl-delay. A site that disallows CrawldBot is not crawled. |
| Identifies itself | The user agent names the bot and links to a page explaining how to block it. |
If you have arrived here from your own access logs, the crawler page explains how to block it, and blocking works.
Actionable Insights Coming soon
Turning a detected change into a recommended response ("they have re-targeted this page at your primary query, here is what that implies") is not built. The in-app copy marks it coming soon and so does this page. What ships today is the change detection.
Why three sites
Because monitoring twenty competitors is a way of monitoring none of them. Three forces the question of who you actually lose traffic to, which for most sites is a shorter list than the one in the pitch deck.