Free Technical SEO utility
Crawl Budget Snapshot
Paste a URL → we fetch robots.txt and sitemap files (public GETs only) → get a plain-English snapshot: URL count, disallow highlights, last-mod freshness, and a likely crawl-waste score with top 3 fixes.
New: robots.txt AI crawler checker
See whether a site's robots.txt allows or blocks GPTBot, OAI-SearchBot, ClaudeBot, Google-Extended, PerplexityBot, CCBot and other AI user-agents at the root path, with the exact rule that decided it. Check AI crawlers →
New: bulk redirect chain checker
Paste up to 20 URLs and see every redirect hop with its status code and Location, plus loops, long chains, 4xx/5xx endpoints and http→https or trailing-slash hops. Export to CSV. Check redirects →