Bulk check up to 20 URLs. See which pages block GPTBot, ClaudeBot, or PerplexityBot while allowing Googlebot. The only free checker with AI crawler user-agent testing.
Get updates on new Ooty tools, integrations, and guides. No spam.
SEO Content Analyzer
44-check SEO audit for any URL
Schema Markup Validator
Validate JSON-LD and check rich result eligibility
AI Readiness Checker
Check if AI crawlers can access your site
Robots.txt Generator
Build a robots.txt with AI crawler presets
Meta Tag Analyzer
Analyze title, description, and OG tags
Sitemap Validator
Validate XML sitemap structure and URL count
Topic Cluster Analyzer
Visualize your site's topic distribution
When you submit URLs, the tool sends an HTTP request to each one from our servers using the user agent you selected. Each request uses redirect: manual mode, which intercepts redirect responses instead of following them automatically. This lets the tool record every hop in the redirect chain before proceeding to the next URL.
DNS resolution is validated at every hop to prevent SSRF attacks. Private IP ranges (10.x.x.x, 192.168.x.x, 172.16-31.x.x, 127.x.x.x, and IPv6 equivalents) are blocked. Each request has a 10-second timeout. All 20 URLs run concurrently, so total check time is roughly equal to the slowest responding server.
Rarely seen in standard web requests. 100 Continue tells a client to proceed with a request body. 101 Switching Protocols is used when upgrading to WebSocket. These codes are handled transparently by browsers and are not meaningful for SEO purposes.
The request completed successfully. 200 OK is the standard response for a loaded page. 201 Created confirms a resource was created via POST. 204 No Content means success with no body (common for API endpoints and analytics beacons). 206 Partial Content indicates a range request, used for video streaming and resumable downloads.
The resource has moved or is temporarily elsewhere. 301 Moved Permanently is the SEO-safe redirect: it passes full link equity to the destination and tells Google to update its index. 302 Found is temporary and does not reliably pass link equity. 307 Temporary Redirect and 308 Permanent Redirect are HTTP/1.1 equivalents that preserve the request method (important for POST requests). 304 Not Modified means the cached version is still valid, used with ETags and Last-Modified headers.
The problem is with the request. 400 Bad Request means the server could not parse the request. 401 Unauthorized requires authentication. 403 Forbidden means the server understood the request but refused it (often a firewall or bot-blocking rule). 404 Not Found means the resource does not exist. 410 Gone confirms permanent deletion (stronger signal to Google than 404). 429 Too Many Requests is a rate limit response.
The server failed to complete a valid request. 500 Internal Server Error is a generic server fault. 502 Bad Gateway means an upstream server returned an invalid response (common with reverse proxies and load balancers). 503 Service Unavailable means the server is overloaded or in maintenance. 504 Gateway Timeout means an upstream server did not respond in time. Repeated 5xx responses on crawled pages will eventually cause Google to reduce crawl frequency or de-index the page.
Every redirect hop adds latency and reduces the link equity passed to the final destination. A redirect chain like A to B to C means the PageRank intended for A reaches C diluted through two hops. Google's John Mueller has confirmed that each redirect hop reduces the signal strength passed through the chain.
Beyond link equity, long redirect chains slow down the first byte for users and crawlers. Googlebot has a crawl budget: if it takes three HTTP round trips just to reach your content, it will crawl fewer pages per session. For large sites, this directly affects how quickly new content gets indexed.
Fix 5xx errors first: they mean your server is failing and Google is likely already seeing them during crawls. Then address 4xx errors: 404s on pages that used to exist should either be restored or redirected to a relevant page. Finally, review redirect chains and collapse any that are longer than one hop.
HTTP status codes are one piece of the SEO puzzle. These guides go deeper into how redirects, crawl budget, and technical health affect your rankings.