Indexability & Crawlability Checker

Check a single signal in depth

This tool gives the combined verdict. When it flags one signal, these dedicated checkers go deeper on that one, with the exact rule, header or tag and how to fix it.

Working from a whole site? Start with the XML sitemap checker to pull every URL, then check which ones Google has actually indexed.

Frequently asked questions

What is indexability?

Indexability is whether a search engine is allowed to add a page to its index. A page is indexable only if all of these are true at once: robots.txt allows Googlebot to crawl it, the page returns a 200 status, there is no noindex in the meta robots tag or the X-Robots-Tag header, and the canonical does not point somewhere else. Fail any one and the page cannot be indexed, no matter how good the content is. The checker above tests all five signals and gives a single verdict.

What is the difference between crawlability and indexability?

Crawlability is whether Googlebot can fetch the page; indexability is whether Google is allowed to include it in search results once fetched. They are controlled by different things. Crawlability is governed by robots.txt and server access (a Disallow rule or a WAF blocking Googlebot). Indexability is governed by the noindex directives and canonical. A page can be crawlable but not indexable (it has a noindex), or indexable in intent but not crawlable (blocked in robots.txt, so Google never reads the page). This tool checks both.

How do I check if a page can be indexed by Google?

Enter the URL above. The tool fetches it as Googlebot and reports each of the five signals: robots.txt crawl permission, HTTP status, the meta robots tag, the X-Robots-Tag header and rel=canonical, then gives a single Indexable or Not indexable verdict with the exact blocker. For your own site, Google Search Console URL Inspection gives the authoritative answer, but it only covers verified properties and one URL at a time.

Why is my page indexable but not indexed?

Being indexable only means Google is allowed to index the page. It still decides whether to. Common reasons an indexable page is not indexed: Google sees it as a duplicate of another page (often via a canonical or near-identical content), the content is judged thin or low value, the page is new and not yet crawled, or the site has limited crawl budget. To see which of your pages Google has actually indexed, and get alerted when one drops out, use index monitoring.

Can a page be blocked in robots.txt and still be indexed?

Yes, and this is the trap the tool flags as a conflict. If a page is disallowed in robots.txt, Googlebot cannot fetch it, so it never sees any noindex you added. Google can still index the URL itself from links pointing to it, usually with no description. To reliably keep a page out of the index, allow crawling and add a noindex, rather than blocking it in robots.txt.

How many URLs can I check at once?

The free tool checks up to 10 URLs per run and 50 per day. Enter one URL per line. For checking a whole site on a schedule, and being alerted the moment a page becomes non-indexable, a free SearchOptimo account raises the limits and monitors the URLs for you.