Crawlability vs Indexability: Why Google Ignores Some Pages
In shortCrawlability = can Google reach the page? Indexability = is Google allowed and willing to store it? A page needs both to rank.
Crawlability: can Google get there?
Google discovers pages by following links and reading sitemaps. A page is hard to crawl when:
- robots.txt blocks it;
- no internal links point to it (an orphan page);
- links are buried in JavaScript that doesn’t render;
- the server is slow or returns errors;
- redirect chains send the bot through three or four hops.
Indexability: may Google keep it?
Even after crawling, a page is excluded when:
- it has a noindex meta tag or X-Robots-Tag header;
- its canonical tag points to another URL;
- it returns a non-200 status;
- Google judges it duplicate or low value.
The two statuses that confuse everyone
Discovered – currently not indexed: Google knows the URL but hasn’t crawled it yet. Usually a crawl budget or internal linking issue — link to the page from stronger pages.
Crawled – currently not indexed: Google visited and decided not to index. This is usually about quality or duplication. Improve the content, merge thin pages, and make sure the page answers something no other page on your site does.
A quick diagnosis routine
- Inspect the URL in Search Console.
- Check “Crawl allowed?” and “Indexing allowed?”.
- Compare user-declared vs Google-selected canonical.
- Count internal links pointing to the page.
- Ask honestly: is this page better than what already ranks?
I run this check across your whole site in a technical SEO audit and rank every blocked or excluded page by business impact.
Keep reading