Everything in SEO assumes something basic that almost nobody checks: whether Google has actually indexed the page. If it hasn’t, your title tags, schema, backlinks, and content quality don’t matter. The page cannot rank because, as far as Google is concerned, it simply doesn’t exist.
Indexation problems are quiet. There’s no error message and no notification. A page sits in your sitemap, looks perfectly normal in a browser, and simply never appears in search. On larger sites it’s routine to find hundreds of pages in this state, and most site owners have never looked.
Our free Bulk Index Checker lets you paste up to 100 URLs and see which are indexed in one pass. This post covers how to read the result and work through the causes in order.
TL;DR
A page can’t rank if it isn’t indexed, and indexation failures are usually caused by one of six things: blocked crawling, a noindex directive, a canonical pointing elsewhere, thin or duplicate content, poor internal linking, or simply not having been crawled yet. Check status in bulk with the free Bulk Index Checker or page-by-page in Google Search Console, then address the causes in order, starting with the easiest and most reversible ones first.
→ Check up to 100 URLs at once
What’s the difference between crawling and indexing?
Crawling is Google fetching your page; indexing is Google deciding to store it and make it eligible to rank. A page can be crawled and still not indexed, which is the most common and most frequently misread situation. The distinction matters because the fixes are completely different.
- Not crawled — Google hasn’t fetched the page yet. This is usually an access, discovery, or crawl-budget problem.
- Crawled, not indexed — Google fetched the page but chose not to store it. This is typically a judgment about quality, duplication, or overall value.
- Indexed — The page is stored and eligible to rank.
That middle state is the one that confuses people. “Crawled – currently not indexed” in Search Console is not a bug and not a technical error. It’s Google saying the page didn’t seem worth keeping. No amount of resubmitting fixes it; the page itself has to become worth indexing.
How do I check whether a page is indexed?
Three ways: run the URLs through a bulk index checker, use the URL Inspection tool in Google Search Console for a single page, or search site:yourdomain.com/page-url for a rough signal. Search Console is authoritative; bulk tools are faster when you’re checking many pages.
The practical workflow:
- Bulk-check the set — Paste up to 100 URLs into the Bulk Index Checker to find which ones are missing.
- Inspect the failures individually in Search Console’s URL Inspection tool to see Google’s specific reason.
- Group the failures by reason and fix the underlying patterns rather than working one page at a time.
A note on the site: operator: it’s a quick sanity check, not a reliable measurement. Results are approximate and the operator behaves inconsistently. Treat an absence as a prompt to check properly, not as proof.
Cause 1: Google can’t crawl the page
Check robots.txt and server responses first: if crawling is blocked, nothing downstream matters. This is the fastest thing to rule out and the most problematic when it happens to be the cause.
What to look for:
- robots.txt disallow rules blocking the path, often a leftover from staging
- Non-200 status codes — A page returning 404, 410, or 500 won’t be indexed. Check status codes in bulk with our Redirect & HTTP Status Checker.
- Login or paywall gating the content
- Server errors or timeouts during crawl windows (review Search Console’s Crawl Stats report)
- Content requiring JavaScript to render. Google can render JS, but it is slower and less reliable than plain HTML. AI crawlers also largely skip JS execution, as discussed in our AI crawler post.
Cause 2: A noindex directive
Check for a noindex meta tag or X-Robots-Tag header. An explicit noindex is the most common reason a crawlable page stays out of the index. It is also easy to miss because the page looks completely fine in a browser.
Where noindex hides:
- The WordPress “Discourage search engines” setting (Settings → Reading), routinely left on after launch
- SEO plugin defaults applied to a post type, category or tag archive
- Staging configuration shipped to production
- X-Robots-Tag HTTP headers set at the server or CDN, invisible in page source
That last one catches people out. If the HTML has no noindex but the page still won’t index, check the response headers.
Cause 3: A canonical pointing somewhere else
If a page canonicals to a different URL, Google treats that other URL as the authoritative version and omits this page from the index. This is working as intended, so the real problem is usually an incorrect canonical tag.
Common cases: a template bug canonicalising every page to the homepage, pagination canonicalising to page one, parameter URLs canonicalising to a version that no longer exists, or a canonical left pointing at a staging domain after migration.
Search Console reports this as “Duplicate, Google chose different canonical than user” or “Alternate page with proper canonical tag.” The second is usually fine. The first means Google disagreed with you, which is worth investigating.
Cause 4: Thin, duplicate or low-value content
The “Crawled – currently not indexed” status usually means Google decided the page wasn’t worth storing. This often happens because content is thin, near-duplicate, or doesn’t add value beyond existing indexed pages. In short, it is a content issue formatted as a technical status.
The pattern we see most often in audits:
- Templated pages at scale — Location or service pages that only swap out a city or service name. These are viewed as doorway pages, and search algorithms enforce quality standards strictly on them.
- Thin tag and category archives with no unique content
- Near-duplicate product variants
- Auto-generated or lightly edited bulk content (covered further in Should You Use AI to Write Your Content?)
The fix isn’t resubmitting the page. It requires consolidation, clear differentiation, or removal, following the framework outlined in Content Refresh & Pruning.
Cause 5: The page is orphaned or buried
Pages without internal links pointing to them are hard to discover and receive no internal authority. This makes Google slower to find them and less inclined to index them. Sitemaps help, but sitemap inclusion alone is not a strong indexing signal.
Fix by linking to the page from relevant existing content, keeping it within about three clicks of the homepage, and making sure it sits inside a logical section rather than floating. The full approach is in Internal Linking & Site Architecture.
Cause 6: It just hasn’t been crawled yet
New pages on sites with lower domain authority can take days or weeks to get indexed, which is standard behavior rather than a technical failure. Before troubleshooting, check when the page was published.
To speed things up, submit the URL via Search Console’s URL Inspection tool, confirm it appears in your XML sitemap, link to it from frequently crawled pages, and share it on active channels to drive initial traffic. Note that these steps improve discovery, but they do not guarantee indexing if Google decides the content lacks value.
To speed it up: submit the URL in Search Console’s URL Inspection, make sure it’s in your XML sitemap, link to it from pages that get crawled often, and share it somewhere that generates genuine traffic. None of these guarantee indexing — they improve discovery, not the quality judgement.
A diagnostic table
| Search Console status | What it means | First action |
|---|---|---|
| Discovered – currently not indexed | Known but not crawled | Check crawl budget, internal links, server speed |
| Crawled – currently not indexed | Crawled, judged not worth indexing | Improve or consolidate the content |
| Excluded by noindex tag | Explicit directive | Remove the noindex |
| Blocked by robots.txt | Crawling blocked | Fix robots.txt |
| Duplicate, Google chose different canonical | Google disagreed with your canonical | Check for near-duplicates |
| Page with redirect | URL redirects elsewhere | Expected — index the destination |
| Soft 404 | Looks empty or error-like | Add real content or return a proper 404 |
What not to do
- Don’t mass-resubmit URLs. Resubmission doesn’t change a quality judgement, and there are daily limits.
- Don’t buy indexing services. They mostly submit URLs you can submit yourself, and they don’t fix why Google skipped the page in the first place.
- Don’t assume every page should be indexed. Thin archives, internal search results and parameter URLs are often better left out. A smaller, higher-quality index is usually better.
- Don’t panic about a few unindexed pages. Some non-indexation is normal and healthy.
Frequently Asked Questions
Why is my page crawled but not indexed?
Google fetched the page and decided it was not worth storing, usually because it is thin, near-duplicate, or adds little value beyond what is already indexed. Since this is a quality assessment rather than a technical bug, simply resubmitting the URL will not help. The content needs to be expanded with unique insights or consolidated into another page.
How long does Google take to index a new page?
Anywhere from hours to several weeks, depending on your site’s authority, crawl frequency and internal linking. Established sites with frequent publishing often see indexing within a day; new or low-authority sites routinely wait weeks. Submitting in Search Console and linking internally both help discovery.
How do I check if my pages are indexed in bulk?
Paste up to 100 URLs into a bulk index checker like OptiSEOn’s free tool to see which are missing, then inspect the failures individually in Google Search Console for Google’s own stated reason.
Does submitting a URL in Search Console guarantee indexing?
No. Submitting a URL requests a crawl, but it does not force Google to index it. If Google crawls the page and finds low value, it will still leave it unindexed. Requesting indexing aids discovery, not quality evaluation.
Should all of my pages be indexed?
No. Thin tag archives, internal search results, parameter URLs and paginated series often shouldn’t be. A focused index of genuinely valuable pages tends to perform better than a bloated one, so deliberate exclusions are a sign of good hygiene rather than a problem.
Can a page be indexed and still get no traffic?
Yes, and it’s common. Indexing makes a page eligible to rank; it doesn’t mean it ranks well or that anyone searches for what it covers. If indexed pages get no impressions, the issue is keyword targeting or competitiveness rather than indexation.
Find out which of your pages are actually indexed. Check up to 100 URLs for free. If a large portion is missing, there is usually a systematic issue behind it. Book a free audit and we will help you fix it.









