Indexing Problems: Why Google Is Not Showing Your Pages

When Google is not showing your pages, the cause is not always “bad SEO.” A page can be missing from Google because it was never discovered, could not be crawled, was blocked by robots rules, had a noindex directive, canonicalized to another URL, redirected, returned an error, looked like a duplicate, lacked enough value, or simply had not been recrawled yet.

The mistake is treating every indexing issue the same. Submitting a URL again will not fix a noindex tag. Rewriting content will not fix a blocked crawl. Adding keywords will not fix a canonical pointing to another page. A serious diagnosis needs to identify which part of the discovery-to-indexing pipeline failed.

This guide gives business owners, marketers, developers, and SEO teams a practical process for diagnosing why Google is not showing pages and what to do next. It uses Search Console evidence, technical checks, and page-quality review so fixes are targeted instead of superstitious.

Before working through this guide, set up Search Console with the Google Search Console Setup Guide. For a broader site-wide review, use the Technical SEO Audit Guide. If the issue is multiple pages competing, use the Keyword Cannibalization Guide.

Key Takeaways

• “Not showing in Google” can mean not discovered, not crawled, not indexed, indexed under another URL, or indexed but not ranking.
• Start with Search Console's URL Inspection and Page indexing report before changing content.
• Confirm the page returns a clean 200 status and is accessible to anonymous users and Googlebot.
• Check robots.txt, noindex, X-Robots-Tag, canonicals, redirects, and sitemap inclusion separately.
• A robots.txt block prevents crawling; it is not a reliable way to remove already-known URLs from search results.
• A noindex directive must be crawlable for Google to see it.
• Google may choose a different canonical than the one you declare.
• Sitemaps help discovery but do not guarantee indexing.
• “Crawled - currently not indexed” and “Discovered - currently not indexed” need different investigation paths.
• Indexing is not the same as ranking; an indexed page may still receive no impressions if it does not satisfy demand or competition.

Table of Contents

1. Define the Problem First

2. How Google's Indexing Pipeline Works

3. Use Search Console Before Guessing

4. Check Discovery Problems

5. Check Crawl Access and Server Response

6. Check Robots.txt, Noindex and X-Robots-Tag

7. Check Canonicals and Duplicate Selection

8. Check Redirects, 404s and Soft 404s

9. Check Sitemap Signals

10. Check Rendering and JavaScript Issues

11. Check Content Quality and Page Purpose

12. Troubleshoot Common Search Console Statuses

13. Fix Workflow by Problem Type

14. Measure Recovery

15. 100-Point Indexing Diagnosis Score

16. Frequently Asked Questions

Define the Problem First

People use “not indexed” loosely. Define the actual problem.

Different meanings

The fix depends on which statement is true.

Run the first five checks

For any URL, check:

1. Does the URL load for an anonymous user?

2. Does it return a 200 status?

3. Is it blocked by robots.txt?

4. Does it include noindex or an X-Robots-Tag?

5. What does Search Console URL Inspection say?

Do not rewrite the page until these basics are known.

How Google's Indexing Pipeline Works

A simplified pipeline is:

`text

discovery -> crawl -> render -> index selection -> serving/ranking

`

Discovery

Google needs to know the URL exists. It can discover URLs through links, sitemaps, redirects, external references, and other signals.

Crawling

Googlebot requests the page. Crawling can be affected by robots.txt, server errors, redirects, rate limits, firewall rules, login requirements, and availability.

Rendering

Google processes the page content and resources. If JavaScript, CSS, APIs, or resources fail, Google may not see the intended content.

Index selection

Google decides whether to index the page and which URL is canonical. A page can be crawlable but excluded because of noindex, duplicate content, canonical signals, soft 404 behavior, poor value, or other reasons.

Serving and ranking

Indexed pages can appear in search results, but indexing does not guarantee ranking. The page still needs relevance, quality, authority, user value, and competitive strength.

Use Search Console Before Guessing

Google's URL Inspection tool and Page indexing report provide direct evidence.

URL Inspection

Use URL Inspection to check:

• whether the URL is on Google
• indexed status
• Google-selected canonical
• user-declared canonical
• crawl allowed status
• last crawl date
• page fetch result
• indexing allowed status
• enhancements detected
• live URL test result

The indexed result shows what Google currently knows. The live test shows what Google can fetch now. If you fixed a page today, the live test may show the fix before the indexed result updates.

Page indexing report

The Page indexing report groups pages by indexing status. It helps identify site-wide patterns such as noindex, duplicate without user-selected canonical, alternate page with proper canonical, crawled currently not indexed, discovered currently not indexed, blocked by robots.txt, soft 404, server error, redirect, and not found.

Prioritize patterns affecting important pages.

Performance report

If a page is indexed but not getting traffic, use Performance:

• Filter by page.
• Review impressions.
• Review queries.
• Compare date ranges.
• Check device and country.
• Compare with related pages.

No impressions is different from low clicks. Low clicks can mean ranking, title, snippet, query intent, brand, or CTR issue.

Check Discovery Problems

A page that Google does not know about cannot be indexed.

Discovery checklist

Check whether the URL is present in:

• internal links
• navigation
• breadcrumbs
• related content
• category/product links
• XML sitemap
• HTML sitemap if used
• canonical tags
• hreflang clusters
• external links
• redirects from old URLs

Google's SEO Starter Guide emphasizes that links are a key way Google discovers pages. Orphan pages are more likely to be missed or crawled less often.

Common discovery failures

• New page published but not linked internally
• Sitemap not updated
• Page only reachable through site search
• JavaScript link without crawlable href
• Navigation hidden behind interactions
• Page behind login
• Infinite-scroll content without crawlable URLs
• Old URL not redirected after migration
• Canonical points to URL that is not linked anywhere

Fix discovery

Add:

• contextual internal links from related pages
• navigation or hub links for important pages
• sitemap inclusion for canonical indexable URLs
• redirects from relevant old URLs
• breadcrumb paths where appropriate

Then inspect the URL in Search Console and monitor crawling.

Check Crawl Access and Server Response

The URL must be crawlable.

HTTP status checks

Check:

• 200 OK for indexable pages
• 301/308 for permanent moves
• 302/307 for temporary moves
• 404 for missing pages
• 410 for intentionally gone pages
• 5xx for server errors
• timeout behavior
• CDN/firewall blocks
• mobile and desktop response differences

If a page intermittently returns 500 or times out, Google may reduce crawl attempts or fail to process it reliably.

Access checks

Make sure Googlebot and anonymous users can access:

• HTML document
• important CSS
• important JavaScript
• images needed for content
• API responses used to render main content
• structured data where rendered

Avoid blocking Google from resources it needs to understand the page.

Server log evidence

If available, check server logs:

• Did Googlebot request the URL?
• What status did it receive?
• How often does it crawl the template?
• Are crawl attempts hitting parameter traps?
• Are important pages rarely crawled?

Logs are especially helpful on large sites.

Check Robots.txt, Noindex and X-Robots-Tag

Robots controls are frequent causes of missing pages.

Robots.txt

robots.txt tells crawlers which paths they should not crawl. It does not reliably remove a URL from search results if Google already knows the URL from other sources.

Check:

• production robots.txt
• user-agent-specific rules
• disallow patterns
• sitemap declaration
• staging rules copied to production
• important CSS/JS blocked
• case-sensitive paths

Bad pattern:

`text

User-agent: *

Disallow: /

`

That blocks crawling sitewide.

Noindex meta tag

The robots meta tag can tell search engines not to index a page:

`html

<meta name="robots" content="noindex">

`

Google's robots meta tag documentation says the rule must be crawlable to be seen. If robots.txt blocks the page, Google may not see the noindex directive.

X-Robots-Tag

X-Robots-Tag is an HTTP header version of robots control. It is often used for PDFs, files, or server-level rules.

Check headers for:

• noindex
• none
• unavailable_after
• noarchive

A CMS page may look clean in source while a server header quietly noindexes it.

Check Canonicals and Duplicate Selection

Canonicalization decides which URL represents duplicate or similar content.

Canonical checks

Check:

• user-declared canonical
• Google-selected canonical in URL Inspection
• canonical URL status
• canonical URL indexability
• internal links to canonical URL
• sitemap includes canonical URL
• redirects agree with canonical
• hreflang references canonical URLs
• duplicate templates

Google's canonical documentation says canonical tags, redirects, and sitemap inclusion are signals, not absolute commands. Google may choose another canonical if it thinks another URL is a better representative.

Common canonical indexing issues

• Page self-canonicalizes incorrectly to another URL.
• Product variant canonicalizes to parent when variant deserves its own page.
• Category page canonicalizes to page one incorrectly.
• Staging URL appears in canonical.
• HTTP canonical on HTTPS page.
• Sitemap includes non-canonical URLs.
• Internal links point to duplicate URLs.

Fix canonical confusion

Align:

• canonical tag
• redirects
• sitemap
• internal links
• hreflang
• structured data URLs
• CMS URL settings

The clearer the signals, the easier index selection becomes.

Check Redirects, 404s and Soft 404s

Redirect and error handling can remove pages from the index.

Redirect issues

Check:

• redirect to wrong page
• redirect chains
• redirect loops
• temporary redirect used for permanent move
• mobile redirect mismatch
• old URLs redirecting to homepage
• query parameters losing important content

For permanent moves, use a relevant permanent redirect. Google's site move guidance warns against redirecting many unrelated old URLs to a single irrelevant destination, because that can confuse users and may be treated like a soft 404.

404 and 410

A 404 or 410 tells Google the page is missing or gone. That can be correct.

Use 404/410 when:

• page is truly gone
• no relevant replacement exists
• thin generated URL should not exist
• deleted test URL has no value

Use redirects when:

• there is a close replacement
• a product has a successor
• a service URL changed
• a migration moved content

Soft 404

A soft 404 happens when a page returns 200 but looks empty, irrelevant, or missing.

Examples:

• “No products found” category with indexable 200
• Deleted product redirected to homepage
• Empty search result page
• Thin placeholder page
• Error message page returning 200

Fix by adding useful content, redirecting to a relevant page, returning 404/410, or noindexing user-useful but search-low-value pages.

Check Sitemap Signals

Sitemaps help discovery and communicate preferred URLs, but do not force indexing.

Sitemap checklist

Check:

• sitemap URL loads
• sitemap returns 200
• sitemap is submitted in Search Console
• sitemap contains canonical URLs
• sitemap excludes noindex URLs
• sitemap excludes redirected URLs
• sitemap excludes duplicate parameter URLs
• sitemap excludes staging URLs
• sitemap updates when content changes
• sitemap is not over size limits

Google's sitemap documentation says sitemaps can help Google discover URLs and that each sitemap can contain up to 50,000 URLs or 50MB uncompressed. Larger sites should use multiple sitemaps or a sitemap index.

Sitemap status interpretation

If a submitted URL is not indexed, do not assume the sitemap failed. Investigate:

• canonical selection
• noindex
• robots blocks
• duplicate content
• content quality
• crawl demand
• internal links
• server response

Sitemap presence is one signal among many.

Check Rendering and JavaScript Issues

Some pages load for users but render poorly for Google.

Rendering checks

Compare:

• raw HTML source
• rendered HTML
• mobile rendering
• Search Console live test screenshot
• crawler-rendered output
• browser with JavaScript disabled where relevant

Look for:

• empty main content in source
• content loaded from blocked API
• links rendered as click handlers instead of hrefs
• metadata inserted inconsistently
• canonical changes after hydration
• structured data missing after render
• client-side errors
• paywall or login overlay hiding content
• lazy-loaded content not loading

Modern JavaScript sites can be indexable, but important content, links, and metadata should be reliable.

Check Content Quality and Page Purpose

Technical access is not enough. Google may crawl a page and still decide not to index it.

Quality checks

Review:

• Does the page satisfy a distinct intent?
• Is it original enough compared with other site pages?
• Is it useful without depending on another page?
• Does it have enough main content?
• Is the title accurate?
• Does the page match search demand?
• Does it provide current information?
• Is it overloaded with boilerplate?
• Does it duplicate a category, tag, or archive?
• Does it have internal links and context?

Google's SEO Starter Guide emphasizes creating helpful, reliable, people-first content and making pages understandable to users and search engines. Thin, duplicated, or unclear pages may not earn indexation even if technically allowed.

Indexing is not ranking

If a page is indexed but has no impressions:

• Search demand may be low.
• Query intent may not match.
• Competition may be strong.
• Page may be too weak.
• Internal links may be poor.
• The page may target the same intent as a stronger internal page.
• Search results may prefer another content type.

Use the Keyword Cannibalization Guide if another internal URL is more visible for the query.

Troubleshoot Common Search Console Statuses

Search Console wording changes over time, but these common statuses are useful to understand.

Discovered - currently not indexed

Google knows the URL but has not crawled it yet.

Investigate:

• weak internal links
• huge sitemap with low-value URLs
• crawl demand
• new site or new section
• server capacity
• duplicate-looking URL patterns
• low page importance

Fix:

• add internal links
• improve sitemap quality
• reduce crawl traps
• strengthen page purpose
• wait for recrawl where appropriate

Crawled - currently not indexed

Google crawled the URL but did not index it.

Investigate:

• thin content
• duplicate content
• canonical confusion
• soft 404 behavior
• low quality
• wrong page purpose
• content rendered poorly
• near-duplicate templates

Fix:

• improve content value
• clarify intent
• canonicalize duplicates
• merge competing pages
• improve internal links
• remove low-value generated pages

Duplicate without user-selected canonical

Google found duplicates but the site did not clearly declare a canonical.

Fix:

• choose primary URL
• add canonical
• update internal links
• clean sitemap
• redirect unnecessary duplicates

Alternate page with proper canonical

This is often expected. It means Google recognized this URL as an alternate and is indexing the canonical instead.

Action:

• Confirm the selected canonical is the intended page.
• No fix needed if correct.

Excluded by noindex

Google saw noindex.

Action:

• Keep if intentional.
• Remove noindex if the page should be indexed.
• Ensure robots.txt does not block the page if Google needs to see noindex.

Blocked by robots.txt

Google could not crawl because robots.txt disallowed the URL.

Action:

• Keep if intentional crawl control.
• Remove or adjust rule if the page should be crawled/indexed.

Page with redirect

Google sees the URL redirects.

Action:

• Fine if old URL intentionally redirects.
• Fix if canonical/indexable URL unexpectedly redirects.

Fix Workflow by Problem Type

Use the diagnosis to choose the fix.

Retest after fixes

After fixing:

• crawl the URL
• inspect in Search Console
• live test the URL
• request indexing for priority single URLs
• resubmit sitemap if many URLs changed
• monitor Page indexing report
• monitor Performance report

Do not expect immediate movement for every page.

Measure Recovery

Indexing recovery needs a baseline.

Baseline fields

Record:

• URL
• page type
• intended status
• Search Console status
• last crawl date
• user-declared canonical
• Google-selected canonical
• sitemap inclusion
• internal links
• issue found
• fix deployed
• deployment date
• retest date

Recovery metrics

Monitor:

• URL Inspection indexed status
• Page indexing report status
• impressions
• clicks
• query visibility
• crawl date
• canonical selection
• sitemap processing
• server errors
• conversions or leads

An indexing fix is not complete until the intended page is eligible and the business can see what happened afterward.

100-Point Indexing Diagnosis Score

Use this score to audit the diagnosis before making changes.

Scoring guidance:

• 90-100: Strong diagnosis; fixes can be prioritized confidently.
• 75-89: Good evidence with a few gaps.
• 60-74: Likely directionally correct but needs stronger checks before major changes.
• 40-59: Too much guessing; gather technical and Search Console evidence first.
• Below 40: Do not change content or redirects yet; rebuild the diagnosis.

Frequently Asked Questions

Why is Google not showing my page?

Common reasons include weak discovery, robots.txt blocks, noindex directives, X-Robots-Tag headers, server errors, redirects, 404/410 responses, soft 404 behavior, duplicate content, canonical selection, rendering problems, low content value, or simply no ranking visibility yet.

Is my page indexed if I can find it with a site search?

Sometimes, but site searches are not perfect diagnostics. Use Search Console URL Inspection for the specific URL. It gives clearer evidence about indexed status, canonical selection, crawl access, and last crawl.

Does submitting a sitemap guarantee indexing?

No. A sitemap helps Google discover URLs and understand which URLs you consider important. Google may still choose not to index a URL because of noindex, duplicates, canonicals, quality, crawl issues, or other reasons.

Should I request indexing in Search Console?

Use Request indexing for important individual URLs after publishing or fixing them. Use sitemaps for many URLs. Request indexing will not fix pages that are blocked, noindexed, broken, duplicate, or low value.

What does “Crawled - currently not indexed” mean?

It means Google crawled the URL but has not indexed it. Investigate content value, duplication, canonical signals, soft 404 behavior, rendering, and internal links.

What does “Discovered - currently not indexed” mean?

It means Google knows the URL but has not crawled it yet. Investigate internal links, sitemap quality, crawl traps, site size, server capacity, and whether the URL looks important.

Can robots.txt remove a page from Google?

robots.txt controls crawling, not guaranteed indexing. If Google already knows a URL, it may still show limited information. To prevent indexing, use noindex on a crawlable page, require login, or remove the page through the appropriate process.

Why did Google choose a different canonical?

Google may choose another canonical if signals are inconsistent or another URL appears to be a better representative. Align canonical tags, redirects, internal links, sitemap URLs, hreflang, and content.

How long does indexing take?

It varies. New or fixed pages can take hours, days, weeks, or longer depending on site authority, crawl demand, internal links, quality, and technical clarity. Monitor Search Console rather than guessing.

What should I do if many pages are not indexed?

Do not request indexing one by one. Audit patterns: templates, sitemaps, robots rules, canonicals, duplicate content, internal links, server errors, rendering, and page quality. For help, review the technical SEO audit service.