Google Indexing Crisis: Why Your Pages Are Stuck in Crawled-Not Indexed

Why Google Is Leaving Your Pages Out of the Index

Google has made a fundamental shift in what it considers worth indexing. At the Google Search Central event in Toronto in April 2026, a Googler explained that AI has lowered the bar for content creation. Now, the only content Google wants to add to its index is content that offers personal experience and knowledge no one else has. If your pages are stuck in “crawled – currently not indexed” in Google Search Console, it's almost certainly because Google judged them as not meeting that threshold.

According to the same Googler, when Google crawls a page and decides not to index it, there are two possible reasons: a technical issue (rare) or quality (the real culprit). The quality issue boils down to one concept: commodity content—content that rehashes what others have already written without adding anything new or more helpful.

This matters for your bottom line because if Google won't index your pages, they can't rank. No index means no organic traffic, no leads, no sales from those pages. And the problem is growing: the June 2026 spam update specifically targeted sites creating commodity content at scale, causing traffic drops with no manual action warning.

What “Crawled – Currently Not Indexed” Really Means

In Google Search Console, the “crawled – currently not indexed” status means Google visited your page, downloaded it, and then decided not to put it in the index. This is different from “discovered – currently not indexed,” which means Google knows the page exists but hasn't crawled it yet.

John Mueller and Martin Splitt discussed this in a recent Search Off the Record podcast. Mueller said that if Google's systems are “seriously worried about the quality of a website,” they will reduce the number of pages indexed. He advised that when you see a pattern of many pages not being indexed with no technical reason, you need to “take a step back and think about the quality overall.”

Importantly, Mueller noted that quality isn't just about the text. It includes the full user experience: excessive ads, interstitials, slow loading, and filler content all contribute to a page being deemed not worth indexing.

Commodity Content: The #1 Reason for Indexing Failure

Marie Haynes, the article's author, has analyzed many sites with this issue. She found that the stuck pages are usually “good, decent articles – as good as the pages that Google is ranking.” But that's exactly the problem: they aren't better. They offer nothing unique.

Google's Quality Rater Guidelines use the word “effort” 120 times. The message is clear: you need to demonstrate effort, expertise, and originality. If your content could have been written by anyone (or any AI) with a quick search, it's commodity content.

Haynes shared a real example: a site whose pages showed only a heading and boilerplate text when tested live. The cause was a robots.txt rule that blocked CSS and JavaScript files, preventing Google from seeing the actual content. That's a technical issue, but it's rare. In most cases, the problem is quality.

How to Diagnose Your Own Pages

To check if your pages have a technical issue, use the URL Inspection tool in Google Search Console. Click “Test Live URL” and see if Google can render the full content. If it can't, fix the technical block (e.g., robots.txt, server errors) and request reindexing.

If the content renders fine, the issue is quality. Haynes recommends a simple test: give your content to an AI like Gemini and ask, “Is this content likely to be considered commodity content?” Then ask for 20 ideas to add first-hand experience. She also created two free tools at tools.mariehaynes.com: one to filter out irrelevant URLs (like /feed/ pages) from your crawled-not indexed list, and another to check indexing status for your most important pages.

Strategic Implications for Your Business

This shift has major consequences for content strategy. The old playbook of covering a topic thoroughly and anticipating all related queries is now risky. Google may see that as “scaled content” and penalize it—even without a manual action. The June 2026 spam update likely hit sites that created commodity content at scale.

If your SEO agency relies on AI to produce content without human expertise, you're vulnerable. The solution requires effort: interview subject matter experts, share unique data, include personal stories, and demonstrate real-world experience. Google wants content that couldn't exist without the author's specific knowledge.

For business owners, the takeaway is clear: invest in content that only you can create. That might mean case studies, original research, detailed how-to guides based on your team's experience, or content that answers questions in a way no competitor has. If you can't add unique value, consider whether the page is worth publishing at all.

What This Means for Your Business

If you have a small site with a few dozen pages, you can likely fix this by improving each page's uniqueness. If you have a large site with hundreds or thousands of pages stuck, recovery will be difficult. Haynes warns that “for most sites, if you have a large number of pages you want indexed, but they are stuck in crawled-currently not indexed, recovery will be difficult.”

Focus your resources on the pages that matter most to your business goals. Use the GSC Index Checker tool to identify which high-value pages are not indexed, and prioritize improving those. For the rest, consider consolidating or removing them to avoid diluting your site's overall quality signal.

Finally, monitor Google's updates. The June 2026 spam update is a sign that Google is getting more aggressive. Stay informed through reliable sources like Search Engine Journal and Google's own podcasts.

Bottom Line

Google's indexing criteria have shifted from “is this content good?” to “is this content uniquely valuable?” If your pages don't offer personal experience or knowledge no one else has, they may never be indexed. The fix requires genuine effort and expertise—not more AI-generated volume. For most businesses, the smartest move is to audit your content, double down on what makes you unique, and let go of the rest.

Source: Search Engine Journal