What Just Happened?
Google's Search Console has been quietly recording AI conversation fragments as regular queries. An SEO specialist noticed odd queries like "yes" and "yes go on" in her reports, and John Mueller confirmed that AI Overviews and AI Mode data are included in the general performance report. This means every time someone tells an AI "yes go on" and your page appears in the response, Search Console logs an impression against that phrase.
Why This Matters for Your Business
This is a breakthrough for understanding how AI search actually drives traffic to your site. For the first time, you can see the real conversations that lead to AI citations—not just generic keywords. The data is small but revealing: one site found 1,127 such queries and 20,300 impressions over 16 months. That's a tiny fraction of total traffic, but every row represents a real person mid-decision, asking an AI to compare options or dig deeper.
The Strategic Opportunity
This leak gives you a competitive edge. Most businesses will ignore this data, but you can use it to optimize your content for AI visibility. The key is to identify which pages are being cited in AI responses and what questions they answer. For example, if you see a query like "what about resend?" on a page about email tools, that's a signal to add a comparison section. This is the kind of insight that can set you apart.
How to Access This Data
You don't need to be a technical wizard. A free tool called the Search Console MCP (v2.4.0) can classify these fragments into seven types, from reply artifacts to agent harnesses. It runs locally, so your data stays private. For larger sites, the BigQuery export offers even deeper access, with no row limits. The setup takes minutes, and the payoff is a clearer picture of your AI search presence.
The Bottom Line
AI search is no longer a black box. This leak is a window into how Google's AI sees your content. Act now to understand your AI visibility before your competitors do. The conversations are already happening—Google's just been taking minutes.
FAQ
Use a regex filter in Search Console to catch short replies like 'yes' or 'sure', or use the free Search Console MCP tool to classify them automatically.
Yes—if Google's AI shows your content in responses, you're already part of these conversations. The leak helps you see and optimize for that visibility.
