---
title: 'Google AI Mode and your website: what to check, from Google''s own rules'
description: >-
  Google says AI Mode needs no special markup or files. We checked our own site
  against the rules it does set: four settings that can still keep you out.
author: elroot_labs
date: '2026-11-18'
categories:
  - digital-infrastructure
---
To appear as a supporting link in Google AI Mode, a page has to be indexed and eligible to show a snippet in ordinary Google Search. Google's guidance on [AI features and your website](https://developers.google.com/search/docs/appearance/ai-features) lists no other technical requirement, and says site owners do not need to create new machine-readable files or add special schema.org markup. So the useful work is checking the four settings that can quietly make a page ineligible: robots.txt, the robots meta tag, snippet limits, and indexing itself. We ran that check on our own site, and this post shows how.

## Indian searches for AI Mode tripled in a year

In our Google Trends pull on 16 November 2026, interest in "google ai mode" in India scored 24 in the week of 16 November 2025, 68 by mid-May 2026, a peak of 87 in August and 74 in early November. A query in Hindi script, "एआई मोड", was marked Breakout, and "google ka ai mode" was a rising related query, a sign that the feature is reaching people who search in Hindi and Hinglish. Those are relative numbers from Trends, which never gives volumes, but the direction is clear and it matches what the feature is designed for: longer questions answered with a summary and a handful of links.

For a business that sells to Indian buyers, the practical question is whether your pages can be among those links, and what you can measure.

## Check 1: robots.txt must let Googlebot in

Google's page states that robots.txt directives for Googlebot are the control for managing access. If Googlebot cannot crawl a page, it cannot be indexed, and it cannot be cited.

When we first ran this check, our robots.txt allowed every crawler except two paths, /admin and /api, and had a second group naming several AI crawlers, including GPTBot, ClaudeBot, PerplexityBot and Google-Extended, with the same allow rules. We moved the site to a new build on 16 November, and its robots.txt is simpler: one group for every crawler, allowing everything except the admin area, plus the sitemaps. Neither version affects AI Mode differently. Google-Extended is the token Google describes for limiting use in training and grounding in some of its other systems; AI Mode and AI Overviews are part of Search and follow Googlebot.

The mistake to look for is the reverse: a blanket `Disallow: /` left over from a staging site, or a rule that blocks the folder where your guides live. Open yourdomain/robots.txt and read it, line by line.

## Check 2: no noindex on pages you want cited

The [robots meta tag documentation](https://developers.google.com/search/docs/crawling-indexing/robots-meta-tag) lists `noindex` as the rule that keeps a page out of search results. It can be set in a meta tag in the HTML or in an X-Robots-Tag HTTP header, and the header is the one people forget, because it does not show up when you view the page source.

On our new site, the robots meta tag on every page we checked sets only `max-image-preview:large`, which leaves indexing at its default of index and follow, and none sends an X-Robots-Tag header. Checking the header takes one command:

`curl -sI YOUR-PAGE-URL | grep -i x-robots-tag`

No output means no header. Run it on a few page types (home, a service page, a blog post), because frameworks and plugins often set headers per route.

## Check 3: snippet limits decide how much can be quoted

This is the setting most likely to matter for AI features. Google's guidance says that to limit the information shown from your pages in Search, you use `nosnippet`, `data-nosnippet`, `max-snippet` or `noindex`.

- `nosnippet` means no text snippet, and the [robots meta tag documentation](https://developers.google.com/search/docs/crawling-indexing/robots-meta-tag) says it also stops the content being used as a direct input for AI Overviews and AI Mode.
- `max-snippet:[number]` caps the characters used as a snippet and, by the same page, how much content can be a direct input to those AI features. `max-snippet:0` is the same as nosnippet; `-1` lets Google choose the length.
- `data-nosnippet` on a span, div or section hides that element's text from snippets while the rest of the page stays eligible.

Our old pages sent `googlebot: index, follow, max-image-preview:large, max-snippet:-1, max-video-preview:-1`, the most permissive setting. The new site sets no snippet limit at all, which has the same effect: Google chooses how much to quote. Either way it is the right choice for a services business that wants its explanations quoted. A publisher with paywalled articles might reasonably choose differently. The point is to make the choice on purpose: search your templates for `nosnippet` and `max-snippet`, because they are sometimes added by an SEO plugin's default and then forgotten.

## Check 4: the page must be indexed, which only Search Console can confirm

The first three checks show that a page is allowed into the index. They do not show that it is in. Search Console's URL Inspection tool answers that for one URL, and its page indexing report answers it for the site.

Google states that traffic from AI features is included in the Search Console Performance report, within the "Web" search type. It mentions no separate AI Mode filter, so you cannot isolate AI Mode clicks there. What you can watch is the set of long, question-shaped queries in the Performance report, since those are the searches AI Mode is built to answer, and whether your pages appear for them.

## What Google says you do not need

Google's own list of what you can skip is short, and it saves time to take it at its word:

- No llms.txt or other "AI text file" is needed for AI Mode.
- No special structured data is needed. Structured data still helps ordinary rich results, as our post on [AI search optimisation](/blog/ai-search-optimization-chatgpt) covers, and Google asks that markup match the visible text.

Google describes AI Mode as possibly using "query fan-out", running several related searches across subtopics to find a wider set of supporting pages. Our reading is that this favours a page that answers one specific question in its first paragraph, because one of the narrower searches can find it even if it would never rank for the broad one.

## The 15-minute version

For a small site, the whole check fits in a quarter of an hour:

1. Read robots.txt and confirm Googlebot can reach the pages you care about.
1. View source on three page types and search for `noindex`, `nosnippet` and `max-snippet`.
1. Run the curl command for X-Robots-Tag on the same three pages.
1. Inspect one important URL in Search Console and confirm it is indexed.
1. In the Performance report, filter queries with the custom regex `^(\S+\s+){4,}\S+$` to see searches of five or more words, and note which pages appear.

If all five pass, the remaining work is the same as it was before AI Mode: pages that answer real questions with something only you can say.
