The Case For Auditing Your AI Visibility This Quarter

Stage One: The Answer Moves Onto the Results Page The first erosion was not artificial intelligence at all. It was the gradual addition of features that answered the query in place: definitions, calculators, weather, sports scores, opening hours, snippets lifted from a page and displayed above it.

Deciding Whether to Block Anything There is a legitimate argument for restricting training crawlers, particularly for publishers whose archive is the product. That is a commercial and editorial decision and it deserves a real discussion rather than a default.

The complication is that AI systems use several distinct agents for different purposes. One may crawl for training corpora, another may fetch pages live when composing an answer, and a search provider's traditional crawler may feed both search results and an ai seo company summary.

Establish What They Will Not Promise Nobody controls what a model says. There is no submission process, no ranking factor to buy, and no relationship with a provider that reserves you a place in an answer. Any guarantee of a specific position or mention is describing something the agency cannot deliver.

It is also worth recording the reason for every rule you keep. A disallow line with no explanation gets preserved indefinitely through migrations and redesigns because nobody dares remove something they do not understand. A one line comment saying who added it and why turns a permanent mystery into a decision that can be revisited.

What that implies for planning is modest and unpopular. Any strategy whose success depends on the current interface staying as it is has an unstated assumption in it, and the assumption has been wrong roughly every three years for a decade. Building on the parts that have survived every stage, which are a real product, direct relationships and a reputation independent of any platform, is not a thrilling recommendation and it has an unusually good record.

The decision that almost never makes sense for a commercial business is blocking the agents that fetch pages when composing answers. That is the mechanism by which you get recommended, and turning it off is the equivalent of declining to be listed anywhere, taken quietly, usually by accident.

What It Should Not Cost This is a defined piece of work with a defined output, and it should be priced that way. Be cautious about audits bundled inescapably into a twelve month retainer, since that structure gives the diagnosis a commercial interest in the treatment.

The Blocks Nobody Chose Most blocking discovered during audits was never a decision. A disallow copied from a template. A staging rule that survived a migration. A security plugin with an aggressive default. A content delivery network setting labelled bot protection with a switch nobody has looked at since launch.

This is the whole argument in one sentence, and it is why the audit is worth running even if you intend to do nothing with the findings for six months. The measurement is cheap. Reconstructing a baseline you never took is impossible.

Ask to See a Prompt Set The first question is the most revealing. Ask them to show you the prompt set from a current or recent client, with the client's name removed. A team doing real work has this and will show it, because the prompts are craft rather than secret sauce.

None of these are expensive to fix and all of them are total. A blocked crawler does not reduce your visibility, it eliminates it, and every day the block stands is a day of answers composed without you in them.

This is the pattern search followed, and there is no obvious reason for it to play out differently here. The advantage of early movement is not that the channel is large yet, it is that the positions are cheap.

What robots.txt Controls It is a request, honoured by mainstream crawlers, that certain user agents avoid certain paths. It has no enforcement behind it and it does not secure anything, but the major providers respect it.

A useful way to think about the sequence is that each stage moved a task from the user to the interface. First the fact, then the summary, and now the comparison. Each move removed a reason to visit a website, and each was followed by an industry insisting the change had been overstated. It is reasonable to expect the pattern to continue rather than to stop at a convenient point.

One reframing helps when presenting this internally. Report the channel as influence rather than acquisition. Acquisition framing invites a comparison against paid media on cost per lead, which this channel will lose on the reported numbers even where it is working, because most of its effect never appears as a referral. Influence framing invites the right question, which is whether more of your market arrives already knowing who you are.

The Cheapest Fixes Have a Deadline That Already Passed Audits routinely surface mechanical problems that have been quietly costing visibility for months. Crawlers blocked in robots.txt. A bot management product returning challenges to legitimate retrieval agents. Key content rendering only after JavaScript executes. Specifications trapped in a PDF.