<?xml version="1.0"?>
<feed xmlns="http://www.w3.org/2005/Atom" xml:lang="en">
	<id>https://wiki-babylonsignalis.org/index.php?action=history&amp;feed=atom&amp;title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers</id>
	<title>How Llms.txt And Robots.txt Affect AI Crawlers - Revision history</title>
	<link rel="self" type="application/atom+xml" href="https://wiki-babylonsignalis.org/index.php?action=history&amp;feed=atom&amp;title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers"/>
	<link rel="alternate" type="text/html" href="https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;action=history"/>
	<updated>2026-09-11T22:14:15Z</updated>
	<subtitle>Revision history for this page on the wiki</subtitle>
	<generator>MediaWiki 1.45.1</generator>
	<entry>
		<id>https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=121842&amp;oldid=prev</id>
		<title>LilianaCruicksha at 14:26, 19 August 2026</title>
		<link rel="alternate" type="text/html" href="https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=121842&amp;oldid=prev"/>
		<updated>2026-08-19T14:26:02Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 14:26, 19 August 2026&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l1&quot;&gt;Line 1:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 1:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The Blocks Nobody Chose Most blocking discovered during audits was never &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;decision. A disallow copied from a template. A staging rule that survived a migration. A security plugin &lt;/del&gt;with &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;an aggressive default&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A content delivery network setting labelled bot protection with a switch nobody has looked at since launch&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Where the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Work Is Genuinely the Same The foundations do not change&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Crawlable pages&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;sane site structure, fast rendering, accurate structured data, internal links &lt;/del&gt;that &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;reflect how topics relate&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;content that answers a real question all serve both channels&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The exception is &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;category where assistant use at &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;research stage is already heavy and where the incumbent comparison &lt;/del&gt;pages &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;are weak&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;There the newer &lt;/del&gt;channel &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;can be underpriced&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;moving early &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;worth more than it will be in two years&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The same caution applies to referral growth figures&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which circulate widely without their context. One widely shared statistic showing several hundred percent growth in assistant referrals came from a sample of nineteen analytics properties. That &lt;/del&gt;is a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;real observation and &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;genuinely small sample&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and the difference matters when you are deciding where to move budget&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The writing skill sits in the middle&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It can be taught to &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;good writer in a few weeks&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;having &lt;/del&gt;it &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;in&lt;/del&gt;-&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;house pays off permanently, because every page &lt;/del&gt;you &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;publish afterwards is better for it. The main obstacle is &lt;/del&gt;not &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;difficulty but reluctance, since writing to be quoted means surrendering some of the &lt;/del&gt;control &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;that persuasive copy provides&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;answer engine optimization&lt;/del&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;This is the least interesting subject &lt;/del&gt;in the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;discipline &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the one &lt;/del&gt;that &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;most often explains a total absence from generated &lt;/del&gt;answers. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A brand can do everything else correctly &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;remain invisible because &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;line in &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;text file&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;or a setting nobody remembers enabling&lt;/del&gt;, is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;turning the relevant crawlers away&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;decision that almost never makes sense for &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;commercial business is blocking the agents that fetch pages when composing answers. That is the mechanism by which you get recommended&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;turning it off is &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;equivalent &lt;/del&gt;of &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;declining &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;be listed anywhere, taken quietly, usually by accident&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;What Not &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Do &lt;/del&gt;in the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Name of Legibility Hidden text intended only for machines fails on every axis. It is detectable&lt;/del&gt;, it &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;violates most guidelines, &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it produces exactly the uniform low quality signal you were trying to avoid&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Get the Basics Right Before Anything Clever Once access is confirmed&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;check that content actually exists for a crawler &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;read&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Load your important pages with JavaScript disabled. If your specifications, pricing&lt;/del&gt;, service &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;areas or contact details vanish, they are effectively absent from this channel regardless of how permissive &lt;/del&gt;your &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;robots file is&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Fair Reasons for Flat Results Not every flat quarter is a failure, &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;being unfair about this loses good suppliers. A saturated category takes longer. A site that needed substantial technical &lt;/del&gt;work &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;will have spent &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;first months on it&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Earned coverage depends on other organisations publishing&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which nobody can schedule&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Assistant measurement &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;not there yet&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;There &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;no console reporting how often you were named&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;answers vary between sessions and accounts, and referral traffic &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;attributed inconsistently across assistants&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The honest approach &lt;/del&gt;is a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;fixed prompt set run &lt;/del&gt;on &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a schedule, with the raw answers kept, and any tool metric attributed to the tool that produced it&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Writing Prompts That Sound Like Customers &lt;/del&gt;The &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;foundational skill is deceptively mundane&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Somebody has to &lt;/del&gt;write &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the questions your buyers actually ask&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;in &lt;/del&gt;their &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;words, without the category vocabulary your team uses internally&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Ask what &lt;/del&gt;was done&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;, not what happened&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;If listings were corrected, pages rewritten and outreach attempted&lt;/del&gt;, and the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;numbers are still flat, that is information &lt;/del&gt;about &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the market. If none of &lt;/del&gt;it &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;happened, the numbers were never going to move&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The test that keeps this honest is simple. Show &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;rewritten page &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;somebody who buys from you &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;ask whether &lt;/del&gt;it is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;clearer. If &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;answer is no, no amount of extraction friendliness makes it a good page&lt;/del&gt;. [https://www.88pianists.com/ &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;answer engine optimization&lt;/del&gt;]&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;skill is knowing to sort cited domains by frequency&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;recognise which of them can be influenced&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;understand that a competitor appearing in an answer is usually a story about a third party page &lt;/del&gt;rather than &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;about their website&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;That &lt;/del&gt;is a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;different analytical habit &lt;/del&gt;from the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;one search built&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;None of them are harmful&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;They just consume implementation &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;maintenance time that would achieve more if spent making &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Organization markup accurate everywhere, or correcting &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;directory listing that has your old address on it&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Put someone&#039;s name against this&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Crawler rules sit between marketing&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;development and whoever administers &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;content delivery network&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which in most organisations means nobody checks them. The failures documented here are &lt;/del&gt;not &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;difficult to find&lt;/del&gt;, they &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;are simply nobody&#039;s job, &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a quarterly review taking half an hour prevents the most complete form of invisibility available&lt;/del&gt;.&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;That sequence typically takes &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;few weeks per source, and the effect on answers follows once enough of the recurring sources agree &lt;/ins&gt;with &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;each other&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;This is the phase where identity work begins to pay, and it is slower than people expect because it depends on other people&#039;s publishing schedules&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Where the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Distinction Does Matter One place, and it is worth being alert to&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Read broadly&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;answer engine optimization includes surfaces &lt;/ins&gt;that &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;are not generative at all&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;such as featured snippets &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;structured result features&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Search marketing has &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;long history of reporting numbers that rise while &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;business does not. Impressions, rankings for terms nobody buys on, traffic to &lt;/ins&gt;pages &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;with no commercial intent&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The new &lt;/ins&gt;channel &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;has arrived with its own version of this&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the version is worse, because there &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;no independent console to check the claims against&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Whether It Is Worth Doing Yet That depends on your category. If your buyers research before they commit&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the exposure is already there and waiting &lt;/ins&gt;is a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;choice with &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;cost. If people buy from you on price or proximity without research&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;this can safely sit lower on your list&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Existing reputation helps disproportionately&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A brand with review volume, press history and consistent details is starting from &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;partly assembled record. A brand with none of that is building identity from scratch&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;identity work is slow because &lt;/ins&gt;it &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;depends on re&lt;/ins&gt;-&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;crawling sources &lt;/ins&gt;you &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;do &lt;/ins&gt;not control.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Answer Engine Optimization Older and broader &lt;/ins&gt;in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;origin. It predates &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;current generation of assistants &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;originally covered any surface &lt;/ins&gt;that answers &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;directly, including featured snippets, knowledge panels and voice assistants&lt;/ins&gt;.&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;What Changed For twenty years, finding a supplier meant typing a query &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;being handed &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;list. You compared &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;few results&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;formed your own opinion and chose. The businesses that appeared near the top of that list got most of the attention&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;why an entire industry grew up around getting there&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;third question matters most. A good answer names &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;cause&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;attaches a number &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;admits an alternative explanation. A weak answer describes activity in &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;language &lt;/ins&gt;of &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;effort without connecting it &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;anything observable&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Connect It &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Something &lt;/ins&gt;in the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Business Referral traffic from assistant domains should be segmented in analytics and tracked&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;with the understanding that &lt;/ins&gt;it &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;undercounts. Some assistants strip referrer data &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;some visits arrive looking direct&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Being named in answers to prompts with buying intent&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;as opposed &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;definitional prompts nobody purchases from&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Being described accurately&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;since a confident recommendation containing a wrong price or a &lt;/ins&gt;service &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;you discontinued costs more than absence. And being cited on the third party sources that appear repeatedly in &lt;/ins&gt;your &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;category&#039;s answers&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Month Two: Corrections &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the First Rewrites The &lt;/ins&gt;work &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;should now be concentrated on the recurring sources from &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;baseline&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Expect a list of listings claimed, details corrected and errors submitted&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;with names and dates attached&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;None of these are traffic numbers, which &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the uncomfortable part. Much of the value in this channel arrives without a click and shows up weeks later as somebody who already knew what you did before they contacted you&lt;/ins&gt;.&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;That emphasis &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;worth watching&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;since retrieval &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;where most current influence actually lies&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A proposal built primarily on getting into training data &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;describing &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;slower and far less controllable mechanism than one built &lt;/ins&gt;on &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;being retrievable now&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;terms are used almost interchangeably&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Generative engine optimization usually emphasises assistants that &lt;/ins&gt;write &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;an answer&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;while answer engine optimization is sometimes used more broadly. Ask any agency what they mean by &lt;/ins&gt;their &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;term&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;What Honest Reporting Contains The prompt set, versioned and unchanged since last month. The raw answers, kept in full rather than summarised. Which competitors were named. Which sources were cited. What work &lt;/ins&gt;was done. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;What moved&lt;/ins&gt;, and the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;specific claim &lt;/ins&gt;about &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which work caused &lt;/ins&gt;it.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Expect &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;vocabulary to keep shifting, and expect new terms &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;arrive with each wave of positioning. The underlying work has been stable since these systems started retrieving live sources, &lt;/ins&gt;and it is the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;work rather than the name that you are buying&lt;/ins&gt;. [https://www.88pianists.com/ &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;ai visibility agency&lt;/ins&gt;]&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One thing to establish in week one is where everything lives. &lt;/ins&gt;The &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;prompt set&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the baseline archive&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the raw answers &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the correction log should sit somewhere you control from the beginning &lt;/ins&gt;rather than &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;in the agency&#039;s systems&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Retrieving them later &lt;/ins&gt;is a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;negotiation. Having them &lt;/ins&gt;from the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;start is an administrative decision nobody objects to at the outset&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;If your category still gets meaningful traffic from those, a proposal scoped only to assistants will leave that work undone&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Conversely, if somebody proposes an answer engine optimization programme &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;delivers only snippet optimisation, they are working on &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;older half of &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;definition&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Watch the quality of enquiries as well as the count&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A common early signal is that conversations start further along&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;with &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;prospect already aware of your price band&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;your typical timeline and what you do &lt;/ins&gt;not &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;do&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;because a machine told them before &lt;/ins&gt;they &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;arrived. That shows up in sales cycle length &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;in fewer wasted calls long before it shows up in any dashboard&lt;/ins&gt;.&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>LilianaCruicksha</name></author>
	</entry>
	<entry>
		<id>https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=121828&amp;oldid=prev</id>
		<title>Edward91S0 at 14:20, 19 August 2026</title>
		<link rel="alternate" type="text/html" href="https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=121828&amp;oldid=prev"/>
		<updated>2026-08-19T14:20:29Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 14:20, 19 August 2026&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l1&quot;&gt;Line 1:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 1:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;If the budget is substantial, add the earned coverage work, which is the slowest and most expensive component and the one you genuinely cannot do quickly on your own. Buying that first, before the cheap fixes are done, is the most common way money gets wasted in this field. [https://www.88pianists.com/ ai seo services]&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;What robots.txt Controls It is a request, honoured by mainstream crawlers, that certain user agents avoid certain paths. It has no enforcement behind it and it does not secure anything, but the major providers respect it.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Set up a simple internal rule to stop the problem returning. One document holding the canonical name, address, founding year, leadership and product names, referenced by anyone creating a new profile, listing or account. Fragmentation is almost never a single decision, it is dozens of small ones made by people who had no way of knowing what the canonical version was.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The condition is that the output has to be yours to keep and act on elsewhere, including the prompt set. An audit that only makes sense inside that agency&#039;s retainer is a sales document with a price attached.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;/del&gt;The Blocks Nobody Chose Most blocking discovered during audits was never a decision. A disallow copied from a template. A staging rule that survived a migration. A security plugin with an aggressive default. A content delivery network setting labelled bot protection with a switch nobody has looked at since launch.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;What Has Not Changed It is worth being clear about &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;continuities, because &lt;/del&gt;the change &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;is regularly oversold. Organic search still delivers the larger share of traffic for most businesses&lt;/del&gt;. Crawlable, fast, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;well &lt;/del&gt;structured &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;sites still win. Content &lt;/del&gt;that &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;genuinely &lt;/del&gt;answers a question &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;still outperforms content that does not&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Identity work has an unusual property that makes &lt;/del&gt;it &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;easy &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;undervalue: it improves everything else &lt;/del&gt;you &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;do afterwards&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Every mention earned after &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;details are consistent contributes &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;one record&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;while &lt;/del&gt;every &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;mention earned before &lt;/del&gt;it &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;may &lt;/del&gt;be &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;filed somewhere it does nothing. Doing the tedious part first &lt;/del&gt;means the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;expensive part later actually accumulates, which reverses the order most programmes choose&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Each addition removed &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;class of query &lt;/del&gt;from &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the click economy&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Sites that had built traffic on simple factual answers lost it first, &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the lesson available at the time&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which most of the industry declined to learn&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;was that owning a fact &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;not a durable position&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Assume &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;pitch is good&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Everyone&#039;s pitch &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;good&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the vocabulary in this field &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;easy enough that a competent salesperson can hold a convincing conversation without anyone behind them who can do &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;work&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Ask &lt;/del&gt;What &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;They Will &lt;/del&gt;Not Do &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Good practitioners have a list. They will not guarantee a position &lt;/del&gt;in &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;an answer, because nobody controls that&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;They will not fabricate reviews or seed forum threads under false identities&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;because &lt;/del&gt;it &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;is detectable&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;damaging &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;increasingly enforced against&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Ask &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;See Their Own Position This one is unfair and revealing&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Ask an assistant to recommend an agency for this kind of work&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;using a prompt a buyer would write&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and see whether the company sitting in front &lt;/del&gt;of &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;you appears&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Be wary of pricing tied to &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;proprietary visibility score&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;since the vendor controls both the number &lt;/del&gt;and the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;prompt set that produces &lt;/del&gt;it. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Be equally wary of performance pricing tied to mentions&lt;/del&gt;, which &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;sounds aligned and creates pressure to game the measurement rather than improve the business&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The Human Layer Companies are abstract &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;people are concrete&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;why named individuals do disproportionate work in establishing identity&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A founder or author with &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;real profile elsewhere&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;consistent across places&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;gives the system something durable &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;attach &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;organisation to&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;This entire area usually amounts &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a day of work. It is routinely &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;difference between a brand that appears &lt;/del&gt;in &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;answers &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;one that does not&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;worth doing before anybody writes a single word &lt;/del&gt;of &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;new content&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;ai seo services&lt;/del&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;honest position is &lt;/del&gt;that &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;attribution in &lt;/del&gt;this &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;channel &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;harder than in any other &lt;/del&gt;you &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;are currently running, &lt;/del&gt;and the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;field has responded to that difficulty mostly by inventing numbers. Confident figures circulate widely&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and a surprising share &lt;/del&gt;of &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;them trace back to &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;vendor&#039;s own sample or to a study far smaller than the claim implies&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Stage One: &lt;/del&gt;The &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Answer Moves Onto the Results Page The first erosion was not artificial intelligence at all. It was the gradual addition &lt;/del&gt;of &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;features &lt;/del&gt;that &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;answered the query &lt;/del&gt;in &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;place: definitions, calculators, weather, sports scores, opening hours, snippets lifted from &lt;/del&gt;a page &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and displayed above it&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Absence is not disqualifying on its own, since their category is crowded &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;they may serve a niche. But they should have an interesting answer&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;answer should not be defensive. A practitioner who &lt;/del&gt;has &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;run this test &lt;/del&gt;on &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;themselves will have thought about &lt;/del&gt;it &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and will tell you what they found&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The last of these is &lt;/del&gt;the most &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;common and the hardest &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;see&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;because it produces no error anyone internally encounters. Your site works perfectly in every browser while returning &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;challenge page to every legitimate retrieval agent&lt;/del&gt;.&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;The Blocks Nobody Chose Most blocking discovered during audits was never a decision. A disallow copied from a template. A staging rule that survived a migration. A security plugin with an aggressive default. A content delivery network setting labelled bot protection with a switch nobody has looked at since launch.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Where &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Work Is Genuinely &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Same The foundations do not &lt;/ins&gt;change. Crawlable &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;pages, sane site structure&lt;/ins&gt;, fast &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;rendering&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;accurate &lt;/ins&gt;structured &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;data, internal links that reflect how topics relate, and content &lt;/ins&gt;that answers a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;real &lt;/ins&gt;question &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;all serve both channels&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The exception is a category where assistant use at the research stage is already heavy and where the incumbent comparison pages are weak. There the newer channel can be underpriced, and moving early is worth more than &lt;/ins&gt;it &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;will be in two years.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The same caution applies &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;referral growth figures, which circulate widely without their context. One widely shared statistic showing several hundred percent growth in assistant referrals came from a sample of nineteen analytics properties. That is a real observation and a genuinely small sample, and the difference matters when &lt;/ins&gt;you &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;are deciding where to move budget&lt;/ins&gt;.&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The writing skill sits in &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;middle. It can be taught &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a good writer in a few weeks, and having it in-house pays off permanently&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;because &lt;/ins&gt;every &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;page you publish afterwards is better for &lt;/ins&gt;it&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;. The main obstacle is not difficulty but reluctance, since writing to &lt;/ins&gt;be &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;quoted &lt;/ins&gt;means &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;surrendering some of &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;control that persuasive copy provides&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;answer engine optimization&lt;/ins&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;This is the least interesting subject in the discipline and the one that most often explains &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;total absence &lt;/ins&gt;from &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;generated answers&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A brand can do everything else correctly &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;remain invisible because a line in a text file&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;or a setting nobody remembers enabling&lt;/ins&gt;, is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;turning the relevant crawlers away&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The decision that almost never makes sense for a commercial business is blocking &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;agents that fetch pages when composing answers&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;That &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the mechanism by which you get recommended&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;turning it off &lt;/ins&gt;is the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;equivalent of declining to be listed anywhere, taken quietly, usually by accident&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;What Not &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;to &lt;/ins&gt;Do in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the Name of Legibility Hidden text intended only for machines fails on every axis&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It is detectable&lt;/ins&gt;, it &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;violates most guidelines&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it produces exactly the uniform low quality signal you were trying to avoid&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Get the Basics Right Before Anything Clever Once access is confirmed, check that content actually exists for a crawler &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;read. Load your important pages with JavaScript disabled&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;If your specifications, pricing&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;service areas or contact details vanish&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;they are effectively absent from this channel regardless &lt;/ins&gt;of &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;how permissive your robots file is&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Fair Reasons for Flat Results Not every flat quarter is &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;failure&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;being unfair about this loses good suppliers. A saturated category takes longer. A site that needed substantial technical work will have spent &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;first months on &lt;/ins&gt;it. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Earned coverage depends on other organisations publishing&lt;/ins&gt;, which &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;nobody can schedule&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Assistant measurement is not there yet. There is no console reporting how often you were named, answers vary between sessions &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;accounts&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and referral traffic &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;attributed inconsistently across assistants&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The honest approach is a fixed prompt set run on &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;schedule&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;with the raw answers kept&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and any tool metric attributed &lt;/ins&gt;to the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;tool that produced it&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Writing Prompts That Sound Like Customers The foundational skill is deceptively mundane. Somebody has &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;write &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;questions your buyers actually ask, &lt;/ins&gt;in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;their words, without the category vocabulary your team uses internally.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Ask what was done, not what happened. If listings were corrected, pages rewritten &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;outreach attempted&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the numbers are still flat, that &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;information about the market. If none &lt;/ins&gt;of &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it happened, the numbers were never going to move&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;test &lt;/ins&gt;that &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;keeps &lt;/ins&gt;this &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;honest &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;simple. Show the rewritten page to somebody who buys from &lt;/ins&gt;you and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;ask whether it is clearer. If &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;answer is no&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;no amount &lt;/ins&gt;of &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;extraction friendliness makes it &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;good page. [https://www.88pianists&lt;/ins&gt;.&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;com/ answer engine optimization]&lt;/ins&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;skill is knowing to sort cited domains by frequency, recognise which &lt;/ins&gt;of &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;them can be influenced, and understand &lt;/ins&gt;that &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a competitor appearing &lt;/ins&gt;in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;an answer is usually a story about &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;third party &lt;/ins&gt;page &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;rather than about their website. That is a different analytical habit from the one search built&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;None of them are harmful. They just consume implementation &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;maintenance time that would achieve more if spent making the Organization markup accurate everywhere&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;or correcting &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;directory listing that &lt;/ins&gt;has &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;your old address &lt;/ins&gt;on it.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Put someone&#039;s name against this. Crawler rules sit between marketing, development and whoever administers &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;content delivery network, which in &lt;/ins&gt;most &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;organisations means nobody checks them. The failures documented here are not difficult &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;find, they are simply nobody&#039;s job&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;quarterly review taking half an hour prevents the most complete form of invisibility available&lt;/ins&gt;.&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>Edward91S0</name></author>
	</entry>
	<entry>
		<id>https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=115811&amp;oldid=prev</id>
		<title>RufusRace6 at 12:22, 18 August 2026</title>
		<link rel="alternate" type="text/html" href="https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=115811&amp;oldid=prev"/>
		<updated>2026-08-18T12:22:02Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 12:22, 18 August 2026&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l1&quot;&gt;Line 1:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 1:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;What you are looking for &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;whether &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;questions sound like a buyer wrote them&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;If every prompt contains &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;client&#039;s category name phrased &lt;/del&gt;the way &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;an internal marketing team would phrase it, they have tested how the brand talks rather than how customers ask&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The last of these &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the most common &lt;/del&gt;and the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;hardest to see, because &lt;/del&gt;it &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;produces no error anyone internally encounters. Your site works perfectly in every browser while returning a challenge page to every legitimate retrieval agent&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Decide What &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Result Means Four outcomes&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;each pointing somewhere different. Absent everywhere with a clean robots file &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;no third party listings usually means an identity and coverage problem. Absent with &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;blocked crawler &lt;/del&gt;or &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;an empty non-JavaScript page means &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;mechanical problem&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which &lt;/del&gt;is the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;good news outcome because it is cheap&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Month Two: Corrections and &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;First Rewrites The work should now &lt;/del&gt;be &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;concentrated &lt;/del&gt;on the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;recurring sources from the baseline&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Expect &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;list of listings claimed, details corrected and errors submitted, &lt;/del&gt;with &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;names and dates &lt;/del&gt;attached.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Agree the Reporting Before You Sign Settle this in the contract rather than discovering it in month three&lt;/del&gt;. A &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;useful monthly report contains the prompt set, the raw answers, which competitors were named, which sources were cited, what changed against last month, and what work was done &lt;/del&gt;that &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;might explain the change.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Check How They Handle Numbers Statistics circulate in this field faster than anyone checks them&lt;/del&gt;. A &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;widely repeated claim about referral traffic growth turned out to rest on a sample of nineteen analytics properties&lt;/del&gt;. A &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;frequently cited conversion comparison came from &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;vendor that sells the service&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Alongside it&lt;/del&gt;, the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;first rewritten pages&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Not a volume &lt;/del&gt;of &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;new content, but your &lt;/del&gt;most &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;commercially important existing pages restructured to answer directly and to carry specifics&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;You should be asked to confirm figures&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;since nobody outside your business can verify &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;lead time or a price range&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Weeks Three and Four&lt;/del&gt;: &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The Access Findings A technical report covering crawler permissions&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;what &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;relevant agents &lt;/del&gt;actually &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;receive from your server&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;whether bot management is interfering, and what survives on your key pages with JavaScript disabled&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Every search marketing agency now offers this service&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Some of them have &lt;/del&gt;built &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;genuine capability&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;some have added a page to their site and a line to their proposal template. From &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;outside &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;two look identical&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;because &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;vocabulary &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;easy and the results are hard to verify&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Those recurring domains are &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;pages your category&lt;/del&gt;&#039;s &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;answers are being built from. Visit each one, look for yourself&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;note whether you are absent, listed with stale details, or filed under &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;wrong category. That list &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;your task list, and you did not have to guess at it&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Vague answers about digital PR are a warning sign. &lt;/del&gt;Good &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;answers are concrete: they &lt;/del&gt;have &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;read your baseline source &lt;/del&gt;list, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;they know which platforms allow corrections&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;they have a view on which comparison articles are worth approaching&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;they will tell you which ones are out of reach&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Finally, pay attention &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;how they talk about their existing clients&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Somebody who describes &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;client&#039;s category accurately, names the specific constraint that made the work difficult&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;mentions something that did not work has actually done &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;job. Somebody who describes every engagement as a success &lt;/del&gt;in &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;identical language has either been unusually lucky or is describing a template&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;If &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;baseline exists, access problems were found and fixed, listings were corrected with names attached, &lt;/del&gt;and the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;source list has begun to move, the engagement is on track even if mention rate has not shifted&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;If none &lt;/del&gt;of &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;those happened&lt;/del&gt;, the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;next ninety days will not be different from &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;first. [https://www.88pianists&lt;/del&gt;.&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;com/ ai seo company]&lt;/del&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Blocks Nobody Chose Most blocking discovered during audits was never a decision&lt;/del&gt;. A &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;disallow copied from a template. A staging rule that survived a migration. A security plugin with an aggressive default. A content delivery network setting labelled bot protection &lt;/del&gt;with a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;switch nobody has looked at since launch&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;This entire area usually amounts to a day of work. It is routinely the difference between a brand that appears in answers and one that does not, and it is worth doing before anybody writes a single word of new content. ai seo &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;company&lt;/del&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Put someone&#039;s name against &lt;/del&gt;this&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;. Crawler rules sit between marketing&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;development &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;whoever administers &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;content delivery network&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which in most organisations means nobody checks &lt;/del&gt;them&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;. The failures documented here are not difficult &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;find, they are simply nobody&lt;/del&gt;&#039;s &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;job, and &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;quarterly review taking half an hour prevents &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;most complete form of invisibility available&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Two asking who to hire or buy from for &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;thing you sell&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Two describing &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;problem your product solves without naming &lt;/del&gt;the category. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Two comparing named competitors&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Two asking &lt;/del&gt;about &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a specific situation your best customers are in&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One asking directly who your company &lt;/del&gt;is. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One asking whether your company is any good&lt;/del&gt;.&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;If the budget is substantial, add the earned coverage work, which &lt;/ins&gt;is the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;slowest and most expensive component and the one you genuinely cannot do quickly on your own&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Buying that first, before &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;cheap fixes are done, is &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;most common &lt;/ins&gt;way &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;money gets wasted in this field. [https://www.88pianists&lt;/ins&gt;.&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;com/ ai seo services]&lt;/ins&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;What robots.txt Controls It &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a request, honoured by mainstream crawlers, that certain user agents avoid certain paths. It has no enforcement behind it &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it does not secure anything, but &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;major providers respect &lt;/ins&gt;it.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Set up a simple internal rule to stop the problem returning. One document holding &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;canonical name, address, founding year&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;leadership &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;product names, referenced by anyone creating &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;new profile, listing &lt;/ins&gt;or &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;account. Fragmentation is almost never &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;single decision&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;dozens of small ones made by people who had no way of knowing what &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;canonical version was&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The condition is that &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;output has to &lt;/ins&gt;be &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;yours to keep and act &lt;/ins&gt;on &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;elsewhere, including &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;prompt set&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;An audit that only makes sense inside that agency&#039;s retainer is &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;sales document &lt;/ins&gt;with &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a price &lt;/ins&gt;attached.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The Blocks Nobody Chose Most blocking discovered during audits was never a decision. A disallow copied from a template&lt;/ins&gt;. A &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;staging rule &lt;/ins&gt;that &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;survived a migration&lt;/ins&gt;. A &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;security plugin with an aggressive default&lt;/ins&gt;. A &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;content delivery network setting labelled bot protection with &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;switch nobody has looked at since launch&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;What Has Not Changed It is worth being clear about the continuities&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;because &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;change is regularly oversold&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Organic search still delivers the larger share &lt;/ins&gt;of &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;traffic for &lt;/ins&gt;most &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;businesses&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Crawlable, fast&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;well structured sites still win. Content that genuinely answers &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;question still outperforms content that does not&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Identity work has an unusual property that makes it easy to undervalue&lt;/ins&gt;: &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it improves everything else you do afterwards. Every mention earned after the details are consistent contributes to one record&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;while every mention earned before it may be filed somewhere it does nothing. Doing the tedious part first means &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;expensive part later &lt;/ins&gt;actually &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;accumulates&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which reverses the order most programmes choose&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Each addition removed a class of query from the click economy&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Sites that had &lt;/ins&gt;built &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;traffic on simple factual answers lost it first&lt;/ins&gt;, and the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;lesson available at &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;time&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which most of &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;industry declined to learn, was that owning a fact &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;not a durable position&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Assume &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;pitch is good. Everyone&lt;/ins&gt;&#039;s &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;pitch is good&lt;/ins&gt;, and the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;vocabulary in this field &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;easy enough that a competent salesperson can hold a convincing conversation without anyone behind them who can do the work&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Ask What They Will Not Do &lt;/ins&gt;Good &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;practitioners &lt;/ins&gt;have &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a &lt;/ins&gt;list&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;. They will not guarantee a position in an answer&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;because nobody controls that. They will not fabricate reviews or seed forum threads under false identities&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;because it is detectable&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;damaging &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;increasingly enforced against&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Ask &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;See Their Own Position This one is unfair and revealing&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Ask an assistant to recommend an agency for this kind of work, using a prompt &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;buyer would write&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;see whether &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;company sitting &lt;/ins&gt;in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;front of you appears&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Be wary of pricing tied to a proprietary visibility score, since the vendor controls both &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;number &lt;/ins&gt;and the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;prompt set that produces it&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Be equally wary &lt;/ins&gt;of &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;performance pricing tied to mentions&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which sounds aligned and creates pressure to game &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;measurement rather than improve &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;business&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Human Layer Companies are abstract and people are concrete, which is why named individuals do disproportionate work in establishing identity&lt;/ins&gt;. A &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;founder or author &lt;/ins&gt;with a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;real profile elsewhere, consistent across places, gives the system something durable to attach the organisation to&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;This entire area usually amounts to a day of work. It is routinely the difference between a brand that appears in answers and one that does not, and it is worth doing before anybody writes a single word of new content. ai seo &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;services&lt;/ins&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The honest position is that attribution in &lt;/ins&gt;this &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;channel is harder than in any other you are currently running&lt;/ins&gt;, and the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;field has responded to that difficulty mostly by inventing numbers. Confident figures circulate widely&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and a surprising share of &lt;/ins&gt;them &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;trace back &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a vendor&lt;/ins&gt;&#039;s &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;own sample or to &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;study far smaller than &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;claim implies&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Stage One: The Answer Moves Onto &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Results Page The first erosion was not artificial intelligence at all&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It was &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;gradual addition of features that answered &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;query in place: definitions, calculators, weather, sports scores, opening hours, snippets lifted from a page and displayed above it.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Absence is not disqualifying on its own, since their &lt;/ins&gt;category &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;is crowded and they may serve a niche&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;But they should have an interesting answer, and the answer should not be defensive&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A practitioner who has run this test on themselves will have thought &lt;/ins&gt;about &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it and will tell you what they found&lt;/ins&gt;.&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The last of these &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the most common and the hardest to see, because it produces no error anyone internally encounters&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Your site works perfectly in every browser while returning a challenge page to every legitimate retrieval agent&lt;/ins&gt;.&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>RufusRace6</name></author>
	</entry>
	<entry>
		<id>https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=111421&amp;oldid=prev</id>
		<title>BurtonBlackwell at 19:23, 17 August 2026</title>
		<link rel="alternate" type="text/html" href="https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=111421&amp;oldid=prev"/>
		<updated>2026-08-17T19:23:11Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 19:23, 17 August 2026&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l1&quot;&gt;Line 1:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 1:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;What &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;We Genuinely Do Not Know Several things &lt;/del&gt;are &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;worth admitting rather than papering over. We do not know how &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;systems weight their signals against each other&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;We do not know how much residual influence training data has once retrieval is involved. We cannot reliably distinguish a change in your visibility from a change in &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;model&lt;/del&gt;&#039;s &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;behaviour&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;practical response to that uncertainty &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;to work on &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;things that are robust &lt;/del&gt;to it. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Accessible pages&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;coherent identity, quotable writing &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;honest &lt;/del&gt;third party coverage &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;have helped under every configuration observed so far&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and they are &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;parts you would want anyway&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;[https://www.88pianists.com/ Geo Seo agency]&lt;/del&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;We also know &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;picture is unstable&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Retrieval strategies are revised without announcement&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a method that explained answers well six months ago may explain them poorly today. Anyone selling certainty here is selling something they do not have&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;In that setting your ranking is one input among several to a retrieval step, and often not a decisive one&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Ahrefs found in July 2025&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;across 15&lt;/del&gt;,&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;000 long-tail prompts&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;that around 80 percent of &lt;/del&gt;cited &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;pages did not rank for the original query at all&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;with about 12 percent in &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;top ten&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The change worth making is editorial direction&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Stop commissioning new pages whose entire value is &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;fact &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;summary can state, and redirect &lt;/del&gt;that &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;effort toward comparison, judgement, original data and anything requiring a transaction. Keep &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;existing pages, keep them current, and structure them to be quoted&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It is also worth recording &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;reason for every rule you keep&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A disallow line with no explanation gets preserved indefinitely through migrations &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;redesigns because &lt;/del&gt;nobody &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;dares remove something they do not understand. A one line comment saying who added it and why turns &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;permanent mystery into &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;decision that can be revisited&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One local specific worth checking is how your opening hours &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;availability are stated across every listing. These are among &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;details most frequently quoted in local recommendations and among the most likely to be wrong&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;because they change seasonally &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;get updated in one place. An assistant confidently telling somebody you are closed is a lost job that leaves no trace in any report&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The reasonable reading is that ranking gets &lt;/del&gt;a page &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;considered while quotability &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;corroboration decide whether it is used. Treating &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;strong search position as an entitlement &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;appear in answers &lt;/del&gt;is the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;mistake that catches out established brands most often&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Reviews Are &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Local Corroboration Layer For a local business&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;reviews &lt;/del&gt;are &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;close to &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;whole evidence base&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;There &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;rarely trade press, rarely analyst coverage&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;often no comparison articles &lt;/del&gt;at &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;all, so review platforms carry the weight alone&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The complication is that AI systems use several distinct agents for different purposes&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One may crawl for training corpora&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;another may fetch pages live when composing an answer&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;search provider&#039;s traditional crawler may feed both search results &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;an AI summary&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;What llms&lt;/del&gt;.&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;txt Proposes It is &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;proposed convention: a file at your root offering a curated&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;plain text guide to your site for language model consumers, pointing at &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;documents you consider authoritative.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Get &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Basics Right Before Anything Clever Once access is confirmed&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;check &lt;/del&gt;that &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;content &lt;/del&gt;actually &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;exists for &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;crawler to read. Load your important pages with JavaScript disabled. If your specifications, pricing, service areas &lt;/del&gt;or &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;contact details vanish, they are effectively absent from this channel regardless of how permissive your robots file &lt;/del&gt;is.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Being &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Source Instead of the Casualty The summary cites sources&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;being one of them is now a legitimate objective. The requirements resemble what earns citations anywhere else: a page that answers directly&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;contains specifics worth attributing&lt;/del&gt;, and is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;reachable and readable by a crawler&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Direct Answers Beat Positioning When &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;model composes &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;recommendation it needs sentences it can attribute&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Positioning language supplies none&lt;/del&gt;. A &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;paragraph about being &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;trusted leader committed to excellence contains no attachable claim, so it is passed over in favour of a competitor who wrote down their turnaround time&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Where you serve several towns, resist the instinct &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;claim the widest possible area&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A stated coverage radius that you genuinely honour &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;more useful than &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;list of thirty places you would only travel to reluctantly, because the specific claim gets quoted &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the vague &lt;/del&gt;one does not&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;. Being the obvious answer within &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;tight radius produces more work than being one &lt;/del&gt;of &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;many possibilities across a county&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Then segment by query type&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;If &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;decline concentrates &lt;/del&gt;in &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;informational and definitional queries while transactional and comparison queries hold, the cause is almost certainly something above you answering the question&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;If the decline is even across every query type&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;look elsewhere&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;because that is &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;different problem&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The important detail is that this does not replace &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;results page, it displaces it&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Your listing &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;still there&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;simply lower down the screen and competing with an answer that has already satisfied a portion of the audience&lt;/del&gt;.&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;What &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;you &lt;/ins&gt;are &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;looking for is whether &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;questions sound like a buyer wrote them&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;If every prompt contains &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;client&lt;/ins&gt;&#039;s &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;category name phrased the way an internal marketing team would phrase it, they have tested how the brand talks rather than how customers ask&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;last of these &lt;/ins&gt;is the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;most common and the hardest &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;see, because &lt;/ins&gt;it &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;produces no error anyone internally encounters&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Your site works perfectly in every browser while returning a challenge page to every legitimate retrieval agent.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Decide What the Result Means Four outcomes&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;each pointing somewhere different. Absent everywhere with a clean robots file &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;no &lt;/ins&gt;third party &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;listings usually means an identity and &lt;/ins&gt;coverage &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;problem. Absent with a blocked crawler or an empty non-JavaScript page means a mechanical problem&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which is &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;good news outcome because it is cheap&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Month Two: Corrections and the First Rewrites The work should now be concentrated on the recurring sources from &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;baseline&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Expect a list of listings claimed, details corrected and errors submitted&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;with names &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;dates attached&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Agree the Reporting Before You Sign Settle this in the contract rather than discovering it in month three&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A useful monthly report contains the prompt set&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the raw answers&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which competitors were named&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which sources were &lt;/ins&gt;cited, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;what changed against last month, and what work was done that might explain &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;change&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Check How They Handle Numbers Statistics circulate in this field faster than anyone checks them&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A widely repeated claim about referral traffic growth turned out to rest on &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;sample of nineteen analytics properties. A frequently cited conversion comparison came from &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;vendor &lt;/ins&gt;that &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;sells &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;service&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Alongside it, &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;first rewritten pages&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Not a volume of new content, but your most commercially important existing pages restructured to answer directly &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;to carry specifics. You should be asked to confirm figures, since &lt;/ins&gt;nobody &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;outside your business can verify &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;lead time or &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;price range&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Weeks Three &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Four: The Access Findings A technical report covering crawler permissions, what &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;relevant agents actually receive from your server, whether bot management is interfering&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;what survives on your key pages with JavaScript disabled&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Every search marketing agency now offers this service. Some of them have built genuine capability, and some have added &lt;/ins&gt;a page &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;to their site &lt;/ins&gt;and a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;line &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;their proposal template. From the outside the two look identical, because the vocabulary &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;easy and &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;results are hard to verify&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Those recurring domains are &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;pages your category&#039;s answers are being built from. Visit each one, look for yourself&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and note whether you &lt;/ins&gt;are &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;absent, listed with stale details, or filed under &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;wrong category&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;That list &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;your task list&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;you did not have to guess &lt;/ins&gt;at &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Vague answers about digital PR are a warning sign&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Good answers are concrete: they have read your baseline source list&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;they know which platforms allow corrections&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;they have &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;view on which comparison articles are worth approaching, &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;they will tell you which ones are out of reach&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Finally, pay attention to how they talk about their existing clients&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Somebody who describes &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;client&#039;s category accurately&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;names &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;specific constraint that made &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;work difficult&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and mentions something &lt;/ins&gt;that &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;did not work has &lt;/ins&gt;actually &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;done the job. Somebody who describes every engagement as &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;success in identical language has either been unusually lucky &lt;/ins&gt;or is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;describing a template&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;If &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;baseline exists&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;access problems were found &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;fixed&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;listings were corrected with names attached&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the source list has begun to move, the engagement &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;on track even if mention rate has not shifted. If none of those happened, the next ninety days will not be different from the first. [https://www.88pianists&lt;/ins&gt;.&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;com/ ai seo company]&lt;/ins&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The Blocks Nobody Chose Most blocking discovered during audits was never &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;decision. A disallow copied from &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;template. A staging rule that survived a migration&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A security plugin with an aggressive default&lt;/ins&gt;. A &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;content delivery network setting labelled bot protection with &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;switch nobody has looked at since launch&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;This entire area usually amounts &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a day of work&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;routinely the difference between &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;brand that appears in answers &lt;/ins&gt;and one &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;that &lt;/ins&gt;does not&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;, and it is worth doing before anybody writes &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;single word &lt;/ins&gt;of &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;new content&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;ai seo company&lt;/ins&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Put someone&#039;s name against this&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Crawler rules sit between marketing, development and whoever administers &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;content delivery network, which &lt;/ins&gt;in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;most organisations means nobody checks them&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The failures documented here are not difficult to find&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;they are simply nobody&#039;s job&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;quarterly review taking half an hour prevents the most complete form of invisibility available&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Two asking who to hire or buy from for the thing you sell. Two describing the problem your product solves without naming &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;category. Two comparing named competitors. Two asking about a specific situation your best customers are in&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One asking directly who your company &lt;/ins&gt;is. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One asking whether your company &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;any good&lt;/ins&gt;.&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>BurtonBlackwell</name></author>
	</entry>
	<entry>
		<id>https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=110469&amp;oldid=prev</id>
		<title>SIHKazuko2 at 17:04, 17 August 2026</title>
		<link rel="alternate" type="text/html" href="https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=110469&amp;oldid=prev"/>
		<updated>2026-08-17T17:04:17Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 17:04, 17 August 2026&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l1&quot;&gt;Line 1:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 1:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The Mechanism Has Changed A link passed authority through &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;graph. A mention &lt;/del&gt;in a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;generated answer works differently: &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;publication&lt;/del&gt;&#039;s &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;text is retrieved, read and used as evidence about what your company is and whether it is worth recommending&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;When &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Test More Often Three situations justify a tighter loop. During an active campaign where you need &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;attribute a specific change, weekly runs &lt;/del&gt;on &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a subset of prompts &lt;/del&gt;are &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;reasonable&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;provided &lt;/del&gt;you &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;accept the variance&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Where &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Work Is Genuinely the Same The foundations do not change&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Crawlable pages, sane site structure, fast rendering, accurate structured data, internal links that reflect how topics relate&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;content &lt;/del&gt;that answers &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a real question all serve both channels&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;You will find discontinued products described as current&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;old addresses, superseded pricing &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;misattributed capabilities&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Each &lt;/del&gt;of &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;those is being read as evidence&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and publishers generally accept factual corrections when you supply evidence and make it easy&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;condition &lt;/del&gt;is that the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;output has &lt;/del&gt;to be &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;yours to keep and act on elsewhere, including the prompt set. An audit that only makes sense inside that agency&#039;s retainer is a sales document with a price attached&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Product recommendations are a harder case than service recommendations, &lt;/del&gt;because &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the answer has to be specific enough to act on&lt;/del&gt;. A &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;model naming &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;product is committing to &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;name, usually a price band and often a comparison, and it needs sources confident enough to support &lt;/del&gt;that.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The idea &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;reasonable &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;adoption is inconsistent&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Support varies by provider &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;no major system currently treats it as required&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Treat it as &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;cheap and speculative addition rather than a deliverable worth paying much for&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Blocks Nobody Chose Most blocking discovered during audits was never &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;decision&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A disallow copied from &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;template. A staging rule &lt;/del&gt;that &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;survived a migration. A security plugin with an aggressive default. A content delivery network setting labelled bot protection with a switch nobody has looked at since launch&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;What robots&lt;/del&gt;.&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;txt Controls It &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a request&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;honoured by mainstream crawlers&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;that certain user agents avoid certain paths. It has &lt;/del&gt;no &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;enforcement behind it and it does not secure anything&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;but &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;major providers respect it&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;One &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;scheduling detail improves comparability more than it should. Run on roughly the same date each month rather than whenever somebody remembers. Retrieval behaviour &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the freshness of competing sources &lt;/del&gt;both &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;vary over a month, &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a series taken at irregular intervals introduces variation that looks like a trend&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One overlooked cost &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;your own time. Every engagement in this field needs somebody inside the business to confirm figures, approve crawler changes and answer factual questions, and &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;plan that assumes this is free will stall. Budget &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;few hours &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;month explicitly and name the person&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;because &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;alternative is an agency waiting on answers and billing for a month in which little shipped&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;And in a fast moving category where competitors are actively publishing&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;monthly can miss &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;shift&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Even then&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;keep the full set monthly and run a small subset more frequently rather than expanding everything&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One brief worth writing once &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;reusing &lt;/del&gt;is a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;factual sheet for anyone writing about you&lt;/del&gt;: &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;canonical name, what you do in &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;sentence&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;who you serve, where you operate, when you were founded, who leads it&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;three concrete figures you are happy to see quoted. Writers use what &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;easy to find, &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;supplying this removes the friction that otherwise produces &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;paragraph of adjectives&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Comparison Is the Native Format Shopping questions are comparison questions&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Somebody asking what &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;buy wants options weighed against each other&lt;/del&gt;, so &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the sources that get used are the ones that have already weighed them&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One organisational point &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;worth raising early, because it decides &lt;/del&gt;more &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;outcomes &lt;/del&gt;than &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the tactics do. These two disciplines share &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;foundation&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;so splitting them between separate suppliers produces duplicated technical audits &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;occasionally contradictory instructions about &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;same pages&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Whoever owns organic search should own this, with specialist help brought in for &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;parts they cannot do rather &lt;/del&gt;than a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;parallel programme running alongside&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;After that&lt;/del&gt;, the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;work &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;ordinary: accurate structured data&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;honest comparison content&lt;/del&gt;, a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;steady flow of detailed reviews, and marketplace listings maintained as carefully as your own pages. [https://www.88pianists&lt;/del&gt;.&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;com/ llm visibility tracking]&lt;/del&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Blocking these &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;therefore &lt;/del&gt;not &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;one decision&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Turning away a training crawler &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a defensible editorial position&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Turning away &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;agent that fetches pages at answer time removes you from answers entirely, &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the two are frequently confused.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Making Yourself Easy to Write About Journalists and analysts write from what they can find quickly. A press page carrying your canonical name, founding details, leadership &lt;/del&gt;with &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;verifiable profiles, plain descriptions &lt;/del&gt;of &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;what you do and concrete figures they can quote removes &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;friction that produces vague coverage&lt;/del&gt;.&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;What We Genuinely Do Not Know Several things are worth admitting rather than papering over. We do not know how the systems weight their signals against each other. We do not know how much residual influence training data has once retrieval is involved. We cannot reliably distinguish &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;change &lt;/ins&gt;in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;your visibility from &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;change in &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;model&lt;/ins&gt;&#039;s &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;behaviour&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The practical response &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;that uncertainty is &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;work &lt;/ins&gt;on &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the things that &lt;/ins&gt;are &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;robust to it. Accessible pages, coherent identity, quotable writing and honest third party coverage have helped under every configuration observed so far&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and they are the parts &lt;/ins&gt;you &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;would want anyway. [https://www.88pianists&lt;/ins&gt;.&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;com/ Geo Seo agency]&lt;/ins&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;We also know &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;picture is unstable&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Retrieval strategies are revised without announcement&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a method &lt;/ins&gt;that &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;explained &lt;/ins&gt;answers &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;well six months ago may explain them poorly today. Anyone selling certainty here is selling something they do not have&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;In that setting your ranking is one input among several to a retrieval step&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;often not a decisive one&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Ahrefs found in July 2025, across 15,000 long-tail prompts, that around 80 percent &lt;/ins&gt;of &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;cited pages did not rank for the original query at all&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;with about 12 percent in the top ten&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;change worth making &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;editorial direction. Stop commissioning new pages whose entire value is a fact a summary can state, and redirect &lt;/ins&gt;that &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;effort toward comparison, judgement, original data and anything requiring a transaction. Keep &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;existing pages, keep them current, and structure them &lt;/ins&gt;to be &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;quoted&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It is also worth recording the reason for every rule you keep. A disallow line with no explanation gets preserved indefinitely through migrations and redesigns &lt;/ins&gt;because &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;nobody dares remove something they do not understand&lt;/ins&gt;. A &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;one line comment saying who added it and why turns &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;permanent mystery into &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;decision &lt;/ins&gt;that &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;can be revisited&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One local specific worth checking &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;how your opening hours &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;availability are stated across every listing&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;These are among the details most frequently quoted in local recommendations and among the most likely to be wrong, because they change seasonally &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;get updated in one place&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;An assistant confidently telling somebody you are closed is &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;lost job that leaves no trace in any report&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;reasonable reading is that ranking gets &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;page considered while quotability and corroboration decide whether it is used&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Treating &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;strong search position as an entitlement to appear in answers is the mistake &lt;/ins&gt;that &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;catches out established brands most often&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Reviews Are the Local Corroboration Layer For a local business, reviews are close to the whole evidence base&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;There &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;rarely trade press&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;rarely analyst coverage&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and often &lt;/ins&gt;no &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;comparison articles at all&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;so review platforms carry &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;weight alone&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The complication is that AI systems use several distinct agents for different purposes. &lt;/ins&gt;One &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;may crawl for training corpora, another may fetch pages live when composing an answer, &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a search provider&#039;s traditional crawler may feed &lt;/ins&gt;both &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;search results &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;an AI summary&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;What llms.txt Proposes It &lt;/ins&gt;is a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;proposed convention: &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;file at your root offering &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;curated, plain text guide to your site for language model consumers&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;pointing at &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;documents you consider authoritative&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Get the Basics Right Before Anything Clever Once access is confirmed&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;check that content actually exists for &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;crawler to read. Load your important pages with JavaScript disabled&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;If your specifications, pricing&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;service areas or contact details vanish, they are effectively absent from this channel regardless of how permissive your robots file is&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Being the Source Instead of the Casualty The summary cites sources, &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;being one of them &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;now &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;legitimate objective. The requirements resemble what earns citations anywhere else&lt;/ins&gt;: a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;page that answers directly&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;contains specifics worth attributing&lt;/ins&gt;, and is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;reachable &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;readable by &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;crawler&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Direct Answers Beat Positioning When a model composes a recommendation it needs sentences it can attribute. Positioning language supplies none&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A paragraph about being a trusted leader committed &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;excellence contains no attachable claim&lt;/ins&gt;, so &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it is passed over in favour of a competitor who wrote down their turnaround time&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Where you serve several towns, resist the instinct to claim the widest possible area. A stated coverage radius that you genuinely honour &lt;/ins&gt;is more &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;useful &lt;/ins&gt;than a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;list of thirty places you would only travel to reluctantly&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;because the specific claim gets quoted &lt;/ins&gt;and the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;vague one does not&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Being &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;obvious answer within a tight radius produces more work &lt;/ins&gt;than &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;being one of many possibilities across &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;county&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Then segment by query type. If the decline concentrates in informational and definitional queries while transactional and comparison queries hold&lt;/ins&gt;, the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;cause is almost certainly something above you answering the question. If the decline &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;even across every query type&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;look elsewhere&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;because that is &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;different problem&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The important detail &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;that this does &lt;/ins&gt;not &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;replace the results page, it displaces it&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Your listing &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;still there&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It is simply lower down &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;screen &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;competing &lt;/ins&gt;with &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;an answer that has already satisfied a portion &lt;/ins&gt;of the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;audience&lt;/ins&gt;.&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>SIHKazuko2</name></author>
	</entry>
	<entry>
		<id>https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=108873&amp;oldid=prev</id>
		<title>RogelioRiemer97 at 15:08, 17 August 2026</title>
		<link rel="alternate" type="text/html" href="https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=108873&amp;oldid=prev"/>
		<updated>2026-08-17T15:08:57Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 15:08, 17 August 2026&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l1&quot;&gt;Line 1:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 1:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Run each prompt at least three times&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Assistants vary their answers between runs, and &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;single result is a sample rather than a finding. Record &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;full &lt;/del&gt;text &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;of each answer and every source cited, not a summary.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The Objection&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the Answer to It Sales teams resist naming competitors &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;conceding anything, and the resistance &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;understandable. The counter is that the comparison is happening regardless, inside a model, using whichever sources it can find&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Set &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Cadence and Stick &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It Monthly is enough for most categories. Run the same prompts&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the same number &lt;/del&gt;of &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;times&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and keep every answer. The value compounds because &lt;/del&gt;you &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;can look back and see when a competitor entered &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;shortlist and which source appeared alongside them&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;complication is that AI systems use several distinct agents for different purposes&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One may crawl for training corpora&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;another may fetch pages live when composing an answer&lt;/del&gt;, and a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;search provider&#039;s traditional crawler may feed &lt;/del&gt;both &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;search results and an AI summary&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Then load your key pages with scripts disabled&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Whatever remains &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;roughly what a retrieval system sees. If your product specifications&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;pricing or service areas vanish, that content needs to exist in the server rendered HTML&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Alternatives Pages Specifically &lt;/del&gt;The &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;alternatives &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a named product page deserves separate mention because it captures a buyer at an unusually decisive moment. Somebody searching for alternatives &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a competitor has a problem&lt;/del&gt;, a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;budget and an incumbent they are unhappy &lt;/del&gt;with.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The volumes will &lt;/del&gt;be &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;small&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;so avoid drawing conclusions from &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;handful of sessions &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;let it accumulate over &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;quarter or two. Also compare against your branded organic traffic rather than all organic&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;since branded search is closer in intent &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;makes for a fairer comparison&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Set &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;review cycle, quarterly for fast moving categories &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;twice a year otherwise. Update the figures &lt;/del&gt;rather than &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the timestamp, and show &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;real modified date so freshness can be judged honestly&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;ai search optimization&lt;/del&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One further caution applies to how this gets used in &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;pitch&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;An agency quoting &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;conversion multiple without its sample size is either unaware of the provenance or hoping you are, and both are informative&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Asking where a number came from is a reasonable question &lt;/del&gt;that &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;costs nothing, and the quality of the answer tells you &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;good deal about how your own reporting will be handled&lt;/del&gt;.&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;In this case there is something real underneath&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The plumbing of how people find suppliers has changed, and the work required &lt;/del&gt;has &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;changed with it. Here is the whole idea explained without the acronyms, aimed &lt;/del&gt;at &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;someone who wants to understand the decision rather than do the job&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;[https://www.88pianists.com/ ai search optimization]&lt;/del&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;What robots.txt Controls It is a request, honoured by mainstream crawlers, that certain user agents avoid certain paths. It has no enforcement behind it and it does not secure anything, but the major providers respect it.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;What It Costs You in Time A fair question, since the reason most owners outsource this is that they do not want to think about &lt;/del&gt;it. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The honest answer is that &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;technical &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;content work can be handled entirely by someone else&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;but two things need you&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Study the citation lists &lt;/del&gt;in &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;almost any commercial category and one format keeps appearing: &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;page that weighs named options against each other. Comparison articles&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;alternatives pages&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;best of roundups &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;side by side tables get quoted far out of proportion to how many of them exist.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;This &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;worth accepting rather than fighting&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Your own comparison page &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;still worth publishing, &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it will rarely be the most cited source &lt;/del&gt;in &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;your category. The higher leverage move is making sure the independent comparisons that already exist describe you accurately&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The terms &lt;/del&gt;are &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;used almost interchangeably&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Generative engine optimization usually emphasises assistants that write an answer&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;while answer engine optimization is sometimes used &lt;/del&gt;more &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;broadly. Ask any agency what they mean by their term&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;None of these are traffic numbers&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which is the uncomfortable part. Much of the value &lt;/del&gt;in &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;this channel arrives without &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;click and shows up weeks later as somebody &lt;/del&gt;who &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;already knew what &lt;/del&gt;you &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;did before they contacted &lt;/del&gt;you.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Why the Direction &lt;/del&gt;Is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Plausible Anyway Set &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;numbers aside and the mechanism is straightforward&lt;/del&gt;. Somebody &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;arriving from an assistant has already had their question answered&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;has &lt;/del&gt;already &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;seen a comparison, and has been given your name as a recommendation&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Now a growing &lt;/del&gt;share &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;of those questions produce an answer instead of &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;list&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The assistant reads the sources&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;forms &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;opinion and hands you &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;recommendation&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The comparison step &lt;/del&gt;that &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;used to happen in &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;buyer&#039;s head now happens inside &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;model&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;using sources the buyer never sees&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Anything &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;client cannot argue with &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;not &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;report&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;If &lt;/del&gt;you &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;cannot open the document&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;disagree with a conclusion &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;point at &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;evidence that contradicts it, you have been sent a reassurance rather than an analysis&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;This entire area usually amounts &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a day &lt;/del&gt;of &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;work. It is routinely &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;difference between a brand &lt;/del&gt;that &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;appears in answers and one that does not, and it is worth doing before anybody writes a single word of new content&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;ai search optimization&lt;/del&gt;&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The Mechanism Has Changed A link passed authority through a graph&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A mention in &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;generated answer works differently: &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;publication&#039;s &lt;/ins&gt;text &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;is retrieved&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;read &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;used as evidence about what your company is &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;whether it &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;worth recommending&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;When to Test More Often Three situations justify &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;tighter loop. During an active campaign where you need &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;attribute a specific change&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;weekly runs on a subset &lt;/ins&gt;of &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;prompts are reasonable&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;provided &lt;/ins&gt;you &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;accept &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;variance&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Where the Work Is Genuinely the Same &lt;/ins&gt;The &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;foundations do not change&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Crawlable pages, sane site structure, fast rendering, accurate structured data&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;internal links that reflect how topics relate&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;content that answers &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;real question all serve &lt;/ins&gt;both &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;channels&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;You will find discontinued products described as current, old addresses, superseded pricing and misattributed capabilities&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Each of those &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;being read as evidence&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and publishers generally accept factual corrections when you supply evidence and make it easy&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;condition is that the output has &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;be yours &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;keep and act on elsewhere&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;including the prompt set. An audit that only makes sense inside that agency&#039;s retainer is &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;sales document &lt;/ins&gt;with &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a price attached&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Product recommendations are a harder case than service recommendations, because the answer has to &lt;/ins&gt;be &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;specific enough to act on. A model naming a product is committing to a name&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;usually &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;price band &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;often &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;comparison&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it needs sources confident enough to support that&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The idea is reasonable and adoption is inconsistent. Support varies by provider and no major system currently treats it as required. Treat it as &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;cheap &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;speculative addition &lt;/ins&gt;rather than a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;deliverable worth paying much for&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The Blocks Nobody Chose Most blocking discovered during audits was never &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;decision&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A disallow copied from &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;template&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A staging rule &lt;/ins&gt;that &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;survived &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;migration&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A security plugin with an aggressive default&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A content delivery network setting labelled bot protection with a switch nobody &lt;/ins&gt;has &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;looked &lt;/ins&gt;at &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;since launch&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;What robots.txt Controls It is a request, honoured by mainstream crawlers, that certain user agents avoid certain paths. It has no enforcement behind it and it does not secure anything, but the major providers respect it.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One scheduling detail improves comparability more than &lt;/ins&gt;it &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;should&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Run on roughly &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;same date each month rather than whenever somebody remembers. Retrieval behaviour &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the freshness of competing sources both vary over a month&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and a series taken at irregular intervals introduces variation that looks like a trend&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One overlooked cost is your own time. Every engagement &lt;/ins&gt;in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;this field needs somebody inside &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;business to confirm figures&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;approve crawler changes and answer factual questions&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a plan that assumes this &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;free will stall&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Budget a few hours a month explicitly and name the person, because the alternative &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;an agency waiting on answers &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;billing for a month &lt;/ins&gt;in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which little shipped&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;And in a fast moving category where competitors &lt;/ins&gt;are &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;actively publishing, monthly can miss a shift&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Even then&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;keep the full set monthly and run a small subset &lt;/ins&gt;more &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;frequently rather than expanding everything&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One brief worth writing once and reusing is a factual sheet for anyone writing about you: canonical name&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;what you do &lt;/ins&gt;in a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;sentence, &lt;/ins&gt;who you &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;serve, where you operate, when you were founded, who leads it, and three concrete figures &lt;/ins&gt;you &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;are happy to see quoted. Writers use what is easy to find, and supplying this removes the friction that otherwise produces a paragraph of adjectives&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Comparison &lt;/ins&gt;Is the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Native Format Shopping questions are comparison questions&lt;/ins&gt;. Somebody &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;asking what to buy wants options weighed against each other&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;so the sources that get used are the ones that have &lt;/ins&gt;already &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;weighed them&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One organisational point is worth raising early, because it decides more outcomes than the tactics do. These two disciplines &lt;/ins&gt;share a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;foundation, so splitting them between separate suppliers produces duplicated technical audits and occasionally contradictory instructions about the same pages&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Whoever owns organic search should own this&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;with specialist help brought in for &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;parts they cannot do rather than &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;parallel programme running alongside&lt;/ins&gt;.&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;After &lt;/ins&gt;that&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;, &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;work is ordinary: accurate structured data, honest comparison content, &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;steady flow of detailed reviews&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and marketplace listings maintained as carefully as your own pages. [https://www.88pianists&lt;/ins&gt;.&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;com/ llm visibility tracking]&lt;/ins&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Blocking these is therefore not one decision. Turning away &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;training crawler &lt;/ins&gt;is a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;defensible editorial position&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Turning away the agent that fetches pages at answer time removes &lt;/ins&gt;you &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;from answers entirely&lt;/ins&gt;, and the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;two are frequently confused&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Making Yourself Easy &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Write About Journalists and analysts write from what they can find quickly. A press page carrying your canonical name, founding details, leadership with verifiable profiles, plain descriptions &lt;/ins&gt;of &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;what you do and concrete figures they can quote removes &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;friction &lt;/ins&gt;that &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;produces vague coverage&lt;/ins&gt;.&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>RogelioRiemer97</name></author>
	</entry>
	<entry>
		<id>https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=107756&amp;oldid=prev</id>
		<title>RuthHopley7631 at 12:36, 17 August 2026</title>
		<link rel="alternate" type="text/html" href="https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=107756&amp;oldid=prev"/>
		<updated>2026-08-17T12:36:07Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 12:36, 17 August 2026&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l1&quot;&gt;Line 1:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 1:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Reviews Do Disproportionate Work For products more than for services&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;review content &lt;/del&gt;is the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;evidence base&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Volume matters&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;recency matters more&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;detail matters most&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;because a review that describes a specific use gives &lt;/del&gt;a model &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;something to match against a specific question&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;You also cannot cleanly attribute &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;purchase &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a recommendation &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;buyer received three weeks earlier in a conversation you never saw. That influence is real&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it is often &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;main value &lt;/del&gt;of &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the channel&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it will not appear in any report &lt;/del&gt;you &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;own&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Where a platform lets you add structured business information alongside reviews, complete every field&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;These profiles are frequently cited as much &lt;/del&gt;for &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;their factual details as for their ratings&lt;/del&gt;, and a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;half completed profile contributes far less than &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;full one even when &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;review count is identical&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It is &lt;/del&gt;an &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;hour of work per platform &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it is repeatedly the cheapest improvement available&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;This &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the least interesting subject &lt;/del&gt;in &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the discipline &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the one that most often explains &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;total absence from generated answers&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A brand can do everything else correctly &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;remain invisible because &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;line in a text file&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;or &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;setting nobody remembers enabling, is turning the relevant crawlers away&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;This entire area usually amounts &lt;/del&gt;to a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;day &lt;/del&gt;of &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;work&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;routinely the difference between &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;brand &lt;/del&gt;that &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;appears in answers &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;one that does not&lt;/del&gt;, and it is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;worth doing before anybody writes a single word of new content&lt;/del&gt;. [https://www.88pianists.com/ &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;get recommended by &lt;/del&gt;ai]&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Get the Basics Right Before Anything Clever Once access is confirmed, check that content actually exists for a crawler to read. Load your important pages with JavaScript disabled. If your specifications, pricing, service areas or contact details vanish, they are effectively absent from this channel regardless of how permissive your &lt;/del&gt;robots &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;file is&lt;/del&gt;.&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Deciding Whether to Block Anything There &lt;/del&gt;is a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;legitimate argument for restricting training &lt;/del&gt;crawlers, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;particularly for publishers whose archive is the product&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;That is a commercial and editorial decision &lt;/del&gt;and it &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;deserves a real discussion rather than a default&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Gemini and Google Surfaces Closest to conventional search infrastructure&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which has a practical consequence: work &lt;/del&gt;that &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;improves your standing in Google search tends &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;carry over here more than &lt;/del&gt;it &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;does elsewhere&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It also appears more conservative &lt;/del&gt;in commercial &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;categories, hedging or declining to make a direct recommendation more often than &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;others&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Where it does recommend&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;established entity signals seem to matter&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which favours brands with consistent details &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;long records over newer entrants&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;This is worth accepting rather than fighting. Your own comparison page is still worth publishing, and it will rarely be the most cited source in your category. The higher leverage move is making sure the independent comparisons that already exist describe you accurately.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Put someone&#039;s name against this&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Crawler rules sit between marketing&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;development and whoever administers the content delivery network, which in most organisations means nobody checks them&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The failures documented here are not difficult to find, &lt;/del&gt;they &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;are simply nobody&#039;s job, and a quarterly review taking half an hour prevents the most complete form of invisibility available&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The last &lt;/del&gt;of these is the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;most common and &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;hardest to see, because it produces no error anyone internally encounters. Your site works perfectly &lt;/del&gt;in &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;every browser while returning &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;challenge page to every legitimate retrieval agent&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Run a commercial prompt in almost any category &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;look at what gets cited&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Review platforms&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;roundups and &lt;/del&gt;comparison &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;sites appear first and most often&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the brands being discussed appear well down the list if at all&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;This is also why review volume and recency show up so consistently in what gets cited&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A platform with forty recent accounts of working with you is more informative than your own page saying customers love you&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it is treated accordingly&lt;/del&gt;.&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;/del&gt;The &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Shared Architecture All three &lt;/del&gt;now &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;commonly retrieve live sources rather than answering purely from training. Your question becomes one or more searches, &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;set of pages is fetched and read&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;answer is composed from what was read&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Why Third Party Comparisons Dominate The comparison pages cited most often are usually &lt;/del&gt;not &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;published by any of the companies being compared. A review site, &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;trade publication or an independent blogger weighing five options reads as disinterested in a way that a vendor&#039;s own page does not&lt;/del&gt;.&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;/del&gt;If the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;only comparisons available are written by competitors &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;by review sites with incomplete information about you, that is &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;version being used. Publishing an honest one puts a source into circulation &lt;/del&gt;that &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;at least contains your figures stated correctly&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and honest treatment of where &lt;/del&gt;you &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;lose makes the rest of the page more credible &lt;/del&gt;rather than &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;less&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Discontinued products deserve deliberate handling rather than deletion&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Removing a page severs &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;connection &lt;/del&gt;between &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;existing reviews &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;coverage and your catalogue&lt;/del&gt;, and it &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;leaves stale third party listings pointing at nothing. Keeping the page, marking it clearly as discontinued and naming the replacement preserves the accumulated evidence and redirects the recommendation rather than losing it&lt;/del&gt;.&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Run each prompt at least three times. Assistants vary their answers between runs&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and a single result &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a sample rather than a finding. Record &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;full text of each answer and every source cited, not a summary&lt;/ins&gt;.&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The Objection&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and the Answer to It Sales teams resist naming competitors and conceding anything&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the resistance is understandable. The counter is that the comparison is happening regardless&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;inside &lt;/ins&gt;a model&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;, using whichever sources it can find&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Set &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Cadence and Stick &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It Monthly is enough for most categories. Run &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;same prompts&lt;/ins&gt;, the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;same number &lt;/ins&gt;of &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;times&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;keep every answer. The value compounds because &lt;/ins&gt;you &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;can look back and see when a competitor entered the shortlist and which source appeared alongside them&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The complication is that AI systems use several distinct agents for different purposes&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One may crawl &lt;/ins&gt;for &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;training corpora, another may fetch pages live when composing an answer&lt;/ins&gt;, and a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;search provider&#039;s traditional crawler may feed both search results and an AI summary.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Then load your key pages with scripts disabled. Whatever remains is roughly what &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;retrieval system sees. If your product specifications, pricing or service areas vanish, that content needs to exist in &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;server rendered HTML&lt;/ins&gt;.&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Alternatives Pages Specifically The alternatives to a named product page deserves separate mention because it captures a buyer at &lt;/ins&gt;an &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;unusually decisive moment. Somebody searching for alternatives to a competitor has a problem, a budget &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;an incumbent they are unhappy with&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The volumes will be small, so avoid drawing conclusions from a handful of sessions and let it accumulate over a quarter or two. Also compare against your branded organic traffic rather than all organic, since branded search &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;closer &lt;/ins&gt;in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;intent &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;makes for &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;fairer comparison&lt;/ins&gt;.&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Set a review cycle, quarterly for fast moving categories &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;twice &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;year otherwise. Update the figures rather than the timestamp&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and show &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;real modified date so freshness can be judged honestly&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;ai search optimization&lt;/ins&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One further caution applies &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;how this gets used in &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;pitch. An agency quoting a conversion multiple without its sample size is either unaware &lt;/ins&gt;of &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the provenance or hoping you are, and both are informative&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Asking where a number came from &lt;/ins&gt;is a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;reasonable question &lt;/ins&gt;that &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;costs nothing, &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the quality of the answer tells you a good deal about how your own reporting will be handled.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;In this case there is something real underneath. The plumbing of how people find suppliers has changed&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the work required has changed with &lt;/ins&gt;it&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;. Here &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the whole idea explained without the acronyms, aimed at someone who wants to understand the decision rather than do the job&lt;/ins&gt;. [https://www.88pianists.com/ ai &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;search optimization&lt;/ins&gt;]&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;What &lt;/ins&gt;robots.&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;txt Controls It &lt;/ins&gt;is a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;request, honoured by mainstream &lt;/ins&gt;crawlers, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;that certain user agents avoid certain paths&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It has no enforcement behind it &lt;/ins&gt;and it &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;does not secure anything, but the major providers respect it&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;What It Costs You in Time A fair question&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;since the reason most owners outsource this is &lt;/ins&gt;that &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;they do not want &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;think about &lt;/ins&gt;it&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;. The honest answer is that the technical and content work can be handled entirely by someone else, but two things need you&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Study the citation lists &lt;/ins&gt;in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;almost any &lt;/ins&gt;commercial &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;category and one format keeps appearing: &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;page that weighs named options against each other&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Comparison articles&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;alternatives pages&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;best of roundups &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;side by side tables get quoted far out of proportion to how many of them exist&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;This is worth accepting rather than fighting. Your own comparison page is still worth publishing, and it will rarely be the most cited source in your category. The higher leverage move is making sure the independent comparisons that already exist describe you accurately.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The terms are used almost interchangeably&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Generative engine optimization usually emphasises assistants that write an answer&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;while answer engine optimization is sometimes used more broadly&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Ask any agency what &lt;/ins&gt;they &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;mean by their term&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;None &lt;/ins&gt;of these &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;are traffic numbers, which &lt;/ins&gt;is the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;uncomfortable part. Much of &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;value &lt;/ins&gt;in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;this channel arrives without &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;click and shows up weeks later as somebody who already knew what you did before they contacted you&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Why the Direction Is Plausible Anyway Set the numbers aside &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the mechanism is straightforward&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Somebody arriving from an assistant has already had their question answered&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;has already seen a &lt;/ins&gt;comparison, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;has been given your name as a recommendation&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Now a growing share of those questions produce an answer instead of a list&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The assistant reads the sources&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;forms the opinion &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;hands you a recommendation&lt;/ins&gt;. The &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;comparison step that used to happen in the buyer&#039;s head &lt;/ins&gt;now &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;happens inside &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;model&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;using sources &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;buyer never sees&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Anything a client cannot argue with is &lt;/ins&gt;not a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;report&lt;/ins&gt;. If &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;you cannot open &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;document, disagree with a conclusion &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;point at &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;evidence &lt;/ins&gt;that &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;contradicts it&lt;/ins&gt;, you &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;have been sent a reassurance &lt;/ins&gt;rather than &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;an analysis&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;This entire area usually amounts to a day of work&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It is routinely &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;difference &lt;/ins&gt;between &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a brand that appears in answers &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;one that does not&lt;/ins&gt;, and it &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;is worth doing before anybody writes a single word of new content&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;ai search optimization&lt;/ins&gt;&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>RuthHopley7631</name></author>
	</entry>
	<entry>
		<id>https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=98520&amp;oldid=prev</id>
		<title>MelanieDickerson at 12:56, 16 August 2026</title>
		<link rel="alternate" type="text/html" href="https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=98520&amp;oldid=prev"/>
		<updated>2026-08-16T12:56:05Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 12:56, 16 August 2026&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l1&quot;&gt;Line 1:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 1:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;That transparency makes it the best available proxy &lt;/del&gt;for &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;how retrieval based answering behaves generally. Here &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;what &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;citation pattern reveals&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;what &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;brand can actually do about it&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Geo seo agency&lt;/del&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Handle &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Statistics Carefully Numbers circulate &lt;/del&gt;in &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;this field faster than anyone checks them&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and using an unsourced one &lt;/del&gt;is the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;fastest way to lose a room. Attach &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;provenance to everything &lt;/del&gt;you &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;cite:&lt;/del&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Put someone&#039;s name against this. Crawler rules sit between marketing&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;development and whoever administers the content delivery network, which in most organisations means nobody checks them&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The failures documented here &lt;/del&gt;are &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;not difficult to find, they are simply nobody&#039;s job&lt;/del&gt;, and a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;quarterly &lt;/del&gt;review &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;taking half &lt;/del&gt;an hour &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;prevents &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;most complete form of invisibility &lt;/del&gt;available.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Make Sure It Can Fetch You Check that your robots.txt permits &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;relevant crawler, &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;check your server logs for what it actually receives. Bot management products frequently serve challenge pages to legitimate retrieval agents, which produces &lt;/del&gt;total &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;invisibility with no error anyone sees&lt;/del&gt;.&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;It also appears more conservative &lt;/del&gt;in &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;commercial categories&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;hedging &lt;/del&gt;or &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;declining to make &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;direct recommendation more often than &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;others. Where it does recommend, established entity signals seem to matter, which favours brands with consistent details and long records over newer entrants&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;If your category still gets meaningful traffic from those, &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;proposal scoped only to assistants will leave that &lt;/del&gt;work &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;undone&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Conversely, if somebody proposes an answer engine optimization programme and delivers only snippet optimisation, they are working on the older half of the definition.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The fix &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;not abandoning modern frameworks. Server side rendering or static generation produces &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;same interface with meaningful content &lt;/del&gt;in &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the initial response&lt;/del&gt;, and it is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;faster for humans too, which is the usual pattern in this area&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A false trade off gets invented early in most of these projects. Somebody proposes stripping &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;design&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;flattening the copy and restructuring everything around what a crawler finds convenient, and somebody else correctly points out &lt;/del&gt;that &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;this would make the site worse &lt;/del&gt;for &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;customers.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Some practitioners still use it that way, which makes it &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;superset of the newer work&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Others use it as a synonym for the generative work specifically&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Both usages are in circulation&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which is why asking somebody what &lt;/del&gt;they &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;mean by it &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a reasonable question rather than a pedantic one&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The difficulty with this proposal &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;that it asks &lt;/del&gt;for &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;money before the problem &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;visible in any report &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;business already trusts&lt;/del&gt;. That is a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;genuinely hard sell, &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;overselling &lt;/del&gt;it &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;is the fastest way to lose credibility when the numbers stay small for two quarters.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The Rendering Question This is the one &lt;/del&gt;real &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;technical constraint. Content that only exists after JavaScript executes may be invisible to &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;retrieval fetch, which is not a browsing session and does not always run scripts&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Gemini and Google Surfaces Closest to conventional search infrastructure, which has a practical consequence: work that improves your standing in Google search tends to carry over here more than it does elsewhere.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;This variability is &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;main practical trap&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Testing without web access &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;concluding you are invisible measures the training corpus &lt;/del&gt;rather than &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;current retrieval&lt;/del&gt;, and the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;two can disagree sharply&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Record which mode &lt;/del&gt;you &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;used with every run&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Where &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Distinction Does Matter One place&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and it is worth being alert &lt;/del&gt;to&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;. Read broadly&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;answer engine optimization includes surfaces that &lt;/del&gt;are &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;not generative at all&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;such as featured snippets &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;structured result features&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;also worth checking which assistant your customers actually use rather than assuming. The answer varies by profession, age &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;country far more than industry commentary suggests&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and several businesses have built measurement programmes around a system their buyers never open&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Adding one question to your enquiry form settles it &lt;/del&gt;in a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;fortnight and can redirect the whole effort&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The decision that almost never makes sense for &lt;/del&gt;a commercial &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;business is blocking the agents that fetch pages when composing answers&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;That is the mechanism by which you get recommended&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;turning it off is &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;equivalent of declining to be listed anywhere, taken quietly, usually by accident&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A Reasonable Sequence Fix rendering first, since content a machine cannot see &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the only total failure &lt;/del&gt;in &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the list&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Then work through &lt;/del&gt;your &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;commercially important pages one at a time&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;moving the direct answer to the top &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;replacing the vaguest paragraph with concrete figures&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;second is content behind interaction&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Accordions&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;tabs &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;modals are good interface patterns &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;their content &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;sometimes absent &lt;/del&gt;from the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;initial response&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Check whether yours is present &lt;/del&gt;in the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;HTML even when collapsed&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;usually &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;configuration question &lt;/del&gt;rather than &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a design one&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Expect &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;vocabulary to keep shifting&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;expect new terms to arrive with each wave of positioning&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The underlying work has been stable since these systems started retrieving live sources&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it is &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;work &lt;/del&gt;rather than &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the name that you are buying&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;[https://www.88pianists.com/ Geo seo agency]&lt;/del&gt;&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Reviews Do Disproportionate Work For products more than &lt;/ins&gt;for &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;services, review content &lt;/ins&gt;is the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;evidence base. Volume matters, recency matters more&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;detail matters most, because a review that describes a specific use gives a model something to match against &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;specific question&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;You also cannot cleanly attribute a purchase to a recommendation &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;buyer received three weeks earlier &lt;/ins&gt;in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a conversation you never saw. That influence is real&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;often &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;main value of &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;channel, and it will not appear in any report &lt;/ins&gt;you &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;own.&lt;/ins&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Where a platform lets you add structured business information alongside reviews&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;complete every field&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;These profiles &lt;/ins&gt;are &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;frequently cited as much for their factual details as for their ratings&lt;/ins&gt;, and a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;half completed profile contributes far less than a full one even when the &lt;/ins&gt;review &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;count is identical. It is &lt;/ins&gt;an hour &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;of work per platform and it is repeatedly &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;cheapest improvement &lt;/ins&gt;available.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;This is the least interesting subject in &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;discipline &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the one that most often explains a &lt;/ins&gt;total &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;absence from generated answers&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A brand can do everything else correctly and remain invisible because a line &lt;/ins&gt;in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a text file&lt;/ins&gt;, or a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;setting nobody remembers enabling, is turning &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;relevant crawlers away&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;This entire area usually amounts to &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;day of &lt;/ins&gt;work. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;routinely &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;difference between a brand that appears &lt;/ins&gt;in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;answers and one that does not&lt;/ins&gt;, and it is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;worth doing before anybody writes a single word of new content. [https://www.88pianists&lt;/ins&gt;.&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;com/ get recommended by ai]&lt;/ins&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Get &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Basics Right Before Anything Clever Once access is confirmed&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;check &lt;/ins&gt;that &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;content actually exists &lt;/ins&gt;for a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;crawler to read&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Load your important pages with JavaScript disabled&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;If your specifications, pricing, service areas or contact details vanish&lt;/ins&gt;, they &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;are effectively absent from this channel regardless of how permissive your robots file &lt;/ins&gt;is.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Deciding Whether to Block Anything There &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a legitimate argument for restricting training crawlers, particularly &lt;/ins&gt;for &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;publishers whose archive &lt;/ins&gt;is the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;product&lt;/ins&gt;. That is a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;commercial and editorial decision &lt;/ins&gt;and it &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;deserves a &lt;/ins&gt;real &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;discussion rather than &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;default&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Gemini and Google Surfaces Closest to conventional search infrastructure, which has a practical consequence: work that improves your standing in Google search tends to carry over here more than it does elsewhere.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It also appears more conservative in commercial categories, hedging or declining to make a direct recommendation more often than &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;others&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Where it does recommend, established entity signals seem to matter, which favours brands with consistent details &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;long records over newer entrants.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;This is worth accepting &lt;/ins&gt;rather than &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;fighting. Your own comparison page is still worth publishing&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it will rarely be &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;most cited source in your category&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The higher leverage move is making sure the independent comparisons that already exist describe &lt;/ins&gt;you &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;accurately&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Put someone&#039;s name against this. Crawler rules sit between marketing, development and whoever administers &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;content delivery network&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which in most organisations means nobody checks them. The failures documented here are not difficult &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;find&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;they &lt;/ins&gt;are &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;simply nobody&#039;s job&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a quarterly review taking half an hour prevents the most complete form of invisibility available&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The last of these &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the most common &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the hardest to see&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;because it produces no error anyone internally encounters&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Your site works perfectly &lt;/ins&gt;in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;every browser while returning &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;challenge page to every legitimate retrieval agent&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Run &lt;/ins&gt;a commercial &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;prompt in almost any category and look at what gets cited&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Review platforms, roundups and comparison sites appear first and most often&lt;/ins&gt;, and the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;brands being discussed appear well down the list if at all&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;This &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;also why review volume and recency show up so consistently &lt;/ins&gt;in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;what gets cited&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A platform with forty recent accounts of working with you is more informative than &lt;/ins&gt;your &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;own page saying customers love you&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it is treated accordingly&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Shared Architecture All three now commonly retrieve live sources rather than answering purely from training&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Your question becomes one or more searches&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a set of pages is fetched &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;read, &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the answer &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;composed &lt;/ins&gt;from &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;what was read.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Why Third Party Comparisons Dominate The comparison pages cited most often are usually not published by any of &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;companies being compared&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A review site, a trade publication or an independent blogger weighing five options reads as disinterested &lt;/ins&gt;in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a way that a vendor&#039;s own page does not.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;If &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;only comparisons available are written by competitors and by review sites with incomplete information about you&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;that &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the version being used. Publishing an honest one puts &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;source into circulation that at least contains your figures stated correctly, and honest treatment of where you lose makes the rest of the page more credible &lt;/ins&gt;rather than &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;less&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Discontinued products deserve deliberate handling rather than deletion. Removing a page severs &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;connection between existing reviews and coverage and your catalogue&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it leaves stale third party listings pointing at nothing&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Keeping the page&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;marking it clearly as discontinued and naming the replacement preserves the accumulated evidence &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;redirects &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;recommendation &lt;/ins&gt;rather than &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;losing it&lt;/ins&gt;.&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>MelanieDickerson</name></author>
	</entry>
	<entry>
		<id>https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=92249&amp;oldid=prev</id>
		<title>HelenaAddis9 at 19:52, 15 August 2026</title>
		<link rel="alternate" type="text/html" href="https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=92249&amp;oldid=prev"/>
		<updated>2026-08-15T19:52:13Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Revision as of 19:52, 15 August 2026&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l1&quot;&gt;Line 1:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 1:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;−&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;What Brands Usually Get Wrong in Response The instinctive response is to publish more brand content, which addresses none of &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;above&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The second instinct &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;to try to displace &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;review site&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which is not achievable &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;would not help if &lt;/del&gt;it &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;were&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;One practical consequence of &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;variation between systems &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;worth planning for&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;If your customers are split across two assistants that behave differently&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;resist building separate programmes for each&lt;/del&gt;. The &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;shared requirements account for most of the achievable outcome&lt;/del&gt;, and the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;effort spent on system specific tactics is usually better spent widening the number &lt;/del&gt;of &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;third party sources that describe you correctly&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Writing Prompts That Sound Like Customers The foundational skill is deceptively mundane&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Somebody has to write &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;questions &lt;/del&gt;your &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;buyers &lt;/del&gt;actually &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;ask&lt;/del&gt;, in &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;their words&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;without &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;category vocabulary your team uses internally&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Real questions are messy&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;specific and frequently uncomfortable&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;They ask about price&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;about limitations, about whether you can handle a particular awkward situation. That specificity is exactly what makes &lt;/del&gt;an answer &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;quotable&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;because it matches &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;shape &lt;/del&gt;of &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a real query rather than a generic one&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;What llms&lt;/del&gt;.&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;txt Proposes It &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a proposed convention: a file at your root offering a curated, plain text guide to your site &lt;/del&gt;for &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;language model consumers&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;pointing at &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;documents you consider authoritative&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Statistical Caution This field circulates numbers faster than it checks them. &lt;/del&gt;A &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;widely repeated referral growth statistic rested on nineteen analytics properties&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;A frequently quoted conversion comparison came from &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;company selling &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;service it flattered&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;This variability is &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;main practical trap&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Testing without web access and concluding you &lt;/del&gt;are &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;invisible measures the training corpus &lt;/del&gt;rather than &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;current retrieval, and the two can disagree sharply. Record which mode you used with every run&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;writing skill sits &lt;/del&gt;in the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;middle&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It can be taught to &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;good writer in a few weeks&lt;/del&gt;, and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;having &lt;/del&gt;it &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;in-house pays off permanently, because every page you publish afterwards &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;better for it. The main obstacle is not difficulty but reluctance, since writing &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;be quoted means surrendering some of &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;control that persuasive copy provides. [https://www.88pianists&lt;/del&gt;.&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;com/ ai search optimization]&lt;/del&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;complication &lt;/del&gt;is that &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;AI systems use several distinct agents for different purposes. One may crawl for training corpora, another &lt;/del&gt;may fetch &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;pages live when composing an answer&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and a search provider&#039;s traditional crawler may feed both search results and an AI summary.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;What robots.txt Controls It &lt;/del&gt;is a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;request, honoured by mainstream crawlers, that certain user agents avoid certain paths. It has no enforcement behind it &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;it &lt;/del&gt;does not &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;secure anything, but the major providers respect it&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Gemini and Google Surfaces Closest to conventional search infrastructure, which has a practical consequence: work that improves your standing in Google search tends to carry over here more than it does elsewhere.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Deciding Whether to Block Anything There is a legitimate argument for restricting training crawlers, particularly for publishers whose archive &lt;/del&gt;is the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;product&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;That is a commercial &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;editorial decision and it deserves a real discussion &lt;/del&gt;rather than &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a default&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;How &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Test Rather Than Trust Everything above is a starting hypothesis&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Run twenty prompts in your own category across &lt;/del&gt;all &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;three&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;from signed out sessions, recording the mode &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the date, and count the cited domains for each&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Get the Basics Right Before Anything Clever Once access &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;confirmed, check that content &lt;/del&gt;actually &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;exists for a crawler to read&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Load your important pages with JavaScript disabled. If your specifications&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;pricing&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;service areas or contact details vanish, they are effectively absent from this channel regardless of how permissive &lt;/del&gt;your &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;robots file is&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;fix &lt;/del&gt;is &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;straightforward if slightly humbling&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Pull &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;language from sales call notes&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;support tickets &lt;/del&gt;and the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;search queries in Search Console&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;then have somebody outside marketing read the prompt set and flag anything that sounds like a brochure&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;A &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;capable in-house marketing team can usually absorb &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;new channel. Somebody learns &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;platform, reads &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;documentation, runs a test budget and reports back&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;This &lt;/del&gt;one &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;resists that pattern&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;because several of &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;skills it needs were never part of the job.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Where &lt;/del&gt;to &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Put Them Individual pages for questions with real volume and commercial weight, grouped sections for &lt;/del&gt;the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;smaller ones. Both work, &lt;/del&gt;and the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;decision should follow how much there is to say rather than a rule&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;most citable &lt;/del&gt;content &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;most businesses could publish already exists&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;unwritten, in sales calls &lt;/del&gt;and &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;support tickets&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It &lt;/del&gt;is the &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;set of questions people actually ask&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;with the answers your team gives verbally every week and has never put on &lt;/del&gt;a &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;page&lt;/del&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Observed behaviour leans toward breadth&lt;/del&gt;, &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;pulling from a wider set &lt;/del&gt;of sources &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;per answer than the others&lt;/del&gt;, and it &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;cites forums, documentation and niche trade sources readily&lt;/del&gt;. &lt;del style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It also appears comparatively responsive to freshness&lt;/del&gt;.&lt;/div&gt;&lt;/td&gt;&lt;td class=&quot;diff-marker&quot; data-marker=&quot;+&quot;&gt;&lt;/td&gt;&lt;td style=&quot;color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;That transparency makes it &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;best available proxy for how retrieval based answering behaves generally&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Here &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;what &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;citation pattern reveals&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;what a brand can actually do about &lt;/ins&gt;it. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Geo seo agency&lt;/ins&gt;&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Handle &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Statistics Carefully Numbers circulate in this field faster than anyone checks them, and using an unsourced one &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the fastest way to lose a room. Attach the provenance to everything you cite:&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Put someone&#039;s name against this&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Crawler rules sit between marketing, development and whoever administers the content delivery network&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which in most organisations means nobody checks them&lt;/ins&gt;. The &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;failures documented here are not difficult to find, they are simply nobody&#039;s job&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a quarterly review taking half an hour prevents &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;most complete form &lt;/ins&gt;of &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;invisibility available&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Make Sure It Can Fetch You Check that your robots&lt;/ins&gt;.&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;txt permits &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;relevant crawler, and check &lt;/ins&gt;your &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;server logs for what it &lt;/ins&gt;actually &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;receives. Bot management products frequently serve challenge pages to legitimate retrieval agents&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which produces total invisibility with no error anyone sees.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;It also appears more conservative &lt;/ins&gt;in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;commercial categories&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;hedging or declining to make a direct recommendation more often than &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;others. Where it does recommend, established entity signals seem to matter, which favours brands with consistent details and long records over newer entrants&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;If your category still gets meaningful traffic from those&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a proposal scoped only to assistants will leave that work undone&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Conversely&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;if somebody proposes &lt;/ins&gt;an answer &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;engine optimization programme and delivers only snippet optimisation&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;they are working on &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;older half &lt;/ins&gt;of &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the definition&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The fix is not abandoning modern frameworks&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Server side rendering or static generation produces the same interface with meaningful content in the initial response, and it &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;faster &lt;/ins&gt;for &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;humans too&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which is &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;usual pattern in this area&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;A &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;false trade off gets invented early in most of these projects&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Somebody proposes stripping the design, flattening the copy and restructuring everything around what &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;crawler finds convenient, and somebody else correctly points out that this would make &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;site worse for customers&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Some practitioners still use it that way, which makes it a superset of the newer work. Others use it as a synonym for &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;generative work specifically&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Both usages &lt;/ins&gt;are &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;in circulation, which is why asking somebody what they mean by it is a reasonable question &lt;/ins&gt;rather than &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;a pedantic one&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;difficulty with this proposal is that it asks for money before the problem is visible &lt;/ins&gt;in &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;any report &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;business already trusts&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;That is &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;genuinely hard sell&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;overselling &lt;/ins&gt;it is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the fastest way &lt;/ins&gt;to &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;lose credibility when &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;numbers stay small for two quarters&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Rendering Question This &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;the one real technical constraint. Content &lt;/ins&gt;that &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;only exists after JavaScript executes &lt;/ins&gt;may &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;be invisible to a retrieval &lt;/ins&gt;fetch, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;not &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;browsing session &lt;/ins&gt;and does not &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;always run scripts&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Gemini and Google Surfaces Closest to conventional search infrastructure, which has a practical consequence: work that improves your standing in Google search tends to carry over here more than it does elsewhere.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;This variability &lt;/ins&gt;is the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;main practical trap&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Testing without web access &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;concluding you are invisible measures the training corpus &lt;/ins&gt;rather than &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;current retrieval, and the two can disagree sharply. Record which mode you used with every run&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Where the Distinction Does Matter One place, and it is worth being alert &lt;/ins&gt;to. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Read broadly, answer engine optimization includes surfaces that are not generative at &lt;/ins&gt;all, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;such as featured snippets &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;structured result features&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;It &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;also worth checking which assistant your customers &lt;/ins&gt;actually &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;use rather than assuming&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;The answer varies by profession&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;age and country far more than industry commentary suggests&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and several businesses have built measurement programmes around a system their buyers never open. Adding one question to &lt;/ins&gt;your &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;enquiry form settles it in a fortnight and can redirect the whole effort&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;decision that almost never makes sense for a commercial business &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;blocking the agents that fetch pages when composing answers&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;That is &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;mechanism by which you get recommended&lt;/ins&gt;, and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;turning it off is &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;equivalent of declining to be listed anywhere, taken quietly&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;usually by accident&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;A &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Reasonable Sequence Fix rendering first, since content &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;machine cannot see is &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;only total failure in &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;list&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Then work through your commercially important pages &lt;/ins&gt;one &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;at a time&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;moving &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;direct answer &lt;/ins&gt;to the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;top &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;replacing &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;vaguest paragraph with concrete figures&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;second is &lt;/ins&gt;content &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;behind interaction. Accordions&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;tabs and modals are good interface patterns &lt;/ins&gt;and &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;their content is sometimes absent from the initial response&lt;/ins&gt;. &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Check whether yours &lt;/ins&gt;is &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;present in &lt;/ins&gt;the &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;HTML even when collapsed&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;which is usually a configuration question rather than &lt;/ins&gt;a &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;design one&lt;/ins&gt;.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;Expect the vocabulary to keep shifting&lt;/ins&gt;, &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;and expect new terms to arrive with each wave &lt;/ins&gt;of &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;positioning. The underlying work has been stable since these systems started retrieving live &lt;/ins&gt;sources, and it &lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;is the work rather than the name that you are buying. [https://www&lt;/ins&gt;.&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;88pianists&lt;/ins&gt;.&lt;ins style=&quot;font-weight: bold; text-decoration: none;&quot;&gt;com/ Geo seo agency]&lt;/ins&gt;&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>HelenaAddis9</name></author>
	</entry>
	<entry>
		<id>https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=89406&amp;oldid=prev</id>
		<title>LatashiaFrawley: Created page with &quot;What Brands Usually Get Wrong in Response The instinctive response is to publish more brand content, which addresses none of the above. The second instinct is to try to displace the review site, which is not achievable and would not help if it were.&lt;br&gt;&lt;br&gt;One practical consequence of the variation between systems is worth planning for. If your customers are split across two assistants that behave differently, resist building separate programmes for each. The shared requ...&quot;</title>
		<link rel="alternate" type="text/html" href="https://wiki-babylonsignalis.org/index.php?title=How_Llms.txt_And_Robots.txt_Affect_AI_Crawlers&amp;diff=89406&amp;oldid=prev"/>
		<updated>2026-08-15T15:55:21Z</updated>

		<summary type="html">&lt;p&gt;Created page with &amp;quot;What Brands Usually Get Wrong in Response The instinctive response is to publish more brand content, which addresses none of the above. The second instinct is to try to displace the review site, which is not achievable and would not help if it were.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;One practical consequence of the variation between systems is worth planning for. If your customers are split across two assistants that behave differently, resist building separate programmes for each. The shared requ...&amp;quot;&lt;/p&gt;
&lt;p&gt;&lt;b&gt;New page&lt;/b&gt;&lt;/p&gt;&lt;div&gt;What Brands Usually Get Wrong in Response The instinctive response is to publish more brand content, which addresses none of the above. The second instinct is to try to displace the review site, which is not achievable and would not help if it were.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;One practical consequence of the variation between systems is worth planning for. If your customers are split across two assistants that behave differently, resist building separate programmes for each. The shared requirements account for most of the achievable outcome, and the effort spent on system specific tactics is usually better spent widening the number of third party sources that describe you correctly.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Writing Prompts That Sound Like Customers The foundational skill is deceptively mundane. Somebody has to write the questions your buyers actually ask, in their words, without the category vocabulary your team uses internally.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Real questions are messy, specific and frequently uncomfortable. They ask about price, about limitations, about whether you can handle a particular awkward situation. That specificity is exactly what makes an answer quotable, because it matches the shape of a real query rather than a generic one.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;What llms.txt Proposes It is a proposed convention: a file at your root offering a curated, plain text guide to your site for language model consumers, pointing at the documents you consider authoritative.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Statistical Caution This field circulates numbers faster than it checks them. A widely repeated referral growth statistic rested on nineteen analytics properties. A frequently quoted conversion comparison came from a company selling the service it flattered.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;This variability is the main practical trap. Testing without web access and concluding you are invisible measures the training corpus rather than current retrieval, and the two can disagree sharply. Record which mode you used with every run.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The writing skill sits in the middle. It can be taught to a good writer in a few weeks, and having it in-house pays off permanently, because every page you publish afterwards is better for it. The main obstacle is not difficulty but reluctance, since writing to be quoted means surrendering some of the control that persuasive copy provides. [https://www.88pianists.com/ ai search optimization]&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The complication is that AI systems use several distinct agents for different purposes. One may crawl for training corpora, another may fetch pages live when composing an answer, and a search provider&amp;#039;s traditional crawler may feed both search results and an AI summary.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;What robots.txt Controls It is a request, honoured by mainstream crawlers, that certain user agents avoid certain paths. It has no enforcement behind it and it does not secure anything, but the major providers respect it.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Gemini and Google Surfaces Closest to conventional search infrastructure, which has a practical consequence: work that improves your standing in Google search tends to carry over here more than it does elsewhere.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Deciding Whether to Block Anything There is a legitimate argument for restricting training crawlers, particularly for publishers whose archive is the product. That is a commercial and editorial decision and it deserves a real discussion rather than a default.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;How to Test Rather Than Trust Everything above is a starting hypothesis. Run twenty prompts in your own category across all three, from signed out sessions, recording the mode and the date, and count the cited domains for each.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Get the Basics Right Before Anything Clever Once access is confirmed, check that content actually exists for a crawler to read. Load your important pages with JavaScript disabled. If your specifications, pricing, service areas or contact details vanish, they are effectively absent from this channel regardless of how permissive your robots file is.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The fix is straightforward if slightly humbling. Pull the language from sales call notes, support tickets and the search queries in Search Console, then have somebody outside marketing read the prompt set and flag anything that sounds like a brochure.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;A capable in-house marketing team can usually absorb a new channel. Somebody learns the platform, reads the documentation, runs a test budget and reports back. This one resists that pattern, because several of the skills it needs were never part of the job.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Where to Put Them Individual pages for questions with real volume and commercial weight, grouped sections for the smaller ones. Both work, and the decision should follow how much there is to say rather than a rule.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;The most citable content most businesses could publish already exists, unwritten, in sales calls and support tickets. It is the set of questions people actually ask, with the answers your team gives verbally every week and has never put on a page.&amp;lt;br&amp;gt;&amp;lt;br&amp;gt;Observed behaviour leans toward breadth, pulling from a wider set of sources per answer than the others, and it cites forums, documentation and niche trade sources readily. It also appears comparatively responsive to freshness.&lt;/div&gt;</summary>
		<author><name>LatashiaFrawley</name></author>
	</entry>
</feed>