Guides
Get found by AI, in plain English
News, explainers and step-by-step fixes for business owners and online shops who want AI assistants to find and recommend them.
Latest guides
-
28 October 2026
Blocking GPTBot won’t take you out of ChatGPT search. Here’s what will.
AI companies use separate crawlers for training and for search. Here’s which is which, and how to set robots.txt so you’re found without being trained on.
Fix guides
Step-by-step fixes
One for each issue Promptopus checks. Do them yourself or hand them to your developer.
- Add a page title and description Give your homepage a clear title and meta description, the summary search engines and AI tools use to describe you. 10 minutes · Easy
- Add an llms.txt file (optional) Publish a short plain-text guide to your site for AI tools. Optional, and only worth doing once the basics are right. 20 minutes · Easy
- Add product data to your product pages Give every product page Product structured data, so AI shopping tools and Google read your price, stock and details instead of guessing. 30 minutes to half a day · Moderate
- Add shipping and returns to your product data Tell AI shopping tools what delivery costs and whether people can return things, by adding shipping and returns to your structured data or Merchant Center. 30 minutes to 2 hours · Moderate
- Add structured data about your business Add Organization or LocalBusiness structured data so search engines and AI tools know exactly who you are. 20 to 45 minutes · Moderate
- Check Cloudflare’s AI crawler settings Make sure Cloudflare isn’t blocking the AI search crawlers you want, separately from your robots.txt. 10 minutes · Easy
- Complete your business details Fill in the missing fields in your Organization structured data, especially your logo and social profiles. 15 to 30 minutes · Easy
- Complete your product data Add the missing product details, such as price, stock status, brand and barcode, so AI tools can show and match your products. 30 minutes to a few hours · Moderate
- Let AI search crawlers read your site Change robots.txt so ChatGPT search, Claude, Perplexity, Google and Bing can read your pages, while keeping AI training blocked if you want to. 10 to 20 minutes · Easy
- Let Google quote your homepage Remove the nosnippet setting so Google can show text from your page, including in AI Overviews and AI Mode. 5 to 15 minutes · Easy
- Let search engines index your homepage Remove the noindex setting that keeps your homepage out of Google, AI Overviews and other AI search tools. 5 to 15 minutes · Easy
- Publish an XML sitemap Switch on your platform’s sitemap and list it in robots.txt, so crawlers can find every page. 10 minutes · Easy
- Put your main content in the HTML Make sure your pages’ text is in the HTML the server sends, so AI crawlers that don’t run JavaScript can read it. Varies by site · Developer needed
- Show your reviews to AI tools Turn on your review app’s structured data so your star rating is in your product data, where AI tools can see it. 10 to 20 minutes · Easy