Put your main content in the HTML
Make sure your pages’ text is in the HTML the server sends, so AI crawlers that don’t run JavaScript can read it.
- Time
- Varies by site
- Difficulty
- Developer needed
- Updated
- 28 October 2026
Your browser runs a page’s scripts before showing it. Most AI crawlers don’t: they read the HTML your server sends and stop there. If your text only appears once scripts run, they see a nearly blank page.
1. See what a crawler sees
In your browser, right-click the page and choose View page source (not “Inspect”). Search for a sentence from your page. If you can’t find it, it’s being added by JavaScript.
2. Find out why
- Site builders and themes: some page sections, sliders or “apps” load their content with scripts. Swap them for standard text sections where you can.
- Custom sites built with React, Vue or similar: the site may be rendering everything in the browser. That’s a build setting your developer can change.
3. Fix it
Ask your developer to render content pages on the server (server-side rendering) or ahead of time (static generation or pre-rendering). Most modern frameworks support this without a redesign.
4. Check again
View the page source again, then run Promptopus. You should see a good number of words reported in the HTML.
For your developer
Most AI crawlers fetch raw HTML and do not execute JavaScript. Use server-side rendering or static generation for content routes (Next.js SSR/SSG, Nuxt SSR, Astro, prerendering). Verify with curl or "view source", not the browser inspector.
General guidance only. Take a backup before making changes, and test on a staging copy where you can. Nobody can guarantee what AI tools recommend.