SEO and AI search in depth
Sitemaps, robots.txt, llms.txt, meta tags, structured data and hreflang are set up on every site without configuration, and new content appears in them as soon as it's published.
This continues Page SEO and social images. None of this needs setting up; it's here so you know what your site already does.
On every site, automatically
| What | What it does |
|---|---|
| Sitemaps | One for your pages and a live one for your content: a new post is in it the moment you publish it |
| robots.txt | Points to the sitemaps; follows your settings for search engines and AI training |
| llms.txt | A summary of your site for AI assistants, following llmstxt.org: what the site is, its pages with descriptions, and the 100 newest items of each collection |
| Meta tags | Title from your template, description, a canonical address without tracking parameters, Open Graph and X cards with an image social networks accept |
| Structured data | Article, product with price, website and organisation on the homepage, and FAQ blocks |
| hreflang | Links between language versions that have their own content |
| Site icons | Favicon, Apple and Android icons from one upload |
The review link is never in search engines.
AI assistants and AI training
Two different things, set separately in Site settings › Indexing:
- Being found by AI assistants — ChatGPT search, Perplexity and others can read and cite your site. llms.txt helps them.
- Training AI models on your site — turn Let AI companies train on this site off and robots.txt blocks crawlers that collect training data: GPTBot, Google-Extended, CCBot, ClaudeBot, Applebot-Extended, Bytespider and others. AI search still finds you.
Analyze › AI and search shows which AI and search crawlers read your pages, robots.txt, llms.txt and sitemap, and visits from AI assistants show as their own source. See Analyze in depth.
Site settings for search
- SEO & sharing — the site name in titles ("{page} · {site}"), a default description and share image.
- Indexing — show the site in search engines, automatic or custom robots.txt, AI training, automatic or custom llms.txt.
- Integrations & code — Google Search Console verification, GA4 and Google Tag Manager on the live domain only, and custom code.
See Site settings.
Redirects and moved pages
- Up to 2,000 exact redirects and 100 with a wildcard.
- Renaming or moving a published page adds a 301 redirect by itself.
- Changing a collection item's address updates links to it in other items.
Content and SEO
- Each collection item has its own SEO title, description and image, suggested from its content, and Show in search results. They go live with the item, without publishing the site.
- FAQ blocks in rich text get FAQ structured data.
- Filtered and sorted collection lists point search engines to the plain list.
Limits
- Collection list pages aren't in the sitemap; item pages are.
- SEO of ordinary pages goes live with the next publish of the site.