Hosted sitemap and robots

Hosting optionsCopy Anchor Link

Pick either:

1. Reverse proxy: proxy /sitemap.xml and /robots.txt to https://api.soobro.com/v1/sites/{publicKey}/sitemap.xml and …/robots.txt
2. Framework adapter: geoSitemap() / geoRobots() for Next.js, or fetchSitemap() / fetchRobots() from @geo/sdk/server for other frameworks

sitemapCopy Anchor Link

• Content library articles, category pages and custom pages are included by publish status
• Every URL carries the xhtml:link rel="alternate" hreflang set
• More than 50,000 entries are sharded automatically with a sitemap index
• changefreq and priority are configurable per type

<url>
  <loc>https://example.com/zh-CN/blog/smart-home-guide</loc>
  <lastmod>2026-11-01</lastmod>
  <xhtml:link rel="alternate" hreflang="zh-Hans" href="https://example.com/zh-CN/blog/smart-home-guide" />
  <xhtml:link rel="alternate" hreflang="en" href="https://example.com/en/blog/smart-home-guide" />
</url>

robots.txtCopy Anchor Link

Configure rules and the AI crawler policy under Sites → robots.txt:

User-agent: *
Allow: /
Disallow: /api/

User-agent: GPTBot
Allow: /

User-agent: ClaudeBot
Allow: /

Sitemap: https://example.com/sitemap.xml

For GEO, allowing GPTBot, ClaudeBot, PerplexityBot, Google-Extended and similar crawlers is a precondition for being cited; restrict individual crawlers if needed.

InvalidationCopy Anchor Link

After publishing, unpublishing or changing configuration, the hosted sitemap and robots update within 60 seconds; edge caches are invalidated per site.