Privacy

Files and pasted text

Uploaded files and pasted lists are read and processed in your browser. They are not sent to our servers.

URLs you ask us to fetch

When you crawl a site, fetch a sitemap or robots.txt by URL, find sitemaps or spot-check URLs, our server requests those public pages on your behalf as SitemapForgeBot and returns the result to you. We don't store the results. Standard request logs (time, IP address, path) are kept briefly by our host, Vercel, for security and rate limiting.

Site owners: the crawler obeys robots.txt for the token SitemapForgeBot, stays on one hostname, and stops at 300 pages per run.

AI features

The "fix plan" and "write robots.txt for me" buttons send a summary of your findings or your description to an AI model through Vercel AI Gateway, only when you click. We don't store the request or the answer.

Stored in your browser

To save retyping, some tools remember your last inputs in your browser's localStorage: the start URL and pasted list in the generator, recent sitemap URLs in the validator, the domain in the finder, and your robots.txt drafts. This data stays on your device and is never sent to us.

Analytics

We use Ahrefs Web Analytics to count page views. It is cookieless and does not build cross-site profiles.