How SearchedBy reads websites

When we read a site

Only when someone asks for a free scan of that site on this website and confirms their email with a code. The terms require it to be their own site, a site they are authorised to analyse, or public information for a legitimate purpose.

What we request, and how fast

A few public pages (up to 6), the robots.txt and the sitemaps, at one request per second. No logins, no forms, nothing private. Some pages are opened by a real browser, which loads their scripts like any visit.

Which identity we use

We read like a browser. To see whether search and AI crawlers are let in, we request up to 3 of those pages again with each crawler's identity (Google, Bing, ChatGPT, Perplexity and Claude, among others). In this scan the site's robots.txt isn't a rule for us: we read it and report what it says.

If you don't want your site analysed

Write to [email protected] from an address on your domain, or with another way to show the site is yours. We add it to the exclusion list and the form stops accepting it. We reply within 7 days.

If you are named in a report

AI engines' answers can name companies and, sometimes, people. If you are named in a report and want a mention corrected or removed, write to [email protected] with the link or the domain. We reply within 7 days.