SitemetricsBot

SitemetricsBot is the crawler behind Sitemetrics. It reads the public homepages of websites in the ranking, to record what each website is built with and what its homepage says about it.

How it identifies itself

Every request carries this user agent:

Mozilla/5.0 (compatible; SitemetricsBot/1.0; +https://www.sitemetrics.com/bot/)

What it does

It follows your robots.txt. It asks before any other request to a website.
It reads homepages, and only now and then. It does not crawl your other pages, submit forms or log in, and it never presents itself as a browser or as another crawler.
It shows what a homepage shows. It may take a homepage’s icon and a picture of its first screen to show on the website’s Sitemetrics page.

How to stop it

Add this to your robots.txt, and it stops reading your homepage:

User-agent: SitemetricsBot
Disallow: /

To stop it altogether, so it sends your website nothing at all, prove you own the website. Either way, the website keeps its place in the ranking and its page, which shows what was read before, with the date.

Something SitemetricsBot did that it should not have? Tell us.