Verifying SE Ranking Crawler FAQ

SE Ranking Crawler is used to crawl websites for Website Audit and On-Page SEO Checker tools. By default, SE Ranking Crawler follows the instructions specified in the robots.txt file. However, this setting can be changed in the project configuration.

The user agent of our crawler is SEBot-WA. You can verify if a web crawler using your server is truly SE Ranking Crawler by using one of the methods specified below.

Reverse DNS method

This is the preferred verification method. All servers used by SE Ranking Crawler have domain names that are subdomains of sr-srv.net (this domain is owned and exclusively used by SE Ranking).

Step 1: Run a reverse DNS lookup on the IP address in question:

Step 2: Verify that the resulting domain name is the subdomain of sr-srv.net.

Step 3: Run a forward DNS lookup on the resulting domain name:

Step 4: Confirm that the resulting IP address matches the original IP address.

IP Match Method

You can also verify SE Ranking Crawler by matching its IP with the official list of addresses below.