What to do if the Website Audit responds won’t start due to an execution error?
Why does the bot only scan 1000 pages?
My website gets overloaded with requests during scan, can I limit the audit's crawling speed?
How to whitelist SE Rankings IPs in Cloudflare?
How do I run a website audit?
How much time does it take to generate a website audit report?
What is the difference between Website Audit and On-Page SEO Checker?
How do I know that a request to my site came from the SE Ranking bot?
What to do if the Website Audit responds won’t start due to an execution error?
The most common reason for the Website Audit failing to start is our bot getting blocked by your website’s firewall.
To ensure the proper launch and scan please make sure that our bot isn’t blocked by the firewall by whitelisting our crawler's IPs and user-agent(SEBot-WA).
Please note, that our bot operates from German IPs, and security rules that block access from Germany may override the whitelist.
Why does the bot only scan 1000 pages?
The default limit for the number of scanned pages is set to 1000, you may change it in the tool’s settings.
My website gets overloaded with requests during scan, can I limit the audit's crawling speed?
The default speed is set to 500 requests per second, but you may limit it in the tool’s settings.
How to whitelist SE Rankings IPs in Cloudflare?
This guide is especially important if you actively use SE Ranking’s Website Audit and On-Page SEO Checker.
The Cloudflare Firewall provides protection from vulnerabilities such as malicious incoming traffic. Sometimes, its automatic rules block our crawlers and prevents SE Ranking’s bots from crawling your website.
But you can easily remove this restriction because Cloudflare provides users with great flexibility. Just follow these steps:
- Log in to the Cloudflare dashboard, and select your account and domain.
- Go to the Security section > click WAF > choose the Tools subsection
- Under IP Access Rules, first enter one of SE Ranking’s IPs. The rule must be set for each crawler's IP separately.
Select a Skip action. Then for Zone, select whether the rule applies to the current website only or to all websites in the account.
Finally, do the same steps with other IPs.
That’s it! If you want to know more, go to the official Cloudflare guide.
How do I run a website audit?
The website audit starts automatically when you create a new project. To restart the audit, click the appropriate button in the Website Audit module. Also, you can set up a schedule for automatic rechecks – once per week or month in the Settings.
How much time does it take to generate a website audit report?
Since your website is checked against dozens of parameters, we can’t predict exactly how long it will take the system to complete the audit. It depends on the number of pages and images on the website, whether there is a crawl delay in the robots.txt file, as well as the internal queue in the system. You will be able to monitor the crawling process in the Website Audit module.
You will get a notification via email once the audit report has been generated.
What is the difference between Website Audit and On-Page SEO Checker?
The Website Audit scans all pages of a website and provides an analysis along with suggestions on how to fix identified problems. An example of the report can be found here.
The On-Page SEO Checker audits a certain URL and evaluates how well it is optimized for a certain query. It detects mistakes that negatively affect the given page’s search engine ranking. An example of the report can be found here.
How do I know that a request to my site came from the SE Ranking bot?
In order to confirm that, you must know how to verify SE Ranking Crawler. Please check our quick guide, which explains how to do that.