{"article":{"id":16335355751196,"url":"https://serankingteam.zendesk.com/api/v2/help_center/en-us/articles/16335355751196.json","html_url":"https://help.seranking.com/hc/en-us/articles/16335355751196-Verifying-SE-Ranking-Crawler-FAQ","author_id":16070358699292,"comments_disabled":false,"draft":false,"promoted":false,"position":6,"vote_sum":-4,"vote_count":30,"upvote_count":13,"downvote_count":17,"section_id":16332657216412,"created_at":"2024-10-11T05:52:44Z","updated_at":"2026-10-23T09:02:22Z","name":"Verifying SE Ranking Crawler FAQ","title":"Verifying SE Ranking Crawler FAQ","source_locale":"en-us","locale":"en-us","outdated":false,"outdated_locales":[],"edited_at":"2026-09-03T11:30:32Z","user_segment_id":null,"permission_group_id":15939478809756,"content_tag_ids":[],"label_names":[],"body":"<div style=\"line-height: 1.6;\">\n<p>SE Ranking Crawler is used to crawl websites for <a href=\"https://help.seranking.com/en/project-tools/website-audit/how-to-use-website-audit\" target=\"_blank\" rel=\"noopener noreferrer\">Website Audit</a> and <a href=\"https://help.seranking.com/en/seo-tools/on-page-seo-checker/how-to-use-on-page-seo-checker\" target=\"_blank\" rel=\"noopener noreferrer\">On-Page SEO Checker</a> tools. By default, SE Ranking Crawler follows the instructions specified in the <em>robots.txt</em> file. However, this setting can be changed in the project configuration.</p>\n<p>The user agent of our crawler is <strong>SEBot-WA</strong>. You can verify if a web crawler using your server is truly SE Ranking Crawler by using one of the methods specified below.</p>\n<h3 style=\"color: #123af8;\" id=\"h_01JEBDSC3VMV4TS0DCH808QCNH\">Reverse DNS method</h3>\n<p>This is the preferred verification method. All servers used by SE Ranking Crawler have domain names that are subdomains of <a href=\"http://sr-srv.net/\" target=\"_blank\" rel=\"noopener noreferrer\">sr-srv.net</a> (this domain is owned and exclusively used by SE Ranking).</p>\n<p><strong>Step 1:</strong> Run a reverse DNS lookup on the IP address in question:</p>\n<div style=\"background-color: #f4f7fd; border-left: 4px solid #123af8; border-radius: 6px; margin: 16px 0; padding: 16px;\">\n<code>$ host 144.76.237.123</code><br><code>123.237.76.144.in-addr.arpa domain name pointer </code><a href=\"http://cloud106.sr-srv.net/\" target=\"_blank\" rel=\"noopener noreferrer\"><code>cloud106.sr-srv.net</code></a>\n</div>\n<p><strong>Step 2:</strong> Verify that the resulting domain name is the subdomain of <a href=\"http://sr-srv.net\" target=\"_blank\" rel=\"noopener noreferrer\">sr-srv.net</a>.</p>\n<p><strong>Step 3:</strong> Run a forward DNS lookup on the resulting domain name:</p>\n<div style=\"background-color: #f4f7fd; border-left: 4px solid #123af8; border-radius: 6px; margin: 16px 0; padding: 16px;\">\n<code>$ host cloud106.sr-srv.net</code><br><code>cloud106.sr-srv.net has address 144.76.237.123</code>\n</div>\n<p><strong>Step 4:</strong> Confirm that the resulting IP address matches the original IP address.</p>\n<h3 style=\"color: #123af8;\" id=\"h_01JEBDSC3VRVQSG3CHMDMXM79K\">IP Match Method</h3>\n<p>You can also verify SE Ranking Crawler by matching its IP with the official list of addresses below.</p>\n<div style=\"background: #fefeff; border: 1px solid #e1e6f0; border-radius: 12px; padding: 20px 24px; margin-top: 16px; box-shadow: 0 2px 6px rgba(0,0,0,0.04); max-width: 860px; position: relative;\">\n  <h4 id=\"h_01K1B11106223HZRABBJ23DAHQ\" style=\"margin-top: 0; color: #123af8;\">\n    Current SE Ranking Crawler IP addresses\n  </h4>\n\n  <button style=\"position: absolute; top: 20px; right: 24px; background: #123af8; color: #fff; border: none; padding: 6px 12px; border-radius: 6px; cursor: pointer; font-size: 14px;\" onclick=\"copySErankingIPs()\">\n    Copy IPs\n  </button><div id=\"seranking-ips\" style=\"display: grid; grid-template-columns: repeat(auto-fit, minmax(280px, 1fr)); gap: 8px 32px; margin-top: 16px;\">\n    <ul style=\"list-style: none; padding-left: 0; margin: 0;\">\n      <li>5.9.48.208</li>\n      <li>23.88.36.149</li>\n      <li>37.27.13.192</li>\n      <li>37.27.22.37</li>\n      <li>37.27.22.127</li>\n      <li>37.27.29.8</li>\n      <li>46.4.81.149</li>\n      <li>62.238.32.219</li>\n      <li>116.202.175.208</li>\n      <li>136.243.103.47</li>\n      <li>138.201.137.152</li>\n      <li>142.132.195.214</li>\n      <li>144.76.14.242</li>\n      <li>144.76.15.151</li>\n      <li>144.76.69.81</li>\n    </ul>\n\n    <ul style=\"list-style: none; padding-left: 0; margin: 0;\">\n      <li>144.76.164.62</li>\n      <li>144.76.237.123</li>\n      <li>162.55.94.175</li>\n      <li>162.55.94.176</li>\n      <li>162.55.244.19</li>\n      <li>167.233.95.57</li>\n      <li>167.233.145.180</li>\n      <li>167.233.148.147</li>\n      <li>167.233.156.129</li>\n      <li>168.119.64.236</li>\n      <li>176.9.41.54</li>\n      <li>176.9.64.179</li>\n      <li>176.9.74.49</li>\n      <li>178.63.105.151</li>\n    </ul>\n  </div>\n</div>\n<div style=\"background-color: #f0f4ff; border-left: 4px solid #123AF8; border-radius: 8px; margin: 20px 0; max-width: 860px; padding: 16px 20px;\"><p style=\"margin: 0;\"><strong>Still getting a 403 after whitelisting these IPs?</strong> The list above is a current snapshot, but SE Ranking Crawler’s addresses are assigned dynamically and can change over time — for Website Audit, some requests are also routed through a dedicated proxy pool — so a newer crawler IP may not yet appear in this list. For an allowlist that keeps working when the IPs change, allow the crawler by its user agent (<strong>SEBot-WA</strong>) or by the <a href=\"#h_01JEBDSC3VMV4TS0DCH808QCNH\">Reverse DNS method</a> above (every crawler host resolves under <strong>*.sr-srv.net</strong>), instead of relying on a fixed IP list alone. Also check whether your firewall, CDN, or WAF has rules that override the IP allowlist — for example, region-specific blocking or bot-protection rules that reject the crawler even when its IPs are whitelisted. Note that a crawl can also be stopped by your site’s <em>robots.txt</em> rules or, on password-protected sites, by missing HTTP authentication in the audit settings — these are separate from an origin 403.</p></div>\n<script>\n  function copySErankingIPs() {\n    const ips = document.querySelectorAll(\"#seranking-ips li\");\n    const ipList = Array.from(ips)\n      .map(el => el.textContent.trim())\n      .join(\"\\n\");\n\n    navigator.clipboard.writeText(ipList)\n      .then(() => {\n        alert(\"IP addresses copied to clipboard.\");\n      })\n      .catch(() => {\n        alert(\"Failed to copy IPs.\");\n      });\n  }\n</script>\n</div>","user_segment_ids":[]}}