About the Web Audit Suite Crawler

Our scanner identifies itself with the following User-Agent string:

WebAuditSuite/1.0 (+https://webauditsuite.com/bot)

All outbound requests made by Web Audit Suite during a website scan use this identifier.

The scanner performs passive analysis of publicly accessible web pages. Each scan triggers approximately the same traffic a normal visitor would generate when browsing your site, following links and reading metadata that's already exposed to any browser.

Concretely, a scan may:

• Fetch your homepage and a small number of internal pages over HTTPS.
• Read your robots.txt and sitemap.xml.
• Read response headers, meta tags, and visible page content.
• Perform DNS lookups against public records.
• Check the validity and expiry of your TLS certificate.

• It does not log in, submit forms, or interact with authenticated areas.
• It does not probe non-public endpoints, fuzz parameters, or test for vulnerabilities.
• It does not perform port scans beyond standard HTTP/HTTPS.
• It does not attempt to bypass WAFs, CAPTCHAs, or rate limits.
• It does not impersonate a specific browser or another vendor's crawler.

Scans are user-initiated — they only run when a Web Audit Suite user submits a URL. We do not run continuous background crawls.

A single scan typically issues fewer than 100 requests over a few minutes, with built-in concurrency limits to avoid burdening the target site. We honor robots.txt rules.

If you don't want the Web Audit Suite scanner to access your site, add the following to your robots.txt:

User-agent: WebAuditSuite
Disallow: /

We honor robots.txt rules and will not crawl paths your site disallows for our user-agent or for the wildcard * user-agent.