Help & FAQ
Common questions about website analysis
Quick Answers
Why did my scan fail?
Many sites use security measures (WAF, bot protection) that block automated scanners. This is expected behavior, not a bug.
What can I try?
Try a simpler URL (homepage vs deep page), wait a few minutes and retry, or try without "www" prefix.
Is this just your tool?
No. All web auditing tools (Lighthouse, Ahrefs, SEMrush, Screaming Frog) face the same limitations with protected sites.
What sites commonly fail?
Government sites, banking portals, healthcare systems, large enterprise sites, and sites behind Cloudflare/Akamai protection.
Frequently Asked Questions
Web auditing tools like ours work by making automated HTTP requests to websites and analyzing the responses. However, many websites implement security measures specifically designed to block or slow down automated requests:
- Web Application Firewalls (WAF) - Services like Cloudflare, Akamai, and AWS WAF detect and block automated traffic patterns
- Bot Protection - CAPTCHA challenges, JavaScript challenges, and behavioral analysis that automated tools cannot pass
- Rate Limiting - Servers that restrict how many requests can be made from a single source in a given time period
- IP Blocking - Some sites block entire ranges of IP addresses associated with cloud hosting providers
- Geographic Restrictions - Sites that only allow access from certain countries or regions
These security measures are legitimate and important for protecting websites from malicious bots, scrapers, and DDoS attacks. Our scanner respects these protections and will not attempt to bypass them.
If a scan fails, here are some things you can try:
- Try a simpler URL - Scan the homepage (e.g., example.com) instead of a deep page (e.g., example.com/products/category/item)
- Wait and retry - Some rate limits reset after a few minutes. Wait 2-5 minutes and try again
- Try with/without www - Some sites behave differently with "www.example.com" vs "example.com"
- Check if the site is accessible - Try visiting the site in your browser to make sure it's actually online
- Verify the URL - Make sure there are no typos in the domain name
Important
If a site consistently blocks our scanner, it likely has strong bot protection that cannot be bypassed. This is not a limitation of our tool specifically - it's how the site is designed to behave.
Additional Resources
- Terms of Service - Usage guidelines and limitations
- Privacy Policy - How we handle your data
- PageSpeed Insights API Documentation
Still Have Questions?
If your question isn't answered here, contact us at support@webauditsuite.com.