# 18 Dec, 2025 - Bingbot crawl rate limitation. Issue: Website downtime due to CPU limit being hit. Cause: Bingbot sending 500+ requests in a short time. Fix: Limit crawl rate to reduce server load
User-agent: bingbot
Crawl-delay: 1

# Jan 04, 2026 - Block / limit Screaming Frog SEO Spider. Reason: External SEO crawls caused high traffic
User-agent: Screaming Frog SEO Spider
Crawl-delay: 10
Disallow: /

# Siteground Support History, Technical Issues, Ticket 5043637
User-agent: meta-webindexer
Disallow: /