Check if robots.txt has timed out or if certain URLs were blocked by it. You can also see whether or not a URL was found Con a sitemap, or if our AhrefsSiteAuditBot couldn't parse the sitemap Sopra the first place. Oppure puoi innestare l’URL dominio che un competitor ed estrapolare https://socialbuzzfeed.com/story2866724/dice-buzz-su-robots-txt