Grouped crawl data provides information about crawl requests.
Posted: Mon Jan 20, 2025 5:58 am
Grouped Crawl Data
"Section "Crawl Request Breakdown
The data breaks down these requests by URL file type, response, Googlebot list of denmark consumer email type, and the purpose of the request (discovering a new page or updating an existing page).
Host Status
Host status shows the general availability of your site and whether Google can access it without any problems.
Host Status Details
Here's an overview:
Robots.txt errors mean that Google was unable to crawl your site for some technical reason. Robots.txt fetch indicates the failure rate bots encountered when crawling your robots.txt file. Even if your site doesn’t need a robots.txt file, it should return a 200 or 404 response when requested. If Googlebot has a connection issue, such as an HTTP 503 status , it will stop crawling your site.
DNS resolution tells you when the DNS server did not recognize your hostname or did not respond during the crawl. If you encounter a problem, contact your registrar to verify that your site is set up correctly and that your server has an active internet connection.
Server connectivity tells you when your server has not responded or has not provided a complete response. If you are experiencing spikes or consistent connectivity issues, you may need to talk to your provider about increasing capacity or troubleshooting availability issues.
"Section "Crawl Request Breakdown
The data breaks down these requests by URL file type, response, Googlebot list of denmark consumer email type, and the purpose of the request (discovering a new page or updating an existing page).
Host Status
Host status shows the general availability of your site and whether Google can access it without any problems.
Host Status Details
Here's an overview:
Robots.txt errors mean that Google was unable to crawl your site for some technical reason. Robots.txt fetch indicates the failure rate bots encountered when crawling your robots.txt file. Even if your site doesn’t need a robots.txt file, it should return a 200 or 404 response when requested. If Googlebot has a connection issue, such as an HTTP 503 status , it will stop crawling your site.
DNS resolution tells you when the DNS server did not recognize your hostname or did not respond during the crawl. If you encounter a problem, contact your registrar to verify that your site is set up correctly and that your server has an active internet connection.
Server connectivity tells you when your server has not responded or has not provided a complete response. If you are experiencing spikes or consistent connectivity issues, you may need to talk to your provider about increasing capacity or troubleshooting availability issues.