Search our Knowledge Base

Google Search Console Crawl Issues

This report is being deprecated because Google has notified us that they will be shutting down their Search Console Crawl Errors APIs at the end of March (ref: Google Developer doc).

If you have this included in marketing dashboards, client dashboards or automated PDF reports that you share with clients or co-workers, please remove this report because it will not contain data after Google shuts down their API.

We will continue to monitor Google's Search Console APIs for a replacement, however, at this time they are not offering one.

The Crawl Issues report provides details about the URLs in your campaign's site that Google could not successfully crawl or that returned an HTTP error code.

If you are still seeing crawl issues listed in our report after you have resolved them in Search Console, please note that it can take up to 5 days before Google releases that updated data to us via their API.

Important! To view this report, Google Search Console (Webmaster Tools) must be configured correctly
(please refer to our Search Console (Google Webmaster) Tools integration documentation).

Search Console (Webmaster Tools) Crawl Issues

Crawl Issues Chart & Table View 

The Google Search Console (Webmaster Tools) chart shows the number of crawl errors each day, with the number of each type indicated by a different color.

Search Console (Webmaster Tools) Crawl Issues Chart

The Crawl Issues report table displays the:

  • URL of the reported error (click the arrow to open the URL)
  • Category of error
  • Platform (Web, Smartphone only, Mobile)
  • Last Crawled by Google
  • First Detected by Google
  • Response Codes (list of response codes)

Search Console Crawl Issues Report Table

The table can also be filtered which allows the user to narrow down what is displayed within the table.

Crawl Issues Report Table Filter Options

Crawl Issues Report Options

The Crawl Issues report options displays allow users to:
  • Show or Hide the Chart and or Table
  • Select the number of results to display per page
  • Platform (All Platforms, Web, Smartphone Only, Mobile)
Search Console Crawl Issues Report Table Filter Options

Crawl Errors Resolved

The data that we receive from Google’s API includes all errors unfiltered. If the crawl issue is marked as fixed in the Search Console account for the website being tracked, Google does not update the API data that we receive immediately.  The error resolution first processes through Google's internal servers and there is an unknown delay until it’s actually published to the API data that we receive. We have seen instances where their data refresh can take 4 or more days.  Our reports are updated as soon as Google provides the data.

Search Console Reports & Graphs

Authorizing a Google Search Console account connection with Rank Ranger integrates referral traffic and search query data directly into the following reports and graphs that can be viewed and added to white label client dashboards, web marketing dashboards and automated PDF Reports:

Search Console Crawl Error Export Utility

Export utility provides all "Linked From” data in the Search Console Crawl Errors report including:
  • Page URL
  • Last Crawled
  • First Detected
  • Response Code
  • Platform
  • Category
  • Linked From URL 

Generate a Crawl Errors Report

In Campaign Settings > Webmaster Tools screen scroll to the Crawl Error Report section and click the Generate Report button  

Search Console Crawl Error Export Utility

Report Status: Pending

Immediately after clicking the Generate Report button, the screen displays the status of Pending. It can take 10 minutes to several hours for this report to generate based on the number of requests in the queue and Google's response time. Do not refresh the screen, as that will generate a new request for the same report. We recommend moving on to other tasks and returning to the screen later.

crawl error export pending

Report Status: Ready

When the report generation has been completed, the status displays Ready and you can click the Download button to obtain the zipped CSV file. You can click the Remove button to delete the file, or it will automatically be removed in 7 days.

crawl error export ready

Get the ultimate SEO tools with the Rank Ranger Software
Learn More About Rank Ranger