Indexing Insight API
  1. Guides
Indexing Insight API
  • Getting Started
  • Guides
    • Authorization
    • Rate limiting
    • Response errors
    • API key details
    • URL report
    • Index coverage
  • Clients
    • Screaming Frog
    • Google Sheets
  • References
    • API key details
      GET
    • URL report
      GET
    • Index coverage
      GET
  1. Guides

URL report

The URL report is the core of how Indexing Insight provides actionable SEO insights.
For each page URL that we monitor with the URL Inspection API, our tool captures both current and historic indexing data. It’s this page URL data that is used to power our reports.
We allow developers to view the current and historic indexing data for a specific page URL.

Request URL Report#

The URL report indexing data for a URL report can be requested using the GET /v1/url-report/and including the API key in the Authorization header.
The URL can used in the request for specific indexing data for a page URL and is a required property.
For example:

URL Report Results#

The URL Report results schema is returned by the GET /v1/url-report/ endpoint.

URL#

The URL property is the URL of the page being monitored by Indexing Insight. This property will always be included in the response, and will be a string.

Index Summary#

The index_summary property is a summary if the page is indexed or not indexed in Google Search. This property will always be included in the response, and will be a string.
The results from this property are one of the following:
FieldDescription
IndexedThe page URL is indexed in Google.
Not IndexedThe page URL is not indexed in Google.
nullNo data for the page URL in Indexing Insight.

Index Coverage State#

The index_coverage_state indicates the index coverage state of the page in Googles's Search Index. This property will always be included in the response, and will be a string.
The results from this property are the same as the coverageState property in the URL Inspection API documentation.
A full list of index coverage states names and descriptions can be found here.

Indexing Allowed#

The indexing_allowed Indicates if Google was allowed or not allowed to index the page through meta robots noindex. This property will always be included in the response, and will be a string.
The results from this property are one of the following:
FieldDescription
YesGoogle did not detect a meta robots noindex tag.
No, noindex' detected in 'robots' meta tagThe page URL has a meta robots noindex tag.
No, 'noindex' detected in 'X-Robots-Tag'The page URL has a X-Robots-Tag noindex in the http header.
-The indexing state is unspecificed by Google.
nullNo data for the page URL in Indexing Insight.

Google Selected Canonical#

The google_selected_canonical property is the canonical URL chosen by Google's Search Index. This property will always be included in the response, and will be a string.
The property's results are equivalent to those of the GoogleCanonical property described in the URL Inspection API documentation.

User Selected Canonical#

The user_selected_canonical declared canonical URL on the page. This property will always be included in the response, and will be a string.
The property's results are equivalent to those of the UserCanonical property described in the URL Inspection API documentation.

Googlebot Primary Crawler#

The googlebot_primary_crawler property is the primary Googlebot user-agent that crawled the page. This property will always be included in the response, and will be a string.
The property's results are equivalent to those of the CrawlingUserAgent property described in the URL Inspection API documentation.

Last Crawl Time#

The last_crawl_time property is the last time the page was crawled by Googlebot's primary crawler. This property will always be included in the response, and will be a string using a date-time format.
The property's results are equivalent to those of the LastCrawlTime property described in the URL Inspection API documentation.

Days Since Last Crawl#

The days_since_last_crawl property is the number of days since Googlebot primary crawler last crawled the page. This property will always be included in the response, and will be a integer.
The days_since_last_crawl property is updated every 24 hours based on the last_crawl_time property, which records when Googlebot last crawled the page.

Page Fetch Status#

The page_fetch_status property indicates if Google could successfully fetch and download the page from the server. This property will always be included in the response, and will be a string.
This property's results are equivalent to those of the page fetch status property described in the URL Inspection API documentation.

Blocked by Robots.txt#

The blocked_by_robots_txt property indicates if Googlebot's primary crawler was blocked by robots.txt. This property will always be included in the response, and will be a string.
The results from this property are one of the following:
FieldDescription
YesThe page URL is blocked from being crawled by Googlebot.
NoThe page URL is not blocked from being crawled by Googlebot
-The robots.txt state is unspecified by Google.
nullNo data for the page URL in Indexing Insight.

Sitemaps#

The sitemaps property is a list of sitemaps where the URL was found by Indexing Insight. This property will always be included in the response, and will be an array.
The property provides a list of sitemaps that the URL was detected in by Indexing Insight.

Inspection Date#

The inspection_date property is the time the page was inspected using the URL Inspection API. This property will always be included in the response, and will be a string using a date-time format.
The property uses a timestamp to record when we inspected the page using the URL Inspection API.

Page Detection#

The page_detection property is the time that Indexing Insight detected the page in the tool. This property will always be included in the response, and will be a string.

Inspection Link#

Theinspection_link property is the link to the URL Inspection tool for the page URL in Google Search Console. This property will always be included in the response, and will be a string.

Indexing Insight Link#

Theindexing_insight_link property is the link to the URL report for the specific URL being monitored. This property will always be included in the response, and will be a string.

Previously Indexed#

Thepreviously_indexed property indicates if Indexing Insight ever detected if the page was historically indexed. This property will always be included in the response, and will be a string.
The results from this property are one of the following:
FieldDescription
YesWhen monitoring the page URL, we historically detected the index summary of 'indexed'.
NoWhen monitoring the page URL, we did not historically detect the index summary of 'indexed'.
nullNo data for the page URL in Indexing Insight.

Previously Indexed Timestamp#

The previously_indexed_timestamp property is the timestamp when Indexing Insight detected the page was indexed. This property will always be included in the response, and will be a string using a date-time format.

Previously Indexed Link#

The previously_indexed_link property is the link to the historic URL Inspection tool in Google Search Console for the last indexed detection. This property will always be included in the response, and will be a string.

Canonical Changed#

The canonical_changed property Indexing Insight detected a change in the Google-selected canonical URL. This property will always be included in the response, and will be a string.
The results from this property are one of the following:
FieldDescription
YesWhile monitoring the page URL, we detected a change in the Google-selected or user-declared canonical URL.
NoWhile monitoring the page URL, we did not detect any change in the Google-selected or user-declared canonical URL.
nullNo data for the page URL in Indexing Insight.

Canonical Changed Google Canonical#

The canonical_changed_google_canonical property is the Google selected canonical URL detected during the change. This property will always be included in the response, and will be a string.

Canonical Changed User Canonical#

The canonical_changed_user_canonical property is the user declared canonical URL detected during the change. This property will always be included in the response, and will be a string.

Canonical Changed Timestamp#

The canonical_changed_timestamp property is the time Indexing Insight detected the Google selected canonical URL change. This property will always be included in the response, and will be a string using a date-time format.

Canonical Changed Link#

The canonical_changed_link property is the link to the historic URL Inspection tool in Search Console when the Google canonical URL changed. This property will always be included in the response, and will be a string.

Ever Blocked by Robots.txt#

The ever_blocked_by_robots_txt property is when Indexing Insight detected if the robots.txt blocked Google from crawling the page. This property will always be included in the response, and will be a string.
The results from this property are one of the following:
FieldDescription
YesWe detected the index coverage state 'URL blocked by robots.txt' when monitoring the page URL.
NoWe did not detect the index coverage state 'URL blocked by robots.txt' when monitoring the page URL.
nullNo data for the page URL in Indexing Insight.

Ever Blocked by Robots.txt Timestamp#

The ever_blocked_by_robots_txt_timestamp property is the time when Indexing Insight detected the robots.txt blocked Google from crawling the page. This property will always be included in the response, and will be a string using a date-time format.

Ever Blocked by Robots.txt Link#

The ever_blocked_by_robots_txt_link property is the link to the historic URL Inspection tool in Search Console when the robots.txt block was detected. This property will always be included in the response, and will be a string.
Modified at 2025-05-22 08:40:19
Previous
API key details
Next
Index coverage
Built with