Submit sitemap URLs from Oncrawl to Google Indexing API and IndexNow

Summary This workflow enables the submission of business-critical URLs via the Google Indexing API and IndexNow. Why is this important for SEO? - If your objective is visibility within AI-powered search and answer engines (such as Copilot, Perplexity, or OpenAI tools), the IndexNow integration is particularly relevant. IndexNow accelerates URL discovery for Bing and Yandex, which are key retrieval sources for several LLM-based platforms. - In parallel, Google remains the dominant search engine, representing ~80% of global search traffic. Gemini is deeply integrated into Google’s ecosystem and, when grounding is enabled, can leverage Google Search as an external retrieval source. Ensuring fast and reliable indexation of critical URLs therefore remains a strategic foundation for both traditional SEO and AI-assisted search experiences. Description This workflow uses OnCrawl API endpoint to automatically discover your sitemaps.xml and submit their latest updates to both Google Indexing API and IndexNOW. It includes two variations: - Index orphan pages detected in sitemap.xml and submit them to Google and IndexNow. - Index newly released pages by identifying indexable canonical URLs added between a pre-release crawl and a post-release crawl. How it works This workflow works for Oncrawl users with API access enabled in their plan. if you are not an Oncrawl users, please refer to: https://n8n.io/workflows/8778-workflow-for-submitting-changed-sitemap-urls-using-google-indexing-api-and-bing-indexnow/ To get an API Key, just go in your User Account profile > tokens > + Add API access token: - Description: any name - Scope: select all checkboxes - Click in Create token. Keep your API secret safe Discover & parse Sitemaps - Create your first crawl by: Clicking in Create configuration > choose a template > Automate > Webhook. - Webhook Node: In n8n, copy paste the Webhook callback URL into the Oncrawl Webhook section. At the end, Oncrawl sends a POST HTTP request to n8n containing: WorkspaceID, ProjectID, CrawlID. More details in Webhook Documentation: https://developer.oncrawl.com/notification - Discoversitemaps endpoint: documentation: https://developer.oncrawl.com/. This endpoint checks the Sitemaps declared in your robots.txt file. You can filter the output to avoid duplicate sitemaps - Config: It’s an initiation node that populate variables such as: - CrawlID: Fetch from Webhook Node - SITEURL: Your site with the following format: https://your-site.com - SITEMAPURL: For subdomain sitemaps, you can duplicate this field. - INDEXNOWKEY: You can create it in the Bing Webmaster tools here https://www.bing.com/indexnow/getstarted - INDEXNOWKEYURL: it's usually your domain and the INDEXNOWKEY: wwww.example.com/ <INDEXNOWKEY> Variables you can update depending on your specs: - DAYSBACK: 7 by default. - BATCHSIZE: 500 it's the default recommended by IndexNow - USEGOOGLE, USEINDEXNOW: by default it's true which means the process will run for both Google and IndexNow Google Node Check Status Node (OAuth Setup): - documentation: https://developers.google.com/webmaster-tools/v1/urlInspection.index/inspect Create credentials: https://console.cloud.google.com/apis/credentials - Enable Google Search Console API - Download the Client ID / Client Secret JSON - Connect n8n using: - Client ID - Client Secret - Scopes - Google Search Console account - All explanations are contained in these tutorials: https://www.youtube.com/watch?v=HT56wExnN5k | https://www.youtube.com/watch?v=FBGtpWMTppw Scopes reference: https://developers.google.com/identity/protocols/oauth2/scopes Google Index API: - Create a service account here https://console.cloud.google.com/iam-admin/serviceaccounts - Assign role: Owner - Generate a JSON key (contains email + private key) - For the two Google API nodes: - Authentication: Predefined credential type - Credential Type: Google Service Account API - Credential configuration: - Region: Your project region - Servic