Templates / Scrape and summarize posts of a news site without RSS feed using AI and save them to a NocoDB

Scrape and summarize posts of a news site without RSS feed using AI and save them to a NocoDB

Needs changes

by Askan · 30,783 views · created 2024-03-17 · Market Research, AI Summarization

Needs changes. This template uses 2 thing(s) that n8n 3.0 removes: OpenAI (legacy), Item Lists (legacy). 2 breaking item(s) found. Static check, last run 2026-10-19.

What this workflow does

This workflow has 18 nodes and runs on a schedule (every week at 04:00). Along the way it connects NocoDB. It also calls colt.net over HTTP.

How it runs

Trigger: On a schedule (every week at 04:00).

  1. Retrieve the web page for further processsing (HTTP Request): calls colt.net
  2. Extract the HTML with the right css class (HTML): parses or builds HTML
  3. Extract date (HTML): parses or builds HTML
  4. Create single link items (Item Lists): reshapes item lists (legacy Item Lists node)
  5. Create single date items (Item Lists): reshapes item lists (legacy Item Lists node)
  6. Merge: merges the data from its input branches
  7. Select posts of last 7 days (Code): runs custom JavaScript code
  8. Merge: merges the data from its input branches
  9. HTTP Request: calls an HTTP API
  10. Summary (OpenAI): work with chat

…plus 7 more steps. See the full node list below.

Services it uses

NocoDB

HTTP calls to: colt.net

Before you upgrade to n8n 3.0

2 things in this workflow are removed in n8n 3.0. Fix them before you upgrade:

  • OpenAI (legacy) in Summary, Keywords: replace with OpenAI node (AI section).
  • Item Lists (legacy) in Create single link items, Create single date items: replace with Split Out, Aggregate, Sort, Limit, Remove Duplicates or Summarize (match the operation used).
Removed in 3.0Replace with
OpenAI (legacy)
Summary, Keywords
OpenAI node (AI section)
Item Lists (legacy)
Create single link items, Create single date items
Split Out, Aggregate, Sort, Limit, Remove Duplicates or Summarize (match the operation used)

Nodes used (9)

From the author

The News Site from Colt, a telecom company, does not offer an RSS feed, therefore web scraping is the choice to extract and process the news. The goal is to get only the newest posts, a summary of each post and their respective (technical) keywords. Note that…

Excerpt from Askan's description on n8n.io.

View the original on n8n.io → Check your own copy

Get the weekly “what broke” email

New templates, newly broken ones, and n8n release changes. One short email a week.

Form not loading? Subscribe here.