Build a multi-site content aggregator with Google Sheets & custom extraction logic

An intelligent web scraping workflow that automatically routes URLs to site-specific extraction logic, normalizes data across multiple sources, and filters content by freshness to build a unified article feed. What Makes This Different: - Intelligent Source Routing - Uses a Switch node to route URLs to specialized extractors based on source identifier, enabling custom CSS selectors per publisher for maximum accuracy - Universal Fallback Parser - Advanced regex-based extractor handles unknown sources automatically, extracting title, description, author, date, and images from meta tags and HTML patterns - Freshness Filtering - Built-in 45-day freshness threshold filters outdated content before saving, with configurable date validation logic - Tier-Based Classification - Automatically categorizes articles into Tier 1 (0-7 days), Tier 2 (8-14 days), Tier 3 (15-30 days), or Archive based on publication date - Rate Limiting & Error Handling - Built-in 3-second delays between requests prevents server overload, with comprehensive error handling that continues processing even if individual URLs fail - Status Tracking - Updates source spreadsheet with processing status, enabling easy monitoring and retry logic for failed extractions Key Benefits of Multi-Source Content Aggregation: - Scalable Architecture - Easily add new sources by adding a Switch rule and extraction node, no code changes needed for most sites - Data Normalization - Standardizes extracted data across all sources into a consistent format (title, description, author, date, image, canonical URL) - Automated Processing - Schedule-based execution (every 4 hours) or manual triggers keep your feed updated without manual intervention - Quality Control - Freshness filtering ensures only recent, relevant content enters your feed, reducing noise from outdated articles - Flexible Input - Reads from Google Sheets, making it easy to add URLs in bulk or integrate with other systems - Comprehensive Metadata - Captures full article metadata including canonical URLs, publication dates, author information, and featured images --- Who's it for This template is designed for content aggregators, news monitoring services, content marketers, SEO professionals, researchers, and anyone who needs to collect and normalize articles from multiple websites. It's perfect for organizations that need to monitor competitor content, aggregate industry news, build content databases, track publication trends, or create unified article feeds without manually scraping each site or writing custom scrapers for every source. How it works / What it does This workflow creates a unified article aggregation system that reads URLs from Google Sheets, routes them to site-specific extractors, normalizes the data, filters by freshness, and saves results to a feed. The system: 1. Reads Pending URLs - Fetches URLs with source identifiers from Google Sheets, filtering for entries with "Pending" status 2. Processes with Rate Limiting - Loops through URLs one at a time with a 3-second delay between requests to respect server resources 3. Fetches HTML Content - Downloads page HTML with proper browser headers (User-Agent, Accept, Accept-Language) to avoid blocking 4. Routes by Source - Switch node directs URLs to specialized extractors (Site A, B, C, D) or universal fallback parser based on Source field 5. Extracts Article Data - Site-specific HTML nodes use custom CSS selectors, while fallback uses regex patterns to extract title, description, author, date, image, and canonical URL 6. Normalizes Data - Standardizes all extracted fields into consistent format, handling missing values and trimming whitespace 7. Filters by Freshness - Validates publication dates and filters out articles older than 45 days (configurable threshold) 8. Calculates Tier & Status - Assigns tier classification and freshness status based on article age 9. Saves to Feed - Appends normalized articles to Article Feed sheet with all metadata 10. Updates St