Multi-platform source discovery with SerpAPI, DuckDuckGo, GitHub, Reddit & Bluesky

Source Discovery - Automatically Search More Up-to-Date Information Sources 🎬 Overview Version : 1.0 This workflow utilizes various nodes to discover and analyze potential sources of information from platforms like Google, Reddit, GitHub, Bluesky, and others. It is designed to streamline the process of finding relevant sources based on specified search themes. ✨ Features - Automated source discovery from multiple platforms. - Filtering of existing and undesired sources. - Error handling for API requests. - User-friendly configuration options. 👤 Who is this for? This workflow is ideal for researchers, content marketers, journalists, and anyone looking to efficiently gather and analyze information from various online sources. 💡 What problem does this solve? This workflow addresses the challenge of manually searching for relevant information sources, saving time and effort while ensuring that users have access to the most pertinent content. Ideal use-cases include: - Resource Compilation for Academic and Educational Purposes - Journalism and Research - Content Marketing - Competitor Analysis 🔍 What this workflow does The workflow gathers data from selected platforms through search terms. It filters out known and undesired sources, analyzes the content, and provides insights into potential sources relevant to the user's needs. 🔄 Workflow Steps 1. Search Queries - Fetch sources using SerpAPI search, DuckDuckGo, and Bluesky. - Utilizes GitHub repositories to find relevant links. - Leverages RSS feeds from subreddits to identify potential sources. 2. Filtering Step - Removes existing and undesired sources from the results. 3. Source Selection - Analyzes the content of the identified sources for relevance. 📌 Expected Input / Configuration The workflow is primarily configured via the Configure Workflow Args (Manual) node or the Global Variables custom node. - Search themes: Keywords or phrases relevant to the desired content. - Lists of known sources and undesired sources for filtering. 📦 Expected Output A curated list of potential sources relevant to the specified search themes, along with insights into their content. 📌 Example !printscreen1.png(fileId:1965) !printscreen2.png(fileId:1964) !printscreen3.png(fileId:1961) !printscreen4.png(fileId:1962) !printscreen5.png(fileId:1963) !printscreen6.png(fileId:1966) ⚙️ n8n Setup Used - n8n version: 1.105.3 - n8n-nodes-serpapi: 0.1.6 - n8n-nodes-globals: 1.1.0 - n8n-nodes-bluesky-enhanced: 1.6.0 - n8n-nodes-duckduckgo-search: 30.0.4 - LLM Model: mistral-small-latest (API) - Platform: Podman 4.3.1 on Linux - Date: 2025-08-06 ⚡ Requirements to Use / Setup - Self-hosted or cloud n8n instance. - Install the following custom nodes: SerpAPI, Bluesky, and DuckDuckGo Search. - n8n-nodes-serpapi - n8n-nodes-duckduckgo-search - n8n-nodes-bluesky-enhanced - Install the Global Variables Node for enhanced configuration: - n8n-nodes-globals (or use Edit Field (Set) node instead) - Provide valid credentials to nodes for your preferred LLM model, SerpAPI, and Bluesky. Credentials for GitHub recommended. ⚠️ Notes, Assumptions \& Warnings - Ensure compliance with the terms of service of any platforms accessed or discovered in this workflow, particularly concerning data usage and attribution. - Monitor API usage to avoid hitting rate limits. - The workflow may encounter errors such as 403 responses; in such cases, it will continue by ignoring the affected substep. - Duplicate removal is applied, but occasional overlaps might still appear depending on the sources. - This workflow assumes familiarity with n8n, APIs, and search engines. - Using AI agents (Mistral or substitute LLMs) requires access to their API services and keys. - This is not a Curator of News. It is designed to find websites that are relevant and useful to your searches. If you are looking for a relevant news selector, please check this workflow. ℹ️ About Us This workflow was developed by the Hybroht team. Our goal is to create tools th