Skip to content
NEWMarketplace and the trig8n Agent: sell what you build, and get plans and changes that are tested before you see them. See what is new

Library / Web Scraping & Research

Web Scraping & Research

Scrape Websites with a Bright Data MCP Gemini Agent

When you run it, a Gemini AI agent uses Bright Data MCP tools to list available scrapers and extract web data from target pages.

What it does

# Scrape Web Data with Bright Data, Google Gemini and MCP Automated AI Agent ## Overview Automated workflow: Scrape Web Data with Bright Data, Google Gemini and MCP Automated AI Agent. This workflow integrates 12 different services: stickyNote, httpRequest, lmChatGoogleGemini, agent, mcpClientTool. It contains 25 nodes and follows best practices for error handling and security. ## Workflow Details - Total Nodes: 25 - Node Types: 12 - Error Handling: ✅ Implemented - Security: ✅ Hardened (no sensitive data) - Documentation: ✅ Complete ## Node Breakdown - AI Agent: agent - When clicking ‘Test workflow’: manualTrigger - MCP Client list all tools for Bright Data: mcpClient - Sticky Note1: stickyNote - MCP Client List all tools: mcpClientTool - MCP Client Bright Data Web Scraper: mcpClient - Webhook for web scraper: httpRequest - Set the URLs: set - MCP Client to Scrape as Markdown: mcpClientTool - MCP Client to Scrape as HTML: mcpClientTool - ... and 15 more nodes ## Usage Instructions 1. Configure Credentials: Set up all required API keys and credentials 2. Update Variables: Replace any placeholder values with actual data 3. Test Workflow: Run in test mode to verify functionality 4. Deploy: Activate the workflow for production use ## Security Notes - All sensitive data has been removed or replaced with placeholders - Error handling is implemented for reliability - Follow security best practices when configuring credentials ## Troubleshooting - Check error logs if workflow fails - Verify all credentials are properly configured - Ensure all required services are accessible

The steps

  1. AI Agent
  2. When clicking ‘Test workflow’
  3. MCP Client list all tools for Bright Data
  4. MCP Client List all tools
  5. MCP Client Bright Data Web Scraper
  6. Webhook for web scraper
  7. Set the URLs
  8. MCP Client to Scrape as Markdown
  9. MCP Client to Scrape as HTML
  10. Google Gemini Chat Model for AI Agent
  11. Simple Memory
  12. Webhook for Web Scraper AI Agent
  13. Set the URL with the Webhook URL and data format
  14. Create a binary data

36 steps in total.

Similar automations