Skip to content
NEWMarketplace and the trig8n Agent: sell what you build, and get plans and changes that are tested before you see them. See what is new

Library / Web Scraping & Research

Web Scraping & Research

Scrape Web Pages and Clean Content with OpenAI

When you run it, it fetches web pages, extracts HTML, has OpenAI clean the content and updates rows in Google Sheets.

What it does

# Manualtrigger Workflow ## Overview Automated workflow: Manualtrigger Workflow. This workflow processes data and performs automated tasks. ## Workflow Details - Total Nodes: 17 - Node Types: 11 - Error Handling: ✅ Implemented - Security: ✅ Hardened (no sensitive data) - Documentation: ✅ Complete ## Node Breakdown - When clicking "Execute Workflow": manualTrigger - HTTP Request: httpRequest - HTML Extract: htmlExtract - OpenAI: openAi - Merge: merge - Clean Content: code - Update Google Sheets: googleSheets - Parse JSON: code - Read Google Sheets: googleSheets - Split In Batches: splitInBatches - ... and 7 more nodes ## Usage Instructions 1. Configure Credentials: Set up all required API keys and credentials 2. Update Variables: Replace any placeholder values with actual data 3. Test Workflow: Run in test mode to verify functionality 4. Deploy: Activate the workflow for production use ## Security Notes - All sensitive data has been removed or replaced with placeholders - Error handling is implemented for reliability - Follow security best practices when configuring credentials ## Troubleshooting - Check error logs if workflow fails - Verify all credentials are properly configured - Ensure all required services are accessible

The steps

  1. When clicking "Execute Workflow"
  2. HTTP Request
  3. HTML Extract
  4. OpenAI
  5. Merge
  6. Clean Content
  7. Update Google Sheets
  8. Parse JSON
  9. Read Google Sheets
  10. Split In Batches
  11. Wait
  12. Error Handler
  13. Error Handler for 7a8bb997
  14. Error Handler for f45fcc6a

24 steps in total.

Similar automations