Library / Web Scraping & Research
Web Scraping & Research
Extract Article Titles from Web Pages in a Loop
When you run it, it fetches a page body, extracts the article title with HTML Extract and loops until all items are finished.
What it does
# Manualtrigger Workflow ## Overview Automated workflow: Manualtrigger Workflow. This workflow integrates 8 different services: stickyNote, itemLists, httpRequest, htmlExtract, set. It contains 20 nodes and follows best practices for error handling and security. ## Workflow Details - Total Nodes: 20 - Node Types: 8 - Error Handling: ✅ Implemented - Security: ✅ Hardened (no sensitive data) - Documentation: ✅ Complete ## Node Breakdown - On clicking 'execute': manualTrigger - Note: stickyNote - Note2: stickyNote - Set: set - Note6: stickyNote - Note1: stickyNote - Item Lists - Create Items from Body: itemLists - HTML Extract - Extract Article Title: htmlExtract - Item Lists - Fetch Body: itemLists - If - Are we finished?: if - ... and 10 more nodes ## Usage Instructions 1. Configure Credentials: Set up all required API keys and credentials 2. Update Variables: Replace any placeholder values with actual data 3. Test Workflow: Run in test mode to verify functionality 4. Deploy: Activate the workflow for production use ## Security Notes - All sensitive data has been removed or replaced with placeholders - Error handling is implemented for reliability - Follow security best practices when configuring credentials ## Troubleshooting - Check error logs if workflow fails - Verify all credentials are properly configured - Ensure all required services are accessible
The steps
- On clicking 'execute'
- Set
- Item Lists - Create Items from Body
- HTML Extract - Extract Article Title
- Item Lists - Fetch Body
- If - Are we finished?
- Set - Increment Page
- HTTP Request - Get Mock Albums
- HTTP Request - Get Wikipedia Page
- HTTP Request - Get my Stars
- Error Handler
- Stopanderror 1
- Stopanderror 2
- Error Handler for 9f0df828
38 steps in total.
Similar automations