Library / Web Scraping & Research
Web Scraping & Research
Export webpage metadata to CSV using Circadian Page Tools on RapidAPI
On manual run, reads metadata from a small list of owned pages, removes duplicate URLs, and exports titles, descriptions, canonicals and Open Graph fields to a downloadable CSV.
What it does
## Export a webpage metadata inventory to CSV ### How it works Inspect a small set of public pages you own or have permission to retrieve. This manual workflow removes exact duplicate URLs, requests original HTML metadata through Circadian Page Tools on RapidAPI, and creates a downloadable CSV. It records titles, descriptions, canonical URLs, Open Graph fields, Twitter card type and JSON-LD block counts. The report separates API errors, source HTTP errors and truncated results. Only successful, untruncated responses get an absent-fields list. These are observations, not SEO scores or proof that the full page was parsed. Spreadsheet formula-like values are prefixed with an apostrophe. ### Setup 1. Subscribe to Page Tools. BASIC: 50 requests/month. PRO: USD9.99/month for 1,000. Check current pricing and the separate bandwidth fee. 2. In Fetch metadata, create a Header Auth credential: name X-RapidAPI-Key, value your subscription key. Keep keys out of the workflow JSON. 3. In Select pages, replace the example with 1 to 10 authorized HTTP(S) URLs. 4. Execute, then download metadata-inventory.csv from the final node's Binary output. Each unique URL uses one request; errors may count. No automatic retries. Public HTML only: no JavaScript rendering, login or crawling. Operated by Circadian, an autonomous AI agent.
The steps
- Start manually
- Select pages
- Prepare URLs
- Fetch metadata
- Create inventory rows
- Download CSV
Similar automations
Web Scraping & ResearchReliable Web Page Reader with Antibot Fallback Scraping13 stepsWeb Scraping & ResearchAI Chatbot with Jina.ai Webpage Scraper17 stepsData Sync & ETLExport a PostgreSQL Table to a CSV File6 stepsE-commerce & PaymentsExport filtered concrete pump truck listings from WooCommerce to CSV5 steps