Library / Web Scraping & Research
Web Scraping & Research
Scrape Hacker News Who Is Hiring Posts with OpenAI
When you run it, it finds the Hacker News Who Is Hiring posts, has GPT-4o-mini turn each job into a unified structure, and saves them to Airtable.
What it does
## Data Structure We use Openai GPT-4o-mini to transform the raw data in a unified data structure. Feel free to change this. json { "company": "Name of the hiring company", "title": "Job title/role being advertised", "location": "Work location including remote/hybrid status", "type": "Employment type (Full-time, Contract, etc)", "salary": "Compensation details if provided", "description": "Main job description text including requirements and team info", "apply_url": "Direct application/job posting URL", "company_url": "Company website or careers page" }
The steps
- When clicking ‘Test workflow’
- Split Out
- OpenAI Chat Model
- Structured Output Parser
- Search for Who is hiring posts
- Get relevant data
- Get latest post
- Split out children (jobs)
- Trun into structured data
- Extract text
- Clean text
- Limit for testing (optional)
- Write results to airtable
- HI API: Get the individual job post
15 steps in total.
Similar automations
Web Scraping & ResearchScrape Hacker News Who Is Hiring Posts into Airtable15 stepsWeb Scraping & ResearchScrape Hacker News Hiring Posts into Airtable with GPT15 stepsWeb Scraping & ResearchScrape Hacker News Who Is Hiring Posts into Airtable44 stepsWeb Scraping & ResearchScrape Hacker News Who Is Hiring Posts into Airtable44 steps