Библиотека / Веб-скрейпинг и исследования
Веб-скрейпинг и исследования
Определение технологического стека сайтов через Apify и оценка потенциальных клиентов с помощью OpenAI
Ежедневный запуск определяет технологии каждого сайта из списка через Apify, оценивает соответствие с помощью OpenAI и отправляет отчёты через Slack и Gmail; по понедельникам отправляется сводка за 7 дней.
Что делает
## Detect website technology stacks with Apify and flag sales prospects using OpenAI Fingerprints the technologies behind each website you list through Apify (CMS, e-commerce platform, analytics, CDN, frameworks) and scores each site for fit with your offer. Typical uses: find stores on a platform you build apps for, spot sites with no analytics or security tooling to pitch, or track which competitors' customers run which stack. ### How it works 1. A daily schedule (or the manual trigger) loads Config; a Monday schedule sends a 7-day report instead. 2. Runs the Apify actor website-tech-stack-detector and downloads the results. 3. Drops incomplete rows and anything already seen in the last 30 days. 4. Score technology fit gives a 0-100 rule score; an OpenAI model adds a fit score, verdict and summary. 5. Upserts every row to the TechStacks sheet tab. Hot rows go to Slack for approval, warm rows to an email digest. ### Setup steps - [ ] Add an Apify HTTP Header Auth credential (Authorization: Bearer ) on the 3 Apify HTTP nodes. - [ ] Create a Google Sheet with the columns in *Upsert to Google Sheets* and paste its ID into googleSheetId. - [ ] Connect OpenAI, Slack and Gmail; set slackChannelId and digestEmail in Config. - [ ] In Config set actorInput.urls, then targetTechnologies (lowercase tool names you sell into), targetCategories, gapCategories (categories whose absence is your pitch) and minConfidence. - [ ] Describe your ideal result in aiCriteria, run once manually, then activate. ### Customization - Change the weights in Score technology fit (target technology 35 plus 10 per extra, gap categories 10 each, old versions 10). - Raise hotScore (60) or warmScore (35) to send fewer alerts. - Needs an Apify account; actor runs use your Apify credits.
Шаги
- Daily schedule
- Run manually
- Weekly report schedule
- Config
- Daily run or weekly report?
- Start Apify run
- Wait before polling
- Get run status
- Check run status
- Route by run status
- Stop: Apify run failed
- Fetch dataset items
- Validate and dedupe
- Any new records?
Всего шагов: 35.
Похожие автоматизации
Веб-скрейпинг и исследованияЕжедневные оповещения о упоминаниях ключевых слов на Reddit из Apify в Slack и GmailШагов: 8Веб-скрейпинг и исследованияScore Reddit buying-intent leads with Apify, OpenAI, Google Sheets and SlackШагов: 26Веб-скрейпинг и исследованияОтслеживание и оценка новых вакансий с Apify, OpenAI, Slack и Google SheetsШагов: 35Веб-скрейпинг и исследованияSummarize new YouTube videos with Apify and OpenAI and log to Notion and SlackШагов: 19