Skip to main content

Apify + Clay: Use Web Scraping to Enrich Your Personal CRM

· 6 min read
Yassine El Haddad
Software Developer & Automation Specialist

I build production AI agents, web scrapers, and automation pipelines. Most of what I publish here comes from the actual problems they run into: proxies that get banned, anti-bot stacks that fingerprint your client, RAG that drifts when the underlying data moves. Stack: Python, TypeScript, Go, FastAPI, LangChain, Crawlee, Playwright, deployed on AWS, GCP, and Cloudflare.

Clay (now Mesh) does a lot of the heavy lifting when you connect email, calendar, LinkedIn, and Twitter. What it won’t do on its own is keep polling the open web forever: enrichment tends to reflect what was true when the contact landed in your book, not every headline or title change afterward.

Apify is where scheduled scraping helps — job moves, company news, fresh posts, GitHub activity — then you fold those findings back into Mesh as notes or updates.

Here are three workflows that combine the two without pretending there’s a single “native” button for it.

Why Pair Apify With Clay?

Clay automatically pulls LinkedIn profiles and recent tweets when a contact is added. But over time:

  • People change jobs and Clay may not update their title
  • Companies publish news, funding announcements, or layoffs Clay won't capture
  • Key contacts publish new content (blog posts, talks, open-source work) that's relevant context
  • Founders you know raise new rounds — prime time to reconnect

Apify runs scheduled scrapers on your contact list and outputs fresh signals you can import into Clay as notes or enrichment updates. The result: your contact database stays accurate without you lifting a finger.

Workflow 1: Track Job Changes in Your Network

One of the most valuable signals for relationship management: when someone in your network changes jobs. New jobs mean new needs, new budgets, and new opportunities to reconnect.

Setup:

  1. Export your Clay contact list as a CSV (LinkedIn URLs or company domains)
  2. Upload to Apify and run the LinkedIn Profile Scraper on the list
  3. Compare output against the last known job titles in Clay
  4. For contacts with job changes, create a Clay note: "Changed from X to Y at Company Z — good time to reconnect"

Automate it with Make:

Use Make to run this weekly:

  • Trigger: Apify Dataset updated
  • Filter: current_title != last_known_title
  • Action: Create Clay note with the job change and a reconnect reminder

Frequency: Weekly or monthly — often enough to catch major changes, infrequent enough to avoid noise.

Workflow 2: News Alerts for Key Contacts' Companies

When a company in your network raises funding, announces a product launch, or makes the news — that's a perfect time to reach out. Apify can scrape Google News or TechCrunch for company mentions on a schedule.

Setup:

  1. Export a list of company domains from your Clay database
  2. Run Apify's Google News Scrapers on each domain weekly
  3. Filter results to the last 7 days
  4. Import headlines into Clay as contact notes: "Recent news: [headline]"

This turns your contact database into a living news feed about the people and companies in your network — without any manual monitoring.

Automate it:

Apify Google News Scraper → filter by date → Google Sheets →
Make webhook → Clay note for matching contact

Workflow 3: Enrich Contacts You Met at Events

You met 30 people at a conference. You have their names and companies from a badge scan or follow-up email thread, but limited context on who they are.

Setup:

  1. Create a list of names + companies from the event
  2. Run Apify's LinkedIn Company Scraper to enrich company details
  3. Run the LinkedIn Profile Scraper for individual profiles where you have LinkedIn URLs
  4. Import enriched data into Clay manually or via Google Sheets sync

What you get for each contact:

  • Current role and company details
  • Company size, industry, and recent posts
  • Recent LinkedIn activity (what they're thinking about right now)
  • Shared connections or common ground

This gives you high-quality context before your post-event follow-up — without hours of manual research.

Technical Setup: Apify to Clay Data Flow

Clay does not have a native Apify integration for clay.earth (the personal CRM). The integration pipeline uses intermediate tools:

Option A: Google Sheets bridge

Apify Dataset → Export to Google Sheets → Clay imports from Google Sheets

Simple, no-code. Works well for periodic batch updates.

Option B: Make automation

Apify webhook (run complete) → Make scenario →
Parse dataset → Match to Clay contact by LinkedIn URL or email →
Create Clay note via API or Zapier

More powerful. Enables real-time updates when Apify runs finish.

Option C: Manual CSV

Apify Dataset → Download CSV → Import into Clay manually

Best for one-off enrichment runs without ongoing automation.

Cost Estimate

ComponentToolMonthly cost
Scraping 500 LinkedIn profiles/monthApify Starter~$5–15 of $29/mo credit
Scraping news for 100 companies/monthApify~$2–5 of monthly credit
Automation (Make)Make free/CoreFree up to 1,000 ops
Personal CRMClay / MeshFree–paid

Running this stack at a reasonable personal networking scale costs roughly $29–50/month all-in for Apify + automation. The time saved from manual research and the relationship signal quality makes it worth it for anyone whose work depends on their network.

Getting Started

  1. Sign up for Apify free — $5/month credit, no card required
  2. Set up Clay / Mesh and connect your Gmail and LinkedIn
  3. Export your Clay contacts as a CSV
  4. Run your first LinkedIn enrichment with Apify's LinkedIn Profile Scraper
  5. Import results back into Clay as notes

The full stack — from fresh web signals to updated Clay contact records — takes about an hour to set up and runs automatically from then on. Most people find the first job change alert alone is worth the effort.

Frequently Asked Questions

Not on clay.earth / Mesh. The Apify hook you may have heard about belongs to Clay.com (GTM enrichment). For the personal CRM, route Apify output through Sheets, Make, or CSV, then attach it to contacts as notes or imports.

Yes — Store Actors include profile and company scrapers with rendering and pagination handled for you. Walk through auth and limits in the LinkedIn scraping guide.

Weekly is a sensible default for title changes; go monthly for broad refreshes; run ad hoc before big meetings. More often than that usually burns credits without much new signal.

Clay.com is team GTM software: it pulls from 50+ data providers and includes Apify as an integration. Clay.earth / Mesh is your private rolodex wired to your own inboxes and calendars — bridges, not the same product surface.