Skip to main content
use-apify.com

AI agents: guides & tutorials

Autonomous agents browse, extract, and act without brittle selectors. Orchestration, guardrails, and Apify-backed tools for dependable scraping.

33 articlesPage 1 of 4

View all tags

AI agents handle web tasks autonomously, browsing and extracting without selectors that break on every redesign. These guides cover orchestration, guardrails, and Apify-backed tools for dependable agent scraping.

The hard part is reliability: agents need bounded actions, retries, and observable runs to be trusted in production. Apify supplies the scraping tools they invoke. Below you will find practical patterns for building robust AI agents.

Related topics

Claude4 min read

Claude Cowork Scheduled Tasks: Web-Data Digests on Autopilot (2026)

· 4 min read
Yassine El Haddad
Software Developer & Automation Specialist
Quick Answer

Claude Cowork can run a task on a schedule (hourly, daily, weekly, or weekdays) and it runs even when your computer is asleep. Pair that with an Apify scraper and you get a recurring web-data digest, a morning price check or a weekly review report, delivered without you doing anything.

Most scraping guides stop at the one-off run. The real leverage is recurring data: the prices, reviews, and listings that change while you are not watching. Cowork's scheduled tasks turn a single scrape into a standing job.

Claude5 min read

Claude Cowork vs Claude Code: Which for Web Data and Automation? (2026)

· 5 min read
Yassine El Haddad
Software Developer & Automation Specialist
Quick Answer

Claude Code and Claude Cowork run on the same engine, but they are built for different people. Use Cowork to delegate knowledge work (research, analysis, reports) with no terminal, and Code to build software in your project. For web data, both can call Apify Actors: pick Cowork to run scrapers and get a spreadsheet, Code to build and automate a data pipeline.

Anthropic ships both Claude Code and Claude Cowork on the same agentic architecture, which confuses a lot of people into thinking they overlap. They do not. The difference is who each is for and where it runs.

Claude6 min read

Scrape Websites into a Spreadsheet with Claude Cowork + Apify (2026)

· 6 min read
Yassine El Haddad
Software Developer & Automation Specialist
Quick Answer

Connect Apify's remote MCP server (https://mcp.apify.com) to Claude Cowork as a custom connector, then ask Cowork in plain language to scrape a site. Cowork picks the right Apify Actor, runs it, and hands you the data to export as a spreadsheet, no code.

Claude Cowork is Anthropic's "hand Claude real work" surface: it runs on the same agentic engine as Claude Code but with no terminal, so it can take on multi-step tasks and finish them for you. Cowork can already search the web and, with computer use, drive a browser a page at a time. What it has no answer for is bulk structured extraction: paginating a result grid, holding a schema across thousands of rows, rotating proxies, and surviving anti-bot defences. That is exactly what Apify adds: a store of pre-built scrapers Cowork can call as tools.

This guide connects the two and turns "get me this web data" into a spreadsheet, with no code.

Create a free Apify account (free monthly credits) →

MCP11 min read

Top 10 MCP Servers for Marketing, Prospecting & Business Growth (2026)

· 11 min read
Yassine El Haddad
Software Developer & Automation Specialist

Model Context Protocol (MCP) servers extend Claude Desktop and Claude Code with live access to external tools: Customer Relationship Management (CRM) data, web scraping, email, spreadsheets, and more. For marketing and sales teams, the right MCP server combination turns Claude into a research assistant, CRM manager, and content producer, all from a chat interface.

This guide covers 10 high-impact MCP servers for non-engineering business functions, with installation instructions and real-world usage examples. If you do not have a Claude account yet, you can try Claude free for a week and set these up the same day.

TL;DR:

#MCP ServerBusiness functionBest for
1ApifyWeb scraping, lead dataMarket research, lead gen, competitive intel
2HubSpotCRM operationsContact management, deal tracking
3Google SheetsReporting, data managementFinancial reports, metrics dashboards
4GmailEmail operationsOutreach, follow-ups, support
5SlackTeam communicationAlerts, summaries, reporting
6Brave SearchWeb searchMarket research, trend analysis
7Google DriveDocument managementContracts, proposals, shared docs
8NotionKnowledge managementWikis, project tracking, meeting notes
9StripePayment operationsRevenue tracking, customer billing
10Google CalendarSchedulingMeeting prep, availability, follow-ups

Prerequisites:

  • Claude Desktop installed (download)
  • MCP works on Claude Free with usage limits; Claude Pro (~$20/mo) raises limits for heavier business use
  • Budget 15+ minutes per server (OAuth / Google Cloud setup often takes longer than API-key-only servers)
AI agents10 min read

The Agentic AI Playbook for SMBs: 5 AI Agents You Can Deploy This Week

· 10 min read
Yassine El Haddad
Software Developer & Automation Specialist

"Agentic AI" is not just for enterprise. In April 2026, small and medium businesses can deploy practical AI agents using no-code tools — agents that qualify leads, answer support questions, schedule content, chase invoices, and monitor inventory.

This playbook covers five agents built with tools you can set up without a developer: Claude, Make.com, n8n, Apify, and Google Sheets. For Model Context Protocol (MCP) setups that connect Claude to your tools (see the "Claude Desktop + MCP" guide in Next steps below), the same agent ideas apply once data and actions are wired in.

TL;DR:

AgentWhat it doesSetup toolTime to deploy
1. Lead QualifierScores inbound leads, routes to sales or nurtureMake.com2 hours
2. Support ResponderDrafts responses to support emailsMake.com / n8n3 hours
3. Content SchedulerResearches and drafts social media postsMake.com2 hours
4. Invoice ChaserSends payment reminders automaticallyMake.com / n8n1.5 hours
5. Inventory MonitorAlerts when stock hits reorder thresholdsn8n + Apify2 hours

Prerequisites:

  • Make.com account (free tier available)
  • Claude: Use Claude API for automation (pay-per-token billing via Anthropic Console — free tier includes limited credits). Claude Pro ($20/mo) is a chat subscription for claude.ai; it does not provide API access for Make.com or n8n HTTP calls.
  • Google account (for Sheets, Gmail)
  • No coding required for agents 1–4
Lead generation10 min read

Automated Lead Generation with AI Agents: Scrape → Enrich → Score → Close (2026 Playbook)

· 10 min read
Yassine El Haddad
Software Developer & Automation Specialist

The key is not just scraping data — it is building a complete pipeline that goes from raw web data to scored, enriched leads in your CRM, automatically.

This playbook covers the architecture, tool-by-tool setup, cost model, and compliance framework for building an AI lead generation system in 2026.

TL;DR:

Pipeline stageToolWhat it does
SourceApify Google Maps, LinkedIn, directory scrapersCollect raw lead data from public sources
EnrichClaude API / Ollama (local)Add company data, tech stack, revenue estimates
ScoreClaude API / OllamaRate leads 1–10 against your Ideal Customer Profile (ICP)
RouteClay, HubSpot, Google SheetsPush scored leads to CRM
Orchestraten8n / Make.comAutomate the entire pipeline on schedule

Prerequisites:

  • Apify account (Starter plan: $19/mo for production use)
  • Claude API key or self-hosted Ollama (see Self-Host AI Stack)
  • CRM account (HubSpot free, Clay, or Google Sheets)
  • n8n or Make.com for orchestration
MCP16 min read

The Complete MCP Server Handbook for Developers (April 2026 Edition)

· 16 min read
Yassine El Haddad
Software Developer & Automation Specialist

The Model Context Protocol (MCP) is the USB-C for AI: a single open standard that connects AI applications to tools, data sources, and workflows. Originated by Anthropic in late 2024 and now an open, community-maintained standard, MCP is supported across a wide range of clients (Claude Desktop and Claude Code, ChatGPT, VS Code, Cursor, and others). The specification covers two transports (local stdio and remote Streamable HTTP, which supersedes the older HTTP+SSE transport), server-side tools, resources, and prompts, and an OAuth 2.1-based authorization flow for remote servers. The public server ecosystem is large and growing fast, spanning official Anthropic servers, vendor servers, and community projects.

If you do not already use Claude, you can try Claude free for a week and follow along with every example in this handbook. The guide covers MCP server development end-to-end, from your first server to production deployment with authentication.

TL;DR:

What you'll learnSection
MCP architecture and how it differs from REST/GraphQL§1–2
Build your first server in TypeScript§3
Build your first server in Python§4
Connect to Claude Desktop and Claude Code§5–6
OAuth 2.1 security and production auth§7
Top 20 production MCP servers§8
MCP for web scraping§9
Enterprise deployment patterns§10

Prerequisites:

  • Node.js 18+ or Python 3.10+
  • Claude Desktop or Claude Code installed
  • Basic understanding of APIs and JSON
Apify7 min read

YouTube Transcripts for LLM and RAG Pipelines (2026)

· 7 min read
Yassine El Haddad
Software Developer & Automation Specialist

The underused RAG corpus​

Most RAG pipelines ingest PDFs, web pages, and documentation. Few teams tap into YouTube — and that is a significant gap. YouTube hosts decades of expert spoken content across every domain: medical lectures, financial analysis, engineering walkthroughs, legal commentary, academic conference talks. This content does not exist as text anywhere else.

AI agents8 min read

GPT-5.4 Native Computer Use: What It Is, How It Benchmarks, and How to Use It (2026)

· 8 min read
Yassine El Haddad
Software Developer & Automation Specialist

GPT-5.4 native computer use (OpenAI, 2026) means the model drives GUIs the way a user would: it reads screen state (e.g. screenshots), issues clicks and keyboard input, and loops until a task completes—paired with a very large API context for long traces. It is not a drop-in replacement for structured web extraction at scale; pair it with scrapers when pages are stable data sources.

Vendor-reported highlights​

OpenAI reports 75% on the OSWorld-Verified benchmark versus a published 72.4% human baseline on that suite, and positions GPT-5.4 as one stack for reasoning, coding, and agentic flows across ChatGPT, the API, and Codex.

At a glance​

  • What it is (vendor framing): GUI-grounded control: perceive screen state, propose actions, loop until done—not a universal substitute for structured data pipelines.
  • Headline benchmark (vendor-reported): 75% OSWorld-Verified vs. 72.4% human baseline on the same benchmark; your internal apps still need their own validation.
  • API scale (vendor-reported): Up to 1M tokens in the API (922K input / 128K output, per OpenAI)—useful for traces, not a reason to skip log compression.
  • Where it usually loses to scraping: High-volume, repeatable HTML/JSON extraction; pair computer use with Apify Actors when the page is a stable data source.

Below: what “native computer use” implies operationally, how benchmarks map to production risk, a straight comparison to scraping, a loop teams actually ship, builder checklists, and compliance guardrails. For the week’s news context, see Top 10 AI and tech stories this week (March 17–24, 2026).

AI agents7 min read

MCP Standard and Ecosystem in 2026: Integration Layer for AI Tools

· 7 min read
Yassine El Haddad
Software Developer & Automation Specialist

Model Context Protocol (MCP) is an open standard for how an AI host (IDE, desktop assistant, or similar) discovers and calls tools in a separate MCP server over transports such as stdio (local) or HTTP (remote). It is a JSON-RPC bridge that standardizes the boundary where models meet APIs, files, and automation. It does not replace your databases or scrapers. The payoff is one reusable integration surface across MCP-capable hosts, provided you still own auth, timeouts, and least privilege.

Below we split what the spec actually defines from what each vendor ships, sketch how the ecosystem shows up in scraping and data workflows, and outline adoption so a chat session does not become root access. For headline news context, see Top 10 AI and tech stories this week (March 17–24, 2026).

Guides on this site

Frequently asked questions

Frequently Asked Questions

An AI agent can autonomously research a list of companies (scraping their sites, LinkedIn, and news), compile findings into a structured report, and flag action items — without step-by-step human instruction. Other real uses: monitoring competitor pricing daily and drafting a summary email, finding and qualifying leads from directories, or crawling job boards and filtering openings by criteria. The agent decides what to fetch, processes results, and acts on them.

The practical path: give the agent a tool that calls an Apify actor (via the Apify MCP server or REST API), define the goal and output format clearly, and set stop conditions. Use LangGraph or CrewAI for orchestration if you need multi-step workflows. Start with a narrow, testable task — e.g. "given a list of 20 company domains, return the CEO name and headquarters city" — before scaling to open-ended research.

Autonomous agents can be 5–20x more expensive than a single-pass LLM extraction because they loop: planning, fetching, reading, re-planning. For bulk data collection, deterministic scrapers are cheaper. Agents shine on tasks where the path is unknown — researching an unfamiliar company, navigating a dynamic site, or resolving ambiguous queries. Limit iteration counts and cache fetched pages to control costs.

LangGraph is popular for stateful, multi-step workflows with clear control flow. CrewAI suits collaborative multi-agent setups. For simpler pipelines, LangChain's agent executor is faster to set up. Apify integrates with all three via the MCP server or REST API, so agents can trigger real scraping jobs rather than simulating browsing with an LLM. Choose the framework your team can debug, not the one with the most features.