Skip to main content
use-apify.com

Tutorial: guides & tutorials

Hands-on web scraping tutorials covering selectors, headless browsers, anti-bot, and Apify deployment for developers at every skill level.

46 articlesPage 1 of 5

View all tags

Related topics

Claude6 min read

Build a Claude Skill for Web Scraping (Calls Apify Actors) (2026)

· 6 min read
Yassine El Haddad
Software Developer & Automation Specialist
Quick Answer

A Claude Skill is a SKILL.md folder that packages instructions Claude loads automatically when relevant. Build one that tells Claude to run Apify Actors for scraping, and every future "get me this web data" request just works. Or install the official Apify Claude Code plugin, which ships five ready-made skills.

Agent Skills are modular capabilities that extend Claude: each Skill packages instructions, metadata, and optional resources that Claude uses automatically when they are relevant to your request. Instead of re-explaining how you like to scrape every time, you encode it once, and Claude reaches for it on its own.

This guide builds a scraping skill that calls Apify, and points you at the official plugin if you would rather not start from scratch.

Claude6 min read

Scrape Websites into a Spreadsheet with Claude Cowork + Apify (2026)

· 6 min read
Yassine El Haddad
Software Developer & Automation Specialist
Quick Answer

Connect Apify's remote MCP server (https://mcp.apify.com) to Claude Cowork as a custom connector, then ask Cowork in plain language to scrape a site. Cowork picks the right Apify Actor, runs it, and hands you the data to export as a spreadsheet, no code.

Claude Cowork is Anthropic's "hand Claude real work" surface: it runs on the same agentic engine as Claude Code but with no terminal, so it can take on multi-step tasks and finish them for you. Cowork can already search the web and, with computer use, drive a browser a page at a time. What it has no answer for is bulk structured extraction: paginating a result grid, holding a schema across thousands of rows, rotating proxies, and surviving anti-bot defences. That is exactly what Apify adds: a store of pre-built scrapers Cowork can call as tools.

This guide connects the two and turns "get me this web data" into a spreadsheet, with no code.

Create a free Apify account (free monthly credits) →

Review6 min read

How to Scrape Trustpilot Reviews with Apify (2026 Guide)

· 6 min read
Yassine El Haddad
Software Developer & Automation Specialist
Quick Answer

Scrape Trustpilot reviews with an Apify Trustpilot Actor: paste a company's Trustpilot URL (or its domain), set how many reviews and which star ratings you want, run the Actor, and export the ratings, review text, dates, and company replies as JSON or CSV. No coding required.

Trustpilot is where customers rate companies at scale, so its reviews are a goldmine for reputation monitoring, competitor benchmarking, and product research. The site's UI paginates and caps what you can see, and it has no export button, which is exactly the gap a scraper fills.

This guide covers no-code Trustpilot extraction on Apify: which Actor to pick, the input fields that matter, what it costs, and how to turn the review text into insight with an LLM.

Start on Apify (free monthly credits) →

Google Maps7 min read

How to Scrape Google Reviews with Apify (2026 Guide)

· 7 min read
Yassine El Haddad
Software Developer & Automation Specialist
Quick Answer

Scrape Google reviews with Apify's Google Maps Reviews Scraper: paste the business's Google Maps URL, set how many reviews you want, run the Actor, and download review text, ratings, dates, and owner replies as JSON or CSV. No coding required.

Google reviews are one of the richest public signals a business leaves behind: star ratings, written feedback, dates, and the owner's replies. Pulling them at scale lets you monitor reputation, track sentiment over time, and benchmark competitors, none of which the Google Maps UI lets you export.

This guide walks through no-code review extraction with the Apify Google Maps Reviews Scraper (used by more than 48,000 people), the input fields that matter, what it costs, and how to turn the raw text into insight with an LLM.

Start on Apify (free monthly credits) →

Chatbase11 min read

Chatbase API: Integration Guide for Developers

· 11 min read
Achraf Bizyane
Software Engineer

Chatbase ships two REST API versions. API v1 is the original integration path; API v2 is a modern redesign with structured error codes, cursor-based pagination, Server-Sent Events (SSE) streaming, and a cleaner response contract. This guide covers v2 exclusively — it is the forward path for all new integrations in 2026. By the end, you will know how to authenticate, send streaming chat messages, paginate through conversation history, handle rate limits, and feed fresh website content scraped with Apify into your Chatbase knowledge base.

Prerequisites: API v2 requires a Standard plan or above. Free and Hobby accounts cannot use the API. Check the pricing guide to evaluate upgrading.

Wispr Flow11 min read

How Developers Use Wispr Flow to Code and Communicate Faster

· 11 min read
Achraf Bizyane
Software Engineer

Wispr Flow won't write code for you. Say "write a function that fetches JSON from a URL" and it types those words literally — no code generation, no autocomplete. What it does is eliminate the friction of typing everything that surrounds your code: the comments, the commit messages, the PR descriptions, the Slack threads, the documentation, the emails.

For developers, that's a substantial portion of the workday. And dictating it is meaningfully faster than typing it.

This guide covers the practical ways developers use Wispr Flow, how to configure it for a technical workflow, and where it genuinely helps versus where you shouldn't expect it to.


AI11 min read

RAG in Production: From Website Crawl to Vector Search That Actually Works (2026)

· 11 min read
Yassine El Haddad
Software Developer & Automation Specialist

Many RAG (Retrieval-Augmented Generation) projects fail in production not because the technology doesn't work, but because teams skip the hard parts: chunking strategy, embedding model selection, retrieval quality measurement, and stale data management. Validate each step on your own corpus — field names, SDK versions, and Actor outputs change over time.

The pipeline: crawl websites → chunk intelligently → embed → store in vector DB → retrieve with reranking → generate answers with citations.

TL;DR:

StageToolKey decisions
CrawlApify Website Content CrawlerMarkdown output, max depth, content filtering
ChunkLangChain RecursiveCharacterTextSplitter~2000 character chunks, ~200 overlap (~500 tokens/chunk at ~4 chars/token — tune for your content)
EmbedOpenAI text-embedding-3-small or local all-MiniLM-L6-v2Cost vs quality trade-off
StoreQdrant or pgvectorManaged vs self-hosted
RetrieveDense vector search + Cohere rerank (sample below)Top-k=20 candidates, rerank to top-5 — add BM25 / sparse hybrid in Qdrant if you need keyword-heavy queries
GenerateClaude SonnetWith source citations

Prerequisites:

  • Python 3.10+ or Node.js 18+
  • Apify account (sign up)
  • Vector database (Qdrant Cloud free tier or self-hosted)
  • LLM API key (Claude, GPT-4, or self-hosted Ollama)
AI11 min read

Vibe Coding with Claude Code: Build and Ship a SaaS MVP in a Weekend

· 11 min read
Yassine El Haddad
Software Developer & Automation Specialist

Andrej Karpathy coined "vibe coding" in early 2025 — the practice of describing what you want to an AI and letting it generate the code, barely reading the output, and just running it until it works. By April 2026, developers are using Claude Code to go from idea to deployed, revenue-ready SaaS MVP in days, not months.

This guide provides the practical framework: what actually works, what breaks, and the phase-by-phase approach that turns "vibes" into a product people pay for.

TL;DR:

PhaseTimeWhat you ship
1. Spec + CLAUDE.md2 hoursArchitecture decision, tech stack, project structure
2. Core features6–8 hoursAuth, database, API routes, basic UI
3. AI features3–4 hoursApify scraping + LLM processing
4. Testing + deploy2–3 hoursVercel/Railway deployment, domain, SSL
5. Marketing page2 hoursLanding page with value prop and signup
Total15–19 hoursDeployed MVP with AI features

Prerequisites:

  • Claude Code installed with Claude Pro ($20/mo) or Max ($100/mo)
  • GitHub account
  • Vercel account (free tier)
  • Supabase account (free tier)
  • Comfortable reading and editing code (TypeScript/JavaScript), working with CLI tools, and following API documentation. You don't need to write complex algorithms from scratch — Claude Code handles most generation — but you should be able to review and adjust the code it produces.
MCP16 min read

The Complete MCP Server Handbook for Developers (April 2026 Edition)

· 16 min read
Yassine El Haddad
Software Developer & Automation Specialist

The Model Context Protocol (MCP) is the USB-C for AI: a single open standard that connects AI applications to tools, data sources, and workflows. Originated by Anthropic in late 2024 and now an open, community-maintained standard, MCP is supported across a wide range of clients (Claude Desktop and Claude Code, ChatGPT, VS Code, Cursor, and others). The specification covers two transports (local stdio and remote Streamable HTTP, which supersedes the older HTTP+SSE transport), server-side tools, resources, and prompts, and an OAuth 2.1-based authorization flow for remote servers. The public server ecosystem is large and growing fast, spanning official Anthropic servers, vendor servers, and community projects.

If you do not already use Claude, you can try Claude free for a week and follow along with every example in this handbook. The guide covers MCP server development end-to-end, from your first server to production deployment with authentication.

TL;DR:

What you'll learnSection
MCP architecture and how it differs from REST/GraphQL§1–2
Build your first server in TypeScript§3
Build your first server in Python§4
Connect to Claude Desktop and Claude Code§5–6
OAuth 2.1 security and production auth§7
Top 20 production MCP servers§8
MCP for web scraping§9
Enterprise deployment patterns§10

Prerequisites:

  • Node.js 18+ or Python 3.10+
  • Claude Desktop or Claude Code installed
  • Basic understanding of APIs and JSON
Apify6 min read

Best YouTube Transcript Scrapers on Apify (2026)

· 6 min read
Yassine El Haddad
Software Developer & Automation Specialist

Quick answer

The best YouTube transcript scraper on Apify in 2026 is YouTube Transcript Scraper — Captions & AI Fallback. It pulls native captions when YouTube has them, falls back to built-in Whisper AI when it doesn't, and returns a transcript_llm field ready for RAG pipelines — no external API key required. Native transcripts cost $0.001 each.