Skip to content
@apify

Apify

We're making the web more programmable.
README.md

Apify Banner

Apify is the largest ecosystem where developers build, deploy, and publish data extraction and web automation tools. We call them Actors.

discord X/Twitter youtube linkedin

Learn About Apify 🧑‍🎓

  • Find hundreds of ready-made Actors for your web scraping or automation project on Apify Store.
  • Learn everything about web scraping and automation with our free courses that will turn you into an expert scraping developer.
  • Publish your web scrapers as paid Actors on the Apify platform, attract people who need these solutions, and get regular passive income.
  • View our livestreams and video content at the Apify YouTube channel.
  • Learn more through tutorials and thought leadership content about web scraping on Apify Blog and Crawlee Blog.

Repositories 💻

  • Crawlee: A web scraping and browser automation library for Node.js and Python to build reliable scrapers.
  • Apify CLI: Apify command-line interface helps you create, develop, build and run Apify actors, and manage the Apify cloud platform.
  • proxy-chain: Node.js implementation of a proxy server (think Squid) with support for SSL, authentication and upstream proxy chaining.
  • fingerprint-suite: Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.
  • got-scraping: HTTP client made for scraping based on got.
  • 👉Check out our more repositories here.👈

We are hiring! 🕸️

Check out the open positions at Apify and help us make the web more programmable.

Pinned Loading

  1. crawlee-python crawlee-python Public

    Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Wo…

    Python 5.2k 339

  2. crawlee crawlee Public

    Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, an…

    TypeScript 16.6k 738

  3. apify-cli apify-cli Public

    Apify command-line interface helps you create, develop, build and run Apify actors, and manage the Apify cloud platform.

    TypeScript 128 20

  4. proxy-chain proxy-chain Public

    Node.js implementation of a proxy server (think Squid) with support for SSL, authentication and upstream proxy chaining.

    JavaScript 872 147

  5. got-scraping got-scraping Public

    HTTP client made for scraping based on got.

    TypeScript 583 49

  6. fingerprint-suite fingerprint-suite Public

    Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.

    TypeScript 1.2k 119

Repositories

Showing 10 of 139 repositories
  • actors-mcp-client Public

    Model Context Protocol (MCP) Client for Apify's Actors

    apify/actors-mcp-client’s past year of commit activity
    0 0 0 0 Updated Jan 26, 2025
  • apify-docs Public

    This project is the home of Apify's documentation.

    apify/apify-docs’s past year of commit activity
    API Blueprint 31 Apache-2.0 81 77 (2 issues need help) 21 Updated Jan 26, 2025
  • actors-mcp-server Public

    Model Context Protocol (MCP) Server for Apify's Actors

    apify/actors-mcp-server’s past year of commit activity
    TypeScript 2 Apache-2.0 1 0 2 Updated Jan 26, 2025
  • apify-cli Public

    Apify command-line interface helps you create, develop, build and run Apify actors, and manage the Apify cloud platform.

    apify/apify-cli’s past year of commit activity
    TypeScript 128 20 39 (1 issue needs help) 6 Updated Jan 26, 2025
  • impit Public

    impit | rust library for browser impersonation

    apify/impit’s past year of commit activity
    Rust 11 0 1 2 Updated Jan 25, 2025
  • actor-vector-database-integrations Public

    Transfer data from Apify Actors to vector databases (Chroma, Milvus, Pinecone, PostgreSQL (PG-Vector), Qdrant, and Weaviate)

    apify/actor-vector-database-integrations’s past year of commit activity
    Python 5 Apache-2.0 4 2 0 Updated Jan 25, 2025
  • actor-whitepaper-web Public

    Documentation site for the Actor Programming Model – a fresh take on serverless microapps. Built with Astro.

    apify/actor-whitepaper-web’s past year of commit activity
    MDX 1 MIT 0 3 10 Updated Jan 25, 2025
  • apify-shared-js Public

    Utilities and constants shared across Apify projects.

    apify/apify-shared-js’s past year of commit activity
    TypeScript 12 Apache-2.0 11 5 1 Updated Jan 24, 2025
  • apify-eslint-config Public

    Apify ESLint preset to be shared between projects

    apify/apify-eslint-config’s past year of commit activity
    JavaScript 2 Apache-2.0 0 1 1 Updated Jan 24, 2025
  • crawlee-python Public

    Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

    apify/crawlee-python’s past year of commit activity
    Python 5,158 Apache-2.0 339 79 15 Updated Jan 24, 2025
View all repositories