Apify is a cloud platform for web scraping and data extraction, which provides an ecosystem of more than a thousand ready-made apps called Actors for various scraping, crawling, and extraction use cases.This integration enables you run Actors on the
Apify platform and load their results into LangChain to feed your vector
indexes with documents and data from the web, e.g. to generate answers from websites with documentation,
blogs, or knowledge bases.
Installation and Setup
- Install the LangChain Apify package for Python with:
- Get your Apify API token and either set it as
an environment variable (
APIFY_API_TOKEN) or pass it asapify_api_tokenin the constructor.
Tool
You can use theApifyActorsTool to use Apify Actors with agents.
Wrapper
You can use theApifyWrapper to run Actors on the Apify platform.
Document loader
You can also use ourApifyDatasetLoader to get data from Apify dataset.
Connect these docs programmatically to Claude, VSCode, and more via MCP for real-time answers.