Trafilatura
Python & Command-line tool to gather text and metadata on the Web - Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
Visit Trafilatura →Ratings & Reviews
Related tools
LangChain
Framework for building LLM-powered applications with chains, agents, and memory. Python and JS.
LlamaIndex
Data framework for building LLM applications with RAG, structured data, and agents.
CrewAI
Framework for orchestrating role-playing autonomous AI agents to tackle complex tasks together.
AutoGen
Microsoft's framework for building multi-agent AI applications with conversation patterns.
LangGraph
LangChain's framework for building stateful, multi-actor agent workflows with graphs.
OpenAI Assistants API
OpenAI's API for building AI assistants with tools, code interpreter, and file search.