Awesome Data Analysis
Section: Tools · A framework for building web scrapers and crawlers.
Entry
Appears in 5 awesome lists
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Section: Tools · A framework for building web scrapers and crawlers.
Section: Web Parsing (HTML) and Web Crawling · 🕷️ Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python.
Section: 5. Retrieval-Augmented Generation (RAG) & Knowledge · Adaptive web scraping and crawling framework for robust structured extraction from pages to large-scale pipelines.
Section: Scraping and Crawling · 🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Section: Web Scraping · An adaptive scraping framework whose selectors relocate elements after page changes, with stealth fetchers and spiders.
(MIT) provides modules for structured outputs at different levels of abstraction, including output parsers for text completion endpoints, Pydantic programs for mapping prompts to structured outputs using function calling or output parsing, and pre-defined Pydantic programs for specific output types.
Milvus is a cloud-native, open-source vector database built to manage embedding vectors generated by machine learning models and neural networks.
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search,…
Open-source browser agent (Python and TypeScript) whose loop injects serialized DOM state each step, exposes browser actions as registered tools, and runs the same code against a local Chrome or a cloud browser. It has grown from a minimal reference into a full framework (~70k lines of Python…
is a library for efficient similarity search and clustering of dense vectors. It contains algorithms that search in sets of vectors of any size, up to ones that possibly do not fit in RAM. It also contains supporting code for evaluation and parameter tuning. Faiss is written in C++ with complete…
Python tool for converting files and office documents to Markdown. Supports PDF, PowerPoint, Word, Excel, images, audio, HTML, and more with OCR and transcription capabilities. MIT licensed.