Awesome Data Analysis
Section: Tools · A state-of-the-art Natural Language Processing library built on Apache Spark.
FreshScore 80
Entry
Spark NLP
Appears in 4 awesome lists
Spark NLP is a natural language processing library built on top of Apache Spark ML that provides simple, performant & accurate NLP annotations for machine learning pipelines that scale easily in a distributed environment.
Open github.comjohnsnowlabs/spark-nlp
Found in these lists
Awesome Machine Learning
Section: Scala · Natural language processing library built on top of Apache Spark ML to provide simple, performant, and accurate NLP annotations for machine learning pipelines, that scale easily in a distributed environment.
FreshScore 93
awesome-nlp
Section: Libraries · Spark NLP is a natural language processing library built on top of Apache Spark ML that provides simple, performant & accurate NLP annotations for machine learning pipelines that scale easily in a distributed environment.
FreshScore 90
Awesome Spark
Section: Natural Language Processing · Natural language processing library built on top of Apache Spark ML.
SlowScore 66
Often listed next to it
transformers
(formerly known as pytorch-transformers and pytorch-pretrained-bert) provides state-of-the-art general-purpose architectures (BERT, GPT-2, RoBERTa, XLM, DistilBert, XLNet, CTRL...) for Natural Language Understanding (NLU) and Natural Language Generation (NLG) with over 32+ pretrained models in…
In 14 listsDetails
Haystack
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search,…
In 13 listsDetails
Awesome NLP with Ruby
A curated list of resources dedicated to Natural Language Processing and text processing for Ruby.
In 5 listsDetails
spaCy
Industrial-strength natural language processing with 75+ languages, transformer pipelines, and production-grade NER, parsing, and text classification.
In 7 listsDetails
tokenizers
Hugging Face's tokenizers for modern NLP pipelines (original implementation) with bindings for Python.
In 6 listsDetails
OpenHands
🙌 OpenHands: Code Less, Make More. (formerly OpenDevin), a platform for software development agents powered by AI. github
In 7 listsDetails
Apache Flink
A streaming dataflow engine that provides data distribution, communication, and fault tolerance for distributed computations over data streams.
In 6 listsDetails