Skip to content

Entry

Spark NLP

Appears in 4 awesome lists

Spark NLP is a natural language processing library built on top of Apache Spark ML that provides simple, performant & accurate NLP annotations for machine learning pipelines that scale easily in a distributed environment.

Open github.comjohnsnowlabs/spark-nlp

Found in these lists

Awesome Data Analysis

Section: Tools · A state-of-the-art Natural Language Processing library built on Apache Spark.

FreshScore 79

Awesome Machine Learning

Section: Scala · Natural language processing library built on top of Apache Spark ML to provide simple, performant, and accurate NLP annotations for machine learning pipelines, that scale easily in a distributed environment.

FreshScore 93

awesome-nlp

Section: Libraries · Spark NLP is a natural language processing library built on top of Apache Spark ML that provides simple, performant & accurate NLP annotations for machine learning pipelines that scale easily in a distributed environment.

FreshScore 91

Awesome Spark

Section: Natural Language Processing · Natural language processing library built on top of Apache Spark ML.

SlowScore 61

transformers

(formerly known as pytorch-transformers and pytorch-pretrained-bert) provides state-of-the-art general-purpose architectures (BERT, GPT-2, RoBERTa, XLM, DistilBert, XLNet, CTRL...) for Natural Language Understanding (NLU) and Natural Language Generation (NLG) with over 32+ pretrained models in…

In 14 listsDetails

Haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search,…

In 13 listsDetails

Awesome NLP with Ruby

A curated list of resources dedicated to Natural Language Processing and text processing for Ruby.

In 5 listsDetails

spaCy

Industrial-strength natural language processing with 75+ languages, transformer pipelines, and production-grade NER, parsing, and text classification.

In 7 listsDetails

OpenHands

🙌 OpenHands: Code Less, Make More. (formerly OpenDevin), a platform for software development agents powered by AI. github

In 7 listsDetails

HuggingFace Datasets

The largest hub of ready-to-use NLP datasets for ML models with fast, easy-to-use and efficient data manipulation tools.

In 6 listsDetails

Stanza

Stanford NLP Python library for 100+ human languages. State-of-the-art neural pipelines for tokenization, NER, parsing, and sentiment analysis with pre-trained models. Apache 2.0 licensed.

In 5 listsDetails

Gensim

Gensim is a Python library for topic modelling, document indexing and similarity retrieval with large corpora.

In 5 listsDetails