Skip to content

Entry

gojieba

Appears in 5 awesome lists

This is a Go implementation of jieba which a Chinese word splitting algorithm.

Open github.comyanyiwu/gojieba

Found in these lists

Awesome Go

Section: Tokenizers · This is a Go implementation of jieba which a Chinese word splitting algorithm.

FreshScore 94

Awesome Go

Section: 分词器 · star:2616 这是一个Go实现的jieba,这是一个中文分词算法。

FreshScore 89

awesome-nlp

Section: Libraries · Go implementation of the jieba Chinese word segmentation algorithm.

FreshScore 90

go-awesome

Section: 搜索推荐 · "结巴"中文分词的 Go 语言版本

StaleScore 56

awesome-go

Section: Other · "结巴"中文分词的Golang版本

FreshScore 81

transformers

(formerly known as pytorch-transformers and pytorch-pretrained-bert) provides state-of-the-art general-purpose architectures (BERT, GPT-2, RoBERTa, XLM, DistilBert, XLNet, CTRL...) for Natural Language Understanding (NLU) and Natural Language Generation (NLG) with over 32+ pretrained models in…

In 14 listsDetails

Haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search,…

In 13 listsDetails

Awesome NLP with Ruby

A curated list of resources dedicated to Natural Language Processing and text processing for Ruby.

In 5 listsDetails

spaCy

Industrial-strength natural language processing with 75+ languages, transformer pipelines, and production-grade NER, parsing, and text classification.

In 7 listsDetails

tokenizers

Hugging Face's tokenizers for modern NLP pipelines (original implementation) with bindings for Python.

In 6 listsDetails

natural

General natural language facilities for node.

In 6 listsDetails

TextAttack

Python framework for adversarial attacks, data augmentation, and model training in NLP. Augment datasets to increase model robustness and generate adversarial examples. MIT licensed.

In 6 listsDetails

HuggingFace Datasets

The largest hub of ready-to-use NLP datasets for ML models with fast, easy-to-use and efficient data manipulation tools.

In 6 listsDetails