Skip to content

Entry

gojieba

Appears in 5 awesome lists

This is a Go implementation of jieba which a Chinese word splitting algorithm.

Open github.comyanyiwu/gojieba

Found in these lists

Awesome Go

Section: Tokenizers · This is a Go implementation of jieba which a Chinese word splitting algorithm.

FreshScore 98

Awesome Go

Section: 分词器 · star:2616 这是一个Go实现的jieba,这是一个中文分词算法。

FreshScore 93

awesome-nlp

Section: Libraries · Go implementation of the jieba Chinese word segmentation algorithm.

FreshScore 91

go-awesome

Section: 搜索推荐 · "结巴"中文分词的 Go 语言版本

StaleScore 55

awesome-go

Section: Other · "结巴"中文分词的Golang版本

FreshScore 79

transformers

(formerly known as pytorch-transformers and pytorch-pretrained-bert) provides state-of-the-art general-purpose architectures (BERT, GPT-2, RoBERTa, XLM, DistilBert, XLNet, CTRL...) for Natural Language Understanding (NLU) and Natural Language Generation (NLG) with over 32+ pretrained models in…

In 14 listsDetails

Haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search,…

In 13 listsDetails

Awesome NLP with Ruby

A curated list of resources dedicated to Natural Language Processing and text processing for Ruby.

In 5 listsDetails

spaCy

Industrial-strength natural language processing with 75+ languages, transformer pipelines, and production-grade NER, parsing, and text classification.

In 7 listsDetails

HuggingFace Datasets

The largest hub of ready-to-use NLP datasets for ML models with fast, easy-to-use and efficient data manipulation tools.

In 6 listsDetails

Stanza

Stanford NLP Python library for 100+ human languages. State-of-the-art neural pipelines for tokenization, NER, parsing, and sentiment analysis with pre-trained models. Apache 2.0 licensed.

In 5 listsDetails

tokenizers

Hugging Face's tokenizers for modern NLP pipelines (original implementation) with bindings for Python.

In 6 listsDetails

natural

General natural language facilities for node.

In 6 listsDetails