chinese-word-segmentation · GitHub Topics

Embedding / Chinese-Word-Vectors

100+ Chinese Word Vectors 上百种预训练中文词向量

中文 chinese-word-segmentation embeddings word-embeddings vectors-trained embedding

Python 11.95 k

1 年前

lancopku / pkuseg-python

pkuseg多领域中文分词工具; The pkuseg toolkit for multi-domain Chinese word segmentation

chinese-word-segmentation

Python 6.6 k

2 年前

baidu / lac

百度NLP：分词，词性标注，命名实体识别，词重要性

word-segmentation part-of-speech-tagger named-entity-recognition chinese-word-segmentation chinese-nlp Parsing Python Java

C++ 3.91 k

4 年前

ownthink / Jiagu

#自然语言处理#Jiagu深度学习自然语言处理工具知识图谱关系抽取中文分词词性标注命名实体识别情感分析新词发现关键词文本摘要文本聚类

自然语言处理 cws pos ner chinese-word-segmentation

Python 3.37 k

3 年前

wolfgarbe / SymSpell

SymSpell: 1 million times faster spelling correction & fuzzy search through Symmetric Delete spelling correction algorithm

翻译 - SymSpell：通过“对称删除”拼写校正算法快一百万倍

levenshtein fuzzy-search approximate-string-matching edit-distance spellcheck spell-check levenshtein-distance damerau-levenshtein spelling fuzzy-matching word-segmentation chinese-text-segmentation chinese-word-segmentation spelling-correction

C# 3.21 k

1 个月前

hankcs / pyhanlp

#自然语言处理#中文分词

hanlp 自然语言处理 chinese-word-segmentation part-of-speech-tagger named-entity-recognition dependency-parser

Python 3.16 k

2 个月前

didi / ChineseNLP

#自然语言处理#Datasets, SOTA results of every fields of Chinese NLP

翻译 - 中国自然语言处理各领域的数据集，SOTA结果

自然语言处理 chinese-nlp machine-translation chinese-word-segmentation Entity resolution question-answering nlp-tasks

HTML 1.8 k

3 年前

lionsoul2014 / jcseg

#自然语言处理#Jcseg is a light weight NLP framework developed with Java. Provide CJK and English segmentation based on MMSEG algorithm, With also keywords extraction, key sentence extraction, summary extraction imp...

Java chinese-word-segmentation 自然语言处理 pos-tagging chinese-text-segmentation chinese-nlp

Java 921

1 年前

mammothb / symspellpy

Python port of SymSpell: 1 million times faster spelling correction & fuzzy search through Symmetric Delete spelling correction algorithm

Python spellcheck spell-check fuzzy-matching fuzzy-search spelling-correction damerau-levenshtein approximate-string-matching levenshtein edit-distance levenshtein-distance spelling word-segmentation chinese-text-segmentation chinese-word-segmentation

Python 821

3 天前

messense / jieba-rs

#自然语言处理#The Jieba Chinese Word Segmentation Implemented in Rust

chinese-word-segmentation jieba 自然语言处理 WebAssembly

Rust 802

16 天前

lionsoul2014 / friso

High performance Chinese tokenizer with both GBK and UTF-8 charset support based on MMSEG algorithm developed by ANSI C. Completely based on modular implementation and can be easily embedded in other...

C Parsing full-text-search chinese-word-segmentation

C 495

1 年前

monpa-team / monpa

#自然语言处理#MONPA 罔拍是一個提供正體中文斷詞、詞性標註以及命名實體辨識的多任務模型

自然语言处理 ner pos named-entity-recognition word-segmentation chinese-word-segmentation pos-tagging bert albert

Python 244

21 天前

Kyubyong / g2pC

g2pC: A Context-aware Grapheme-to-Phoneme Conversion module for Chinese

pinyin crf chinese-nlp chinese-word-segmentation

Python 239

6 年前

hemingkx / WordSeg

A PyTorch implementation of a BiLSTM \ BERT \ Roberta (+ BiLSTM + CRF) model for Chinese Word Segmentation (中文分词) .

bert PyTorch roberta chinese-word-segmentation

Python 207

3 年前

supercoderhawk / DeepLearning_NLP

#自然语言处理#基于深度学习的自然语言处理库

深度学习自然语言处理 chinese-word-segmentation relation-extraction named-entity-recognition Tensorflow

Python 155

6 年前

howl-anderson / MicroTokenizer

一个轻量且功能全面的中文分词器，帮助学生了解分词器的工作原理。MicroTokenizer: A lightweight Chinese tokenizer designed for educational and research purposes. Provides a practical, hands-on approach to understanding NLP concepts, fe...

chinese-nlp Parsing 自然语言处理 chinese-word-segmentation educational-project

Python 148

5 个月前