Unsupervised Word Segmentation for Neural Machine Translation and Text Generation
翻译 - 用于神经机器翻译和文本生成的无监督分词
Chinese word segmentation algorithm without corpus(无需语料库的中文分词)
CKIP Neural Chinese Word Segmentation, POS Tagging, and NER
翻译 - CKIP神经汉语分词,POS标记和NER
#自然语言处理#Unsupervised text tokenizer for Neural Network-based text generation.
翻译 - 用于基于神经网络的文本生成的无监督文本标记器。
pkuseg多领域中文分词工具; The pkuseg toolkit for multi-domain Chinese word segmentation
Simple Solution for Multi-Criteria Chinese Word Segmentation
Document Scanner and Word Segmentation
快速中文分词分析word segmentation
Word segmentation library in Rust
English word segmentation, written in pure-Python, and based on a trillion-word corpus.
Source codes and corpora of paper "Iterated Dilated Convolutions for Chinese Word Segmentation"
Chinese Word Segmentation task based on BERT and implemented in Pytorch
Coupling Distant Annotation and Adversarial Training for Cross-Domain Chinese Word Segmentation
Source codes for paper "Neural Networks Incorporating Dictionaries for Chinese Word Segmentation", AAAI 2018
基于结巴分词的 Emacs 中文分词工具
Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashta...