Skip to content
/ pyseg Public

Chinese tokenizer implement with C, and package with python. c 语言开发的一款开源的高性能中文分词器,使用流行的mmseg算法实现

License

Notifications You must be signed in to change notification settings

counten/pyseg

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

PySeg

Chinese tokenizer implement with C, and package with python. c 语言开发的一款开源的高性能中文分词器,使用流行的mmseg算法实现。

Build and test

python3 setup.py build_ext --inplace
python3 test.py

Install

python3 setup.py install

TODO

dist to pypi with wheel(can not pack data file till now).

About

  1. contact me [email protected] or www.codeyourlife.cn
  2. The core C implement of this project friso.

About

Chinese tokenizer implement with C, and package with python. c 语言开发的一款开源的高性能中文分词器,使用流行的mmseg算法实现

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages