4 Commits

Author	SHA1	Message	Date
Wang Bin	aa9ad48b1c	refactor variable name	2015-02-26 16:07:08 +08:00
Wang Bin	0f7c56b4ef	small code refactor	2015-02-04 14:47:59 +08:00
Wang Bin	9ee7ba2c13	use github.com/deckarep/golang-set instead of Trie, to reduce memory usage and improve performance, this is corresponding to jieba commit #4a93f21918a26083c039970edb9457c589c3a0ab	2015-02-03 15:20:30 +08:00
Wang Bin	0cb70d4890	added tokenize function	2013-11-04 14:28:18 +08:00