33 Commits

Author	SHA1	Message	Date
Wang Bin	7cf16072e6	updated all tests to use Fatal/Fatalf to fail tests ealier	2015-03-30 18:01:21 +08:00
Wang Bin	c397cafe8a	uniform the api	2015-03-30 17:52:09 +08:00
Wang Bin	68fed7e250	make struct Jieba's fields private	2015-03-30 16:12:02 +08:00
Wang Bin	0ca4053394	fixed the test failure in textrank	2015-03-30 13:06:44 +08:00
Wang Bin	51c63cb9ad	small refactor the interface, use contructors instead of pointers for entry	2015-03-30 13:00:56 +08:00
Wang Bin	48a0bd390b	fixed a typo in previous commit	2015-03-30 11:13:00 +08:00
Wang Bin	a66bf2a0bd	move dictPath function private	2015-03-30 11:02:57 +08:00
Wang Bin	79adffe328	added a new interface for caching	2015-03-28 15:49:32 +08:00
Wang Bin	59da5b5e3a	removed dict.go, functions move to util.go, also use interface to simplify code	2015-03-25 18:28:37 +08:00
Wang Bin	1c378c28a7	finished all OOP refactor	2015-03-24 18:34:07 +08:00
Wang Bin	16929faf57	removed old tokenize module, updated README	2015-03-18 17:31:41 +08:00
Wang Bin	f596ac063d	added more tests	2015-03-17 16:34:36 +08:00
Wang Bin	a14788addb	fixed a but in tokenizer under search mode, added more tests	2015-03-17 16:29:09 +08:00
Wang Bin	2c95c61d33	added jieba tokenizer for bleve	2015-03-17 15:30:13 +08:00
Wang Bin	8bf9888a1c	make some public variable/function to private	2015-02-28 18:23:59 +08:00
Wang Bin	1c8d4fbf23	make some public variable/function to private	2015-02-28 18:17:48 +08:00
Wang Bin	d06ba85b0b	make some public variable/function to private	2015-02-28 18:08:57 +08:00
Wang Bin	142b90f76a	updated REAMD.md, fixed a small bug in textrank	2015-02-28 14:55:32 +08:00
Wang Bin	c7ac8a7096	small tweak, map stopWords' value are not used, no need to be string	2015-02-27 18:07:23 +08:00
Wang Bin	d76fbfb017	unify Cut method, return channel instead of array	2015-02-27 17:04:50 +08:00
Wang Bin	76b9df8511	change cut method to return a channel string, not []string	2015-02-27 11:37:55 +08:00
Wang Bin	87fe3a19f8	refactor, removed duplicated codes	2015-02-26 18:03:08 +08:00
Wang Bin	dd7e4ec802	refactor, removed duplicated codes	2015-02-26 17:59:34 +08:00
Wang Bin	ed0bc44921	removed third party dependency	2015-02-26 17:45:59 +08:00
Wang Bin	73cb677aca	added test for load cutomized stop words file	2015-02-25 12:04:09 +08:00
Wang Bin	e60dcd3e9e	fixed the bug of textrank, updated tests	2015-02-17 12:04:06 +08:00
Wang Bin	74dbb7d525	added simple implemention of textrank, corresponding to jieba commit #4030d8ed86dd3ff54e215ebe88c141b2a8345eda	2015-02-04 18:23:47 +08:00
Wang Bin	70a8da2687	ExtractTags not return words with weight, instead of words, this is correpsonding to jieba commit #f5ca87e0884ec6f013b4f9c4119aa47d44e090fe	2015-02-04 16:05:23 +08:00
Wang Bin	5e01cf47a3	small refactor, move stopwords to a seperate file	2015-01-26 18:34:19 +08:00
Wang Bin	b828b25f67	fix performance problem of extrag_tags, corresponding to jieba commit #eb98eb92484d3d302cd96049be43c224fe45414a	2015-01-26 18:31:10 +08:00
Wang Bin	2981f336d1	make test more readable	2015-01-26 16:50:45 +08:00
Wang Bin	052c571015	allow user to manually set idf file and stop words file, corresponding to jieba commit 16d626d3477c8649d42094d7d7d4ae7c619783de	2014-08-14 12:05:29 +08:00
Wang Bin	8c785ad36a	initial commit	2013-10-31 18:20:04 +08:00