95 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Wang Bin	c4c3a5f9ad	refactor Cut function, make CutAll a seperate function, to simplify the logic of Cut function	2015-03-30 15:18:36 +08:00
Wang Bin	556b96b137	removed unused method/property	2015-03-30 14:31:41 +08:00
Wang Bin	328310cfbb	removed all cache load/dump related codes, benchmark shows read from dict file is faster than load from gob file	2015-03-30 14:25:08 +08:00
Wang Bin	0ca4053394	fixed the test failure in textrank	2015-03-30 13:06:44 +08:00
Wang Bin	51c63cb9ad	small refactor the interface, use contructors instead of pointers for entry	2015-03-30 13:00:56 +08:00
Wang Bin	48a0bd390b	fixed a typo in previous commit	2015-03-30 11:13:00 +08:00
Wang Bin	a66bf2a0bd	move dictPath function private	2015-03-30 11:02:57 +08:00
Wang Bin	79adffe328	added a new interface for caching	2015-03-28 15:49:32 +08:00
Wang Bin	e11060513c	merge trie.go into jieba.go	2015-03-28 12:14:11 +08:00
Wang Bin	45c7854fac	finished generilzation of dictionary load	2015-03-28 10:51:00 +08:00
Wang Bin	e155fe5467	refactor to generalize set dictionary function, not finished yet	2015-03-25 18:46:14 +08:00
Wang Bin	59da5b5e3a	removed dict.go, functions move to util.go, also use interface to simplify code	2015-03-25 18:28:37 +08:00
Wang Bin	7fe5e7d4c4	small refactor, replace WordTagFreq with Entry	2015-03-25 17:53:25 +08:00
Wang Bin	800ecaa8c9	small refactor	2015-03-25 16:01:05 +08:00
Wang Bin	8687ca58b8	removed unecessary stateTag struct, using string instead	2015-03-25 15:13:46 +08:00
Wang Bin	1c378c28a7	finished all OOP refactor	2015-03-24 18:34:07 +08:00
Wang Bin	73d87e4ed6	refactor posseg, added Posseg struct	2015-03-24 16:54:02 +08:00
Wang Bin	0027927b6d	code refactor for RegexpSplit function, moved it to util.go, add return chan string	2015-03-24 14:40:06 +08:00
Wang Bin	323b6714fa	removed cache directory, the refactor I made before was not clear	2015-03-24 14:06:10 +08:00
Wang Bin	d257da40a7	try to refactor, not finished yet	2015-03-20 18:38:08 +08:00
Wang Bin	16929faf57	removed old tokenize module, updated README	2015-03-18 17:31:41 +08:00
Wang Bin	f596ac063d	added more tests	2015-03-17 16:34:36 +08:00
Wang Bin	a14788addb	fixed a but in tokenizer under search mode, added more tests	2015-03-17 16:29:09 +08:00
Wang Bin	2c95c61d33	added jieba tokenizer for bleve	2015-03-17 15:30:13 +08:00
Wang Bin	1aabc4a2f3	removed unnecessary MarshalBinary/UnmarshalBinary method	2015-03-16 15:55:41 +08:00
Wang Bin	8bf9888a1c	make some public variable/function to private	2015-02-28 18:23:59 +08:00
Wang Bin	1c8d4fbf23	make some public variable/function to private	2015-02-28 18:17:48 +08:00
Wang Bin	d06ba85b0b	make some public variable/function to private	2015-02-28 18:08:57 +08:00
Wang Bin	a43924173d	make some public variable/function to private	2015-02-28 17:53:08 +08:00
Wang Bin	30b40c34df	make some public variable/function to private	2015-02-28 17:51:03 +08:00
Wang Bin	84bd2e14e2	make some public variable/function to private	2015-02-28 17:43:10 +08:00
Wang Bin	b23dc63eb2	make some public variable/function to private	2015-02-28 17:40:58 +08:00
Wang Bin	2c6a897751	make some public variable/function to private	2015-02-28 17:35:04 +08:00
Wang Bin	db06c66086	make some public variable/function to private	2015-02-28 17:32:40 +08:00
Wang Bin	4b0ddcf666	make some public variable/function to private	2015-02-28 17:27:16 +08:00
Wang Bin	858ceb5a0b	small tweaks, add docs	2015-02-28 17:08:04 +08:00
Wang Bin	142b90f76a	updated REAMD.md, fixed a small bug in textrank	2015-02-28 14:55:32 +08:00
Wang Bin	c7ac8a7096	small tweak, map stopWords' value are not used, no need to be string	2015-02-27 18:07:23 +08:00
Wang Bin	00fae2358d	unify Cut method, return channel instead of array	2015-02-27 17:56:26 +08:00
Wang Bin	43480db509	unify Cut method, return channel instead of array	2015-02-27 17:30:45 +08:00
Wang Bin	c03b3eac1c	unify Cut method, return channel instead of array	2015-02-27 17:15:23 +08:00
Wang Bin	d76fbfb017	unify Cut method, return channel instead of array	2015-02-27 17:04:50 +08:00
Wang Bin	76b9df8511	change cut method to return a channel string, not []string	2015-02-27 11:37:55 +08:00
Wang Bin	87fe3a19f8	refactor, removed duplicated codes	2015-02-26 18:03:08 +08:00
Wang Bin	dd7e4ec802	refactor, removed duplicated codes	2015-02-26 17:59:34 +08:00
Wang Bin	ed0bc44921	removed third party dependency	2015-02-26 17:45:59 +08:00
Wang Bin	f6c298fc65	small refactor for function names	2015-02-26 17:38:26 +08:00
Wang Bin	2bda0be7c5	small refactor, updated REAMDE	2015-02-26 17:27:04 +08:00
Wang Bin	f7fdb9749d	rename GetDAG to DAG	2015-02-26 16:56:18 +08:00
Wang Bin	aa9ad48b1c	refactor variable name	2015-02-26 16:07:08 +08:00