14 Commits

Author	SHA1	Message	Date
源文雨	36c17a10b5	fs.File -> io.Reader	2022-12-03 10:54:06 +08:00
源文雨	6982ead703	优化 jieba	2022-11-30 16:00:56 +08:00
源文雨	4d76899e79	优化 tokenizer	2022-11-30 15:39:50 +08:00
源文雨	f3da9e6420	优化 dict, add fs.File 支持	2022-11-30 14:14:48 +08:00
源文雨	d487545eb5	优化 tag_extracker	2022-11-30 13:35:21 +08:00
源文雨	8bbc755ed4	优化	2022-11-30 12:18:15 +08:00
Wang Bin	c48eb5b4a7	added AddWord/DeleteWord/SuggestFrequency functions, this is correpsonding to jieba commit #59aa8b69b1399569ea6b417280c993da703baba8	2015-05-08 11:57:46 +08:00
Wang Bin	3d91f615cf	moved tokenizers to a seperated module	2015-05-07 18:52:29 +08:00
Wang Bin	1a9466927a	move tokenizer.go to top directory	2015-05-04 18:20:35 +08:00
Wang Bin	7cf16072e6	updated all tests to use Fatal/Fatalf to fail tests ealier	2015-03-30 18:01:21 +08:00
Wang Bin	68fed7e250	make struct Jieba's fields private	2015-03-30 16:12:02 +08:00
Wang Bin	c4c3a5f9ad	refactor Cut function, make CutAll a seperate function, to simplify the logic of Cut function	2015-03-30 15:18:36 +08:00
Wang Bin	1c378c28a7	finished all OOP refactor	2015-03-24 18:34:07 +08:00
Wang Bin	16929faf57	removed old tokenize module, updated README	2015-03-18 17:31:41 +08:00