yogurt-cultures / kefir Goto Github PK

Hi, thank you for this amazing project.

I want to use simple present tense for the verbs which are returning from morphological analysis without tense tag.

For example: 'gelmek' -> 'gelir', 'gitmek' -> 'gider'

Is there any way to do that with Kefir?

Summary of the project is confusing. Currently it seems to provide only NLG features.

When I try to install kefir I get this error:

Collecting kefir
Using cached https://files.pythonhosted.org/packages/ac/bc/2b33a0657cda729faedefb896b4e1315251dc38387763cf3973ca0b758c7/kefir-0.1.0.tar.gz
Complete output from command python setup.py egg_info:
Traceback (most recent call last):
File "", line 1, in
File "C:\Users\Username\AppData\Local\Temp\pip-install-xf5i6hha\kefir\setup.py", line 37, in
readme = f.read()
File "c:\users\username\appdata\local\programs\python\python36\lib\encodings\cp1254.py", line 23, in decode
return codecs.charmap_decode(input,self.errors,decoding_table)[0]
UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 2554: character maps to

----------------------------------------

Command "python setup.py egg_info" failed with error code 1 in C:\Users\username\AppData\Local\Temp\pip-install-xf5i6hha\kefir\

By using a dictionary you can identify exceptional cases which is not possible by just inspection of the letters.

One possiblity is zemberek: https://github.com/ahmetaa/zemberek-nlp/blob/master/morphology/src/main/resources/tr/master-dictionary.dict

These are the rules: https://github.com/ahmetaa/zemberek-nlp/wiki/Text-Dictionary-Rules

Zemberek has a binary version based on protocol buffers as well for pre processed attributes and fast loading. it should be possible to read it with python directly:
Proto:
https://github.com/ahmetaa/zemberek-nlp/blob/master/morphology/src/main/proto/lexicon.proto

Binary dictionary:
https://github.com/ahmetaa/zemberek-nlp/blob/master/morphology/src/main/resources/tr/lexicon.bin