Input file to generate_vectors about japanese-words-to-vectors HOT 7 CLOSED

@tringn Thank you! I wrote this code long time ago and it seems that the input of the function is an input that needs not be tokenized but it should have one line per sentence: https://radimrehurek.com/gensim/models/word2vec.html#gensim.models.word2vec.LineSentence

from japanese-words-to-vectors.

from japanese-words-to-vectors.

But I agree there is something I quite dont get it. It should go inside the tokenizer at some point and here it does not. I ll investigate more.

from japanese-words-to-vectors.

You were correct. I updated the code. Tell me if it looks good to you now. b9e47ee

from japanese-words-to-vectors.

I'll close this as it has been solved.

from japanese-words-to-vectors.

Thank you so much.
It is clear now.

from japanese-words-to-vectors.

@tringn Happy I could help! Good luck ;)

from japanese-words-to-vectors.