Hitting "array is too big" error when loading a 3.72MB text file with 9K lines about pke HOT 2 CLOSED

Just taking a quick guess here, but did you build your own python 2.7? Or did you pay attention that you downloaded the correct one. The first few warnings look like your python was built with the wrong unicode flags.

I know you're using windows, but on linux you would have to explicitly enable unicode support upon running configure with the --enable-unicode=ucs4 flag. I ran into a similar problem in the past. Don't know how you do that on windows though.

A quick googling for the first few warnings should've told you that already.

from pke.

I confirm what @yannick-c says about unicode.

The ValueError can also be due to the version of Python that you have installed (32bits or 63bits). Here is a similar problem and solution on stackoverflow : https://stackoverflow.com/questions/42727181/valueerror-array-is-too-big-when-loading-googlenews-vectors-negative

from pke.