ethanrosenthal / datapiques_source Goto Github PK

https://github.com/EthanRosenthal/DataPiques_source/blob/master/content/notebooks/2015-11-02-intro-to-collaborative-filtering.ipynb

The implementation of function "fast_similarity" is pretty nice. According to cosine similarity formula, I found the function "slow_similarity" seems to have an mistake.
"sim[u, uprime] = ratings[u, i] * ratings[uprime, i]" should be "sim[u, uprime] += ratings[u, i] * ratings[uprime, i]"

Hi Ethan

I am trying to install your fork of implicit library but I am not able to install it. Can you please look into this issue.

!git clone https://github.com/EthanRosenthal/implicit.git
%cd implicit
# !ls
!python setup.py install

Here is the error

/usr/local/lib/python3.7/dist-packages/setuptools/dist.py:694: UserWarning: Usage of dash-separated 'description-file' will not be supported in future versions. Please use the underscore name 'description_file' instead
% (opt, underscore_opt))
running install
running bdist_egg
running egg_info
writing implicit.egg-info/PKG-INFO
writing dependency_links to implicit.egg-info/dependency_links.txt
writing requirements to implicit.egg-info/requires.txt
writing top-level names to implicit.egg-info/top_level.txt
reading manifest template 'MANIFEST.in'
adding license file 'LICENSE'
writing manifest file 'implicit.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_py
running build_ext
building 'implicit._implicit' extension
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fdebug-prefix-map=/build/python3.7-OGiuun/python3.7-3.7.10=. -fstack-protector-strong -Wformat -Werror=format-security -g -fdebug-prefix-map=/build/python3.7-OGiuun/python3.7-3.7.10=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.7m -c implicit/_implicit.c -o build/temp.linux-x86_64-3.7/implicit/_implicit.o -Wno-unused-function -O3 -ffast-math -fopenmp -march=native
implicit/_implicit.c: In function ‘__Pyx__ExceptionSave’:
implicit/_implicit.c:18236:21: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_type’; did you mean ‘curexc_type’?
*type = tstate->exc_type;
^~~~~~~~
curexc_type
implicit/_implicit.c:18237:22: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_value’; did you mean ‘curexc_value’?
*value = tstate->exc_value;
^~~~~~~~~
curexc_value
implicit/_implicit.c:18238:19: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_traceback’; did you mean ‘curexc_traceback’?
*tb = tstate->exc_traceback;
^~~~~~~~~~~~~
curexc_traceback
implicit/_implicit.c: In function ‘__Pyx__ExceptionReset’:
implicit/_implicit.c:18245:24: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_type’; did you mean ‘curexc_type’?
tmp_type = tstate->exc_type;
^~~~~~~~
curexc_type
implicit/_implicit.c:18246:25: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_value’; did you mean ‘curexc_value’?
tmp_value = tstate->exc_value;
^~~~~~~~~
curexc_value
implicit/_implicit.c:18247:22: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_traceback’; did you mean ‘curexc_traceback’?
tmp_tb = tstate->exc_traceback;
^~~~~~~~~~~~~
curexc_traceback
implicit/_implicit.c:18248:13: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_type’; did you mean ‘curexc_type’?
tstate->exc_type = type;
^~~~~~~~
curexc_type
implicit/_implicit.c:18249:13: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_value’; did you mean ‘curexc_value’?
tstate->exc_value = value;
^~~~~~~~~
curexc_value
implicit/_implicit.c:18250:13: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_traceback’; did you mean ‘curexc_traceback’?
tstate->exc_traceback = tb;
^~~~~~~~~~~~~
curexc_traceback
implicit/_implicit.c: In function ‘__Pyx__GetException’:
implicit/_implicit.c:18305:24: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_type’; did you mean ‘curexc_type’?
tmp_type = tstate->exc_type;
^~~~~~~~
curexc_type
implicit/_implicit.c:18306:25: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_value’; did you mean ‘curexc_value’?
tmp_value = tstate->exc_value;
^~~~~~~~~
curexc_value
implicit/_implicit.c:18307:22: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_traceback’; did you mean ‘curexc_traceback’?
tmp_tb = tstate->exc_traceback;
^~~~~~~~~~~~~
curexc_traceback
implicit/_implicit.c:18308:13: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_type’; did you mean ‘curexc_type’?
tstate->exc_type = local_type;
^~~~~~~~
curexc_type
implicit/_implicit.c:18309:13: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_value’; did you mean ‘curexc_value’?
tstate->exc_value = local_value;
^~~~~~~~~
curexc_value
implicit/_implicit.c:18310:13: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_traceback’; did you mean ‘curexc_traceback’?
tstate->exc_traceback = local_tb;
^~~~~~~~~~~~~
curexc_traceback
implicit/_implicit.c: In function ‘__Pyx__ExceptionSwap’:
implicit/_implicit.c:18977:24: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_type’; did you mean ‘curexc_type’?
tmp_type = tstate->exc_type;
^~~~~~~~
curexc_type
implicit/_implicit.c:18978:25: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_value’; did you mean ‘curexc_value’?
tmp_value = tstate->exc_value;
^~~~~~~~~
curexc_value
implicit/_implicit.c:18979:22: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_traceback’; did you mean ‘curexc_traceback’?
tmp_tb = tstate->exc_traceback;
^~~~~~~~~~~~~
curexc_traceback
implicit/_implicit.c:18980:13: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_type’; did you mean ‘curexc_type’?
tstate->exc_type = *type;
^~~~~~~~
curexc_type
implicit/_implicit.c:18981:13: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_value’; did you mean ‘curexc_value’?
tstate->exc_value = *value;
^~~~~~~~~
curexc_value
implicit/_implicit.c:18982:13: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_traceback’; did you mean ‘curexc_traceback’?
tstate->exc_traceback = *tb;
^~~~~~~~~~~~~
curexc_traceback
error: command 'x86_64-linux-gnu-gcc' failed with exit status 1

Hello,First of all, great tutorial post. I am referring to the post

Intro to Implicit Matrix Factorization: Classic ALS with Sketchfab Models

Two comments I have.

1. you said that you are using the implicit package, and it seems that in the class AlternatingLeastSquares there is no method predict_for_customers(). Have you created your own version of the ALS class? You mentioned that before getting the item-to-item recommendations.

To get item-to-item recommendations, I made a small method predict_for_items in the ALS class.

Is the predictor_for_user simply: predict_for_customers = model.user_factors.dot(model.item_factors.T)

2. In the function learning_curve(), why do you have this if statement

for epoch in epochs:
    model.iterations = epoch - prev_epoch
    if not hasattr(model, 'user_vectors'):
        model.fit(train)
    else:
        model.fit_partial(train)

Tks.

Hi Ethan,

First of all thank you very much for your posts and notebooks. I rarely come across such detailed rich python recommender tutorials online like yours.

I've been trying to replicate the process in the notebook 2016-10-19-implicit-mf-part-1.ipynb. I can follow pretty much all the contents, except I get stuck at the functions calculate_mse, and precision_at_k. Perhaps when you implemented them, the implicit library had an order version, but now the model.predict_for_customers() does not exist anymore. May I ask what would be a remedy for this? I've thought about using model.recommend() instead, but I'm not too sure how to adjust the training matrix or testing matrix accordingly.

Secondly I discovered that the model.fit() method expects the rating matrix to have items as rows, users as columns. Yet you seem to shape the rating matrix as users as rows, items as columns. Do you think this would be a problem?

Hope to hear from you.

Many thanks