scores all zeros despite getting >0.3 on kaggle submission about recsys-dataset HOT 3 CLOSED

Hi @yxc8, are you sure you scored the test_sessions.jsonl and not the test.jsonl from Kaggle for your local CV?

from recsys-dataset.

Ah, I see, thanks for pointing this out! I was indeed using the wrong file.

One more thing, the current test still fails because it can't catch the case when prediction doesn't have a certain key. So in evaluate.py, evaluate_session() function, change if 'clicks' in labels and labels['clicks']: to if 'clicks' in labels and labels['clicks'] and 'clicks' in prediction.keys(): and similarly for carts and orders, then the test works without error. Just want to point this out in case someone run into a similar problem.

Anyway thanks for the help Philip!

from recsys-dataset.

Thanks for pointing that out, @yxc8!

from recsys-dataset.