Comments (2)
I have also found that the calculation of precision@k is incorrect. When trying to find out what was wrong, I noticed that the p@k results were identical to the results I got when calculating the recall@k myself, so I think the implicit library's p@k may be returning the recall@k instead of the precision.
from implicit.
I have also found that the calculation of precision@k is incorrect. When trying to find out what was wrong, I noticed that the p@k results were identical to the results I got when calculating the recall@k myself, so I think the implicit library's p@k may be returning the recall@k instead of the precision.
Its because of fmin(K, likes.size())
. If the average number of interactions per user in the test is lower enough than k, the denominator in line 471 often be the same as in the recall formula, so in this case the result of such precision realization is identical to the recall
from implicit.
Related Issues (20)
- Saving NmsLibModel HOT 1
- numpy has teriminated the `get_info` method HOT 4
- Evaluation module not working HOT 1
- Adding `numpy` to `requirements.txt`
- pip install implicit is not work to use GPU HOT 3
- Incremental update with old users but new items HOT 4
- als explain method bug HOT 1
- Usage of the trained model on testing.
- ranking metrics fail when model trained on CPU but not GPU?; implicit 0.7.2 HOT 1
- Python issue HOT 4
- Is it possible to compare scores across multiple results?
- function get_lastfm() error
- getting index error while using recommend function while ALS algorithm
- What is a good enough Precision@K and MAP@K value?
- BPR results not reproducible using multiple threads
- gpu issue on colab (implicit==0.7.2 / cuda ==12.1) HOT 1
- Early stopping for ALS
- How recommend method works in Nearest Neighbour Models? HOT 3
- Potential bug in calculation of gradient updates for BPR
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from implicit.