Comments (3)
两种评估方法的比较参见kdd 20 best paper https://dl.acm.org/doi/10.1145/3394486.3403226
基于负采样的评估是过去算力不足时的一种折中办法,现在已经过时了。关注这点没什么意义。
from qrec.
Hit@K 参见https://github.com/Coder-Yu/SELFRec/blob/main/util/evaluation.py
from qrec.
余老师您好:
Hit Ratio@K 的指标,我按照您给的link和指点,已经在QRec里加上了。模块化的操作,真的很棒!!!
我这才发现,您是把 Self-Supervised Learning的模型,又单独新开源了一个 SELFRec的项目, 像MHCN就也在里面。感谢您的无私分享和付出。
rankingMeasure时,针对某个user,负采样100个或者1000个那个,看了您给的文章,说这样做确实是有偏差的。现在在算力足够的情况下,都是对所有的item进行一个排序,而不是仅仅取 user unrated item。但我现的情况是确实需要对比一下,我在开题里写了,现在没办法改了,MHCN是目前SoRec新技术里的SOTA,我地要跑实验看。我自己尝试后,现在也没改成功,相比只包含一个model的开源项目,您这个信息太丰富了,我对QRec还没有掌握。
我看应该是在这个位置改 https://github.com/Coder-Yu/QRec/blob/master/base/iterativeRecommender.py#L123 但是我发现,只把这个地方的candidates改成当前user unrated 的1000/100个 items时, 会报error。我没找到还要改哪里。
希望您在百忙之中,再给指点得稍微细一点,或者加上这个功能。感谢感谢!!
from qrec.
Related Issues (20)
- measure functions
- Distribution of item representation HOT 3
- there's no ratings code for SimGCL HOT 1
- MemoryError for motif matirx in MHCN. HOT 1
- RSGAN中负样本生成的问题 HOT 1
- 使用GPU HOT 2
- K重交叉验证每一次结果不一样 HOT 2
- About socialmf_tf HOT 2
- DHCF模型 HOT 2
- Problem HOT 1
- NDCG计算 HOT 1
- 数据集问题 HOT 1
- 关于MHCN的性能问题 HOT 1
- 关于ESRF的问题请教 HOT 6
- Visual image rendering HOT 2
- Performance comparison over different item groups HOT 3
- yelp数据集的疑问 HOT 1
- 用相同的数据集训练,设置相同的种子,相同的参数。MHCN在QRec上的表现明显优于SELFRec是什么原因啊 HOT 5
- 关于ESRF代码如何提取出 alternative neighborhood HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from qrec.