Giter Club home page Giter Club logo

Comments (3)

Coder-Yu avatar Coder-Yu commented on June 21, 2024

两种评估方法的比较参见kdd 20 best paper https://dl.acm.org/doi/10.1145/3394486.3403226

基于负采样的评估是过去算力不足时的一种折中办法,现在已经过时了。关注这点没什么意义。

from qrec.

Coder-Yu avatar Coder-Yu commented on June 21, 2024

Hit@K 参见https://github.com/Coder-Yu/SELFRec/blob/main/util/evaluation.py

from qrec.

jindongli-Ai avatar jindongli-Ai commented on June 21, 2024

余老师您好:
Hit Ratio@K 的指标,我按照您给的link和指点,已经在QRec里加上了。模块化的操作,真的很棒!!!
我这才发现,您是把 Self-Supervised Learning的模型,又单独新开源了一个 SELFRec的项目, 像MHCN就也在里面。感谢您的无私分享和付出。
rankingMeasure时,针对某个user,负采样100个或者1000个那个,看了您给的文章,说这样做确实是有偏差的。现在在算力足够的情况下,都是对所有的item进行一个排序,而不是仅仅取 user unrated item。但我现的情况是确实需要对比一下,我在开题里写了,现在没办法改了,MHCN是目前SoRec新技术里的SOTA,我地要跑实验看。我自己尝试后,现在也没改成功,相比只包含一个model的开源项目,您这个信息太丰富了,我对QRec还没有掌握。
我看应该是在这个位置改 https://github.com/Coder-Yu/QRec/blob/master/base/iterativeRecommender.py#L123 但是我发现,只把这个地方的candidates改成当前user unrated 的1000/100个 items时, 会报error。我没找到还要改哪里。
希望您在百忙之中,再给指点得稍微细一点,或者加上这个功能。感谢感谢!!

from qrec.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.