Comments (4)
WeiXiongUST
commented on July 28, 2024
@Haoxiang-Wang hi haoxiang, could you look into this?
from rlhf-reward-modeling.
Haoxiang-Wang
commented on July 28, 2024
Hi @philschmid
For ArmoRM evaluation on RewardBench, I directly pushed an eval code to RewardBench, and you can check out the evaluation command at this PR: allenai/reward-bench#135
from rlhf-reward-modeling.
philschmid
commented on July 28, 2024
Hey thank you for sharing i opened a PR on your model card to make the usage for non expert a bit easier based on your Reward Bench PR, which uses the preference score for the response, aggregated from the multi-objective rewards with the gating layer.
https://huggingface.co/RLHFlow/ArmoRM-Llama3-8B-v0.1/discussions/3
from rlhf-reward-modeling.
Haoxiang-Wang
commented on July 28, 2024
Thank you @philschmid for the new usage demo code!
I just updated the READMEs of our HuggingFace page and this repo (see 15226e9)
from rlhf-reward-modeling.
Related Issues (20)
- how to serve this model? HOT 1
- Cannot run the training script HOT 1
- KeyError: 'input_ids_j' in training HOT 2
- Cannot understant the code at README.md of pair-pm HOT 4
- Does pair-pm supports multi-turn conversation? HOT 2
- How to construct new pairs for adding to the dataset HOT 1
- quesion about the output HOT 1
- can we say PM is better than BT? HOT 2
- Low Safety Score for RM-Gemma-2B Model HOT 2
- How to calculate the avg score of reward bench? HOT 2
- question of chat templates HOT 6
- tutorial to reproduce ArmoRM HOT 1
- environment set up issue HOT 1
- preference_700K dataset's details? HOT 4
- How do you implement SLic on pair_pm model? HOT 1
- Training and evaluating for pair_pm model. HOT 5
- Bradley-Terry model removes lm head while saving HOT 1
- How to finetune ARMO model with custom dataset? HOT 3
- "Token pattern not found in the list" error HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from rlhf-reward-modeling.