Why do I get a warning when I use the score function with lang="en" about code-bert-score HOT 3 CLOSED

Hi @higgsbosonprose ,
Thank you for your interest in our work and for your kind words!

I will fix that and let you know. In the meantime, you can run it without rescale_with_baseline=True, and manually rescale the scores using:
(score - 0.7)/(1 - 0.7).

This is what causing the error, not the "en" language. But why are you using "en" ? The language should be the programming language, I.e. "java" / "python" etc.

Best,
Uri

from code-bert-score.

Hey @urialon,
Thanks for your prompt reply. I am working on a project where we are using CodeBERT score as a baseline for evaluating NL explanations of code. I want to get a score of generated explanations with reference to the Ground Truth explanation (also in NL) that is why I use "en" :)

Best,
Saksham

from code-bert-score.

Hi @higgsbosonprose ,
Thanks again for your feedback.

I set a default baseline to 0.5. This is updated in this repo and on pypi, so you can pip install code_bert_score --upgrade

Let us know if you have any more questions or feedback!
Uri

from code-bert-score.