How is the entity linking F1 calculated? about rng-kbqa HOT 4 CLOSED

[no gt entities] and [no detected entities] -> f1 = 1.0
[no gt entities] and [exists detected entities] -> f1 = 0.0
[exists gt entities] and [no detected entities] -> f1 = 0.0
then it's the standard f1 evaluation in other case.

This evaluation process might be a bit different from the original GRAILQA one (they also reported entity linking performance ), but the differences should be subtle enough.

I can share the script for references in any case. Just shoot me an email if needed.

from rng-kbqa.

I got some little higher results.
Would you please provide a script? Thanks.

from rng-kbqa.

sent

from rng-kbqa.

Received, thanks.

from rng-kbqa.