-
Notifications
You must be signed in to change notification settings - Fork 251
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Spanproto recall为1.0的情况 #248
Comments
大佬你好~ 请问你是怎么复现的,我怎么没法运行呢?源码是否有问题呀? |
您是怎么实现的呢? |
I found the same problem, hoping the author can answer it. |
应该是分词导致的公共序列问题,导致召回率为一 |
您好!
在运行您提供的脚本后,发现recall一直为1.0的情况,不知是否是下面这行代码的原因(这里将真实标签也拼进去,后面评测的时候泄露了)https://github.com/wjn1996/SpanProto/blob/f1e0acb8672f0bfcbb7c827c48b06b3e8ccb295a/models/span_proto.py#L588
此外,在将此处改成
query_all_spans = query_predict_spans
后,得到的结果和论文中相差较大,不知哪边出了问题。FEW-NERD 5way-1shot: inter—— span_f1:0.5826 class_f1:0.4618 intra——span_f1:0.4606 class_f1:0.3548
The text was updated successfully, but these errors were encountered: