Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

U2Net benchmark comparison #20

Open
roimulia2 opened this issue Jun 9, 2022 · 3 comments
Open

U2Net benchmark comparison #20

roimulia2 opened this issue Jun 9, 2022 · 3 comments

Comments

@roimulia2
Copy link

Hey! Loved the paper.

Have you tried doing a comparison to U2Net? As for now, it's considered the state-of-the-art in SOD. I was wondering if you tested against it.

@Karel911
Copy link
Owner

Hi,

Actually, we did not compare TRACER with the U2Net in our research.
Based on the reported results of U2Net on benchmark datasets, our TRACER outperformed U2Net for the five benchmark dataset (i.e., DUT-TE, DUT-O, HKU-IS, ECSSD, and PASCAL-S).
If you want to know the FPS difference of each model, I recommend measuring FPS under your environment.

@dem-esgal
Copy link

Hi,
I will share my opinion as well. As I saw during my own "in the wild" testing TRACER has some problems with hairs masking. Integrated metrics such as F-measure or MAE cannot reflect this. I'm sharing non-sigmoid final map boys

@roimulia2
Copy link
Author

Hey @dem-esgal, as for overall "objects", do you think it performs better? (if fine details aren't required)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants