Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

SQuAD 2.0 Electra Large 성능 저하 #1

Open
Se-Hun opened this issue Aug 18, 2021 · 0 comments
Open

SQuAD 2.0 Electra Large 성능 저하 #1

Se-Hun opened this issue Aug 18, 2021 · 0 comments
Labels
bug Something isn't working

Comments

@Se-Hun
Copy link
Owner

Se-Hun commented Aug 18, 2021

SQuAD 2.0 데이터셋에 한해서 Electra 모델 중 Large size의 모델 loss 값이 떨어지지 않는 Issue가 있습니다.
Electra 논문에 적혀있는 대로 Hyper Parameter를 튜닝하고 실험을 수행하였으나, loss 값이 5.90 근처에서 떨어지지 않습니다.
@Se-Hun Se-Hun added the bug Something isn't working label Aug 26, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Se-Hun