Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluate() function gets unexpected arguments #944

Closed
nelagamy opened this issue May 9, 2024 · 3 comments
Closed

Evaluate() function gets unexpected arguments #944

nelagamy opened this issue May 9, 2024 · 3 comments
Labels
question Further information is requested

Comments

@nelagamy
Copy link

nelagamy commented May 9, 2024

This is the code:
result = evaluate(
amnesty_qa["eval"], metrics=metrics, llm=azure_model, embeddings=azure_embeddings
)
This is the error:
{
"name": "TypeError",
"message": "evaluate() got an unexpected keyword argument 'llm'",
"stack": "---------------------------------------------------------------------------
TypeError Traceback (most recent call last)
Cell In[27], line 1
----> 1 result = evaluate(
2 amnesty_qa["eval"], metrics=metrics, llm=azure_model, embeddings=azure_embeddings
3 )
5 result

TypeError: evaluate() got an unexpected keyword argument 'llm'"
}

@nelagamy nelagamy added the question Further information is requested label May 9, 2024
@KaimingFanshi
Copy link

seems like you are using an old version of ragas. Try upgrade your ragas package [ pip3 install ragas==0.1.7 ] should resolve your problem .

@jjmachan
Copy link
Member

jjmachan commented Jun 1, 2024

thanks to @KaimingFanshi for helping @nelagamy ❤️

@jjmachan jjmachan closed this as completed Jun 1, 2024
@Raushan999
Copy link

seems like you are using an old version of ragas. Try upgrade your ragas package [ pip3 install ragas==0.1.7 ] should resolve your problem .

I'm working on openai==0.28.1, and for that I need ragas<=0.0.18, But ragas is giving the above discussed error. And I can't just upgrade the ragas, since I can only work with lower version of openai.

Any solutions for this....

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

4 participants