Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ragas llama_index integration as shown doesn't work for custom LLMs #954

Closed
pliablepixels opened this issue May 14, 2024 · 1 comment
Closed
Labels
question Further information is requested

Comments

@pliablepixels
Copy link

pliablepixels commented May 14, 2024

[X] I checked the documentation and related resources and couldn't find an answer to my question.

Your Question
This document describes how to use Llama index w/OpenAI and Ragas. And [this] shows how we can use a custom LLM but via langchain.

Can you please provide an example of how one can use llama_index without needing LangChain and using a custom LLM ?

Code Examples
I made some progress using"

evaluate (data, metrics, llm=LangchainLLMWrapper(mycustomLLM), embeddings=LangchainEmbeddingsWrapper(my_embedding))

But halfway through eval it compains of unimplemented methods like ragas has no attribute generate_prompt. I'm not sure what needs to be done, and what unimplemented methods may show up in the future.

@pliablepixels pliablepixels added the question Further information is requested label May 14, 2024
@jjmachan
Copy link
Member

jjmachan commented Jun 1, 2024

this should fix this https://docs.ragas.io/en/stable/howtos/integrations/llamaindex.html

extremely sorry about the late response

@jjmachan jjmachan closed this as completed Jun 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants