Skip to content

Issues: explodinggradients/ragas

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

306 Open 643 Closed
306 Open 643 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Do the scores for rubric have to be numeric and in a 1-5 range? question Further information is requested
#1800 opened Dec 27, 2024 by alexcpop
What is Different Between LLMContextPrecisionWithoutReference and Faithfulness? question Further information is requested
#1799 opened Dec 27, 2024 by Jimmy-web169
'StringIO' object has no attribute 'TP' bug Something isn't working
#1798 opened Dec 27, 2024 by richness
logprobs to assess the confidence of verdict prediction question Further information is requested
#1797 opened Dec 26, 2024 by Kefan-pauline
I am getting the error "TypeError(ufunc 'invert' not supported for the input types, and the inputs could not be safely coerced to any supported types according to the casting rule ''safe'')" and context_recall as 0 bug Something isn't working question Further information is requested
#1796 opened Dec 26, 2024 by tvsathish
little wrong in this page <https://docs.ragas.io/en/stable/concepts/metrics/overview/#different-types-of-metrics>? documentation Improvements or additions to documentation question Further information is requested
#1793 opened Dec 26, 2024 by earfanfan
1
Is there any demo that is compatible with ragas in langsmith? question Further information is requested
#1791 opened Dec 24, 2024 by pengxin233
How to use RagasEvaluatorChain in the latest version bug Something isn't working question Further information is requested
#1789 opened Dec 24, 2024 by pengxin233
making convert_to_ragas_messages capable of dealing with tool call AIMessages that have List as argument enhancement New feature or request
#1788 opened Dec 23, 2024 by AMMISAIDFaical
How to generate out of context questions to evaluate the hallucination of a LLM question Further information is requested
#1785 opened Dec 23, 2024 by parkerzf
Language Not Supported question Further information is requested
#1783 opened Dec 22, 2024 by yusufsyaifudin
There is some bug,Exception raised in Job[1]: ValidationError(1 validation error for ChatMessage role Input should be a valid string [type=string_type, input_value=None, input_type=NoneType] bug Something isn't working
#1782 opened Dec 21, 2024 by Terran0629
unable to apply transformation: 'headlines' property not found in this node bug Something isn't working module-testsetgen Module testset generation question Further information is requested
#1775 opened Dec 20, 2024 by Z-oo883
Answer correctness not working bug Something isn't working
#1774 opened Dec 19, 2024 by ekaanshkhosla
Factual Correctness F1, Precision and Recall at the same time. enhancement New feature or request
#1772 opened Dec 19, 2024 by Javier-Jimenez99
TypeError: 'float' object is not subscriptable when using answer_correctness metric in evaluate() bug Something isn't working module-metrics this is part of metrics module
#1771 opened Dec 19, 2024 by seroetr
2
KeyError: 0 by following the Get Started "Run ragas metrics for evaluating RAG" bug Something isn't working module-metrics this is part of metrics module
#1770 opened Dec 18, 2024 by parkerzf
1
1
the generated testset is empty bug Something isn't working module-testsetgen Module testset generation question Further information is requested
#1769 opened Dec 18, 2024 by Kevinddddddd
1
Exception raised in Job[1]: AttributeError('str' object has no attribute 'acomplete') bug Something isn't working
#1768 opened Dec 17, 2024 by waadmhj
2
Documentation (Un)stable? documentation Improvements or additions to documentation question Further information is requested
#1767 opened Dec 17, 2024 by tiwarikaran
1
Rubrics criteria scoring does not prompt a score per rubric criterium bug Something isn't working
#1766 opened Dec 17, 2024 by GillesJ
Error in generating test set bug Something isn't working module-testsetgen Module testset generation
#1764 opened Dec 16, 2024 by 13874360430
1
Unable to pass an evaluation criteria to a SimpleCriteriaScore bug Something isn't working
#1763 opened Dec 14, 2024 by vklonin
Version file not found bug Something isn't working
#1761 opened Dec 13, 2024 by ejoly3
Incorrect evaluation results using EvaluatorChain integration bug Something isn't working
#1760 opened Dec 13, 2024 by wriazati
ProTip! Updated in the last three days: updated:>2024-12-24.