Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[API] experiment with answer #67

Open
AudreyCLEVY opened this issue Dec 20, 2024 · 0 comments
Open

[API] experiment with answer #67

AudreyCLEVY opened this issue Dec 20, 2024 · 0 comments
Assignees
@dtrckd
Milestone
Leaderboard

Comments

@AudreyCLEVY
Copy link
Collaborator

Image
la logique actuelle de création d'un EXPERIMENT quand la réponse est déjà calculé est la suivante :
On charge un nouveau datasets avec la réponse du llm, pourtant le dataset est identique.

PROPOSITION : créer un schema alternatif pour Model qui serait un couple "dataset"-"list de output/answer".
@dtrckd dtrckd changed the title [BACK] experiment with answer [API] experiment with answer Dec 20, 2024
@dtrckd dtrckd added this to the Leaderboard milestone Jan 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@dtrckd dtrckd

Labels
None yet
Projects
None yet
Milestone
Leaderboard
Development

No branches or pull requests
2 participants
@dtrckd @AudreyCLEVY