-
Notifications
You must be signed in to change notification settings - Fork 39
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Prompt refinement #227
Prompt refinement #227
Conversation
Looks potentially positive, but it's very hard to say with prompts. There's not much I can do to review this. How can we objectively know whether it's better? It would be very helpful to see the evidence you have so far @Swiftyos. |
Co-authored-by: Toran Bruce Richards <[email protected]>
…questObject and ResponseObject fields
add to the prisma parser tests the example here |
Converted to draft until I have a good before and after benchmark. @majdyz @ntindle @Torantulino @aarushik93 Please all feel free to commit to this PR any tweaks to the prompts (or target a pr into this one) I will update the benchmark system then try and test if the prompts are improving or not |
For the record: Once this system is ready, we'll go through many iterative rounds of prompt refinement based on what we can measure. |
No description provided.