Updated openai example notebook to use the new generative text task type #2526
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Updated the notebook at
notebooks/responsibleaidashboard/text/responsibleaidashboard-openai-model-debugging.ipynb
to use the new generative text task type.The patched model currently does not output the ground truth answer from the dataset, and instead outputs the string
"This is a dummy prediction"
. This is because the task currently does not support additional text fields to be a part of the test dataset. Once this issue is resolved, the notebook can be further updated to be more illustrative of how the new task type works.