Skip to content

Commit

Permalink
Update How_to_use_moderation.ipynb (#1097)
Browse files Browse the repository at this point in the history
  • Loading branch information
teomusatoiu committed Mar 11, 2024
1 parent 1dad5f9 commit bed4110
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/How_to_use_moderation.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -201,7 +201,7 @@
"metadata": {},
"source": [
"#### Setting moderation thresholds\n",
"Our output moderation will assess the LLM's response and block anything scoring a 0.4 or higher in any category. Setting this threshold is a common area for optimization - we recommend building an evaluation set and grading the results using a confusion matrix to set the right tolerance for your moderation. The trade-off here is generally:\n",
"OpenAI has selected thresholds for moderation categories that balance precision and recall for our use cases, but your use case or tolerance for moderation may be different. Setting this threshold is a common area for optimization - we recommend building an evaluation set and grading the results using a confusion matrix to set the right tolerance for your moderation. The trade-off here is generally:\n",
"\n",
"- More false positives leads to a fractured user experience, where customers get annoyed and the assistant seems less helpful.\n",
"- More false negatives can cause lasting harm to your business, as people get the assistant to answer inappropriate questions, or provide inappropriate responses.\n",
Expand Down

0 comments on commit bed4110

Please sign in to comment.