Improve Automation Flexibility and Automation Email Format #1016
+142
−75
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Previously it just gave a decision. This was hard to debug during prompt tuning. Asking for reason before decision improves models decision quality.
This tries to decouple the automation query from the chat query. So the chat model doesn't have to know it is running in an automation context or figure how to notify user or send automation response. It just has to respond to the AI generated `query_to_run' corresponding to the `scheduling_request` automation by the user. For example, a `scheduling_request' of `notify me when X happens' results in the automation calling the chat api with a `query_to_run` like `tell me about X` and deciding if to notify based on information gathered about X from the scheduled run. If these two are not decoupled, the chat model may respond with how it can notify about X instead of just asking about it. Swap query_to_run with scheduling_request on the automation web page
Previously we sent the AI response directly. This change post processes the AI response with the awareness that it is to be sent to the user as an email to improve rendering and quality of the emails.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
to_notify_or_notdecider AI