-
Notifications
You must be signed in to change notification settings - Fork 3.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Inject message history through initiate_chat
.
#2671
Comments
In replicantlife, we implemented a log file as the database, but also allowed for in memory store, redis or postgres.
I think this needs more fleshing out before implementing, love the idea! |
I tried some versions of it locally. Based on my exp it seemed that the LLM is sometimes unnecessarily pulling up past context in current q&a even when it's not really needed. What really worked for us (more deterministically) was to add a tool that would fetch last conversations. So the LLM can decide if it needs the last context. |
I would expect something like below
initiate_chat
to take a previous history of context and then be able to use it.While something like this can be achieved using
initiate_chat
'smessage
param which can be a callable, having a native implementation would be helpful. Because in this scenario, it sometimes end up loosing the context, because it also depends on the system prompt of the agent to be able to realise this.In another example from the blog mentioned here, people are replaying the chat in GroupChat and broadcasting it to all other agents. I believe this need can also be eliminated if only the user's query & response are passed onto while initiating group chat
Originally posted by @r4881t in #2437 (comment)
The text was updated successfully, but these errors were encountered: