Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

{Feature Request}: Summarization of previous chat single or multiple AI bots. #1132

Open
SPn00b opened this issue Sep 22, 2024 · 3 comments
Open

Comments

@SPn00b
Copy link

SPn00b commented Sep 22, 2024

Describe the Feature
Summarize previous chats to make space for context while remembering previous important events and actions and leave recent 2-3 responses as is.
example ->https://github.com/kwaroran/RisuAI/wiki/SupaMemory and https://perchance.org/ai-chat#edit

Additional Information:
Edition Windows 11 Pro
Version 23H2
OS build 22631.4169
Experience Windows Feature Experience Pack 1000.22700.1034.0
Processor 12th Gen Intel(R) Core(TM) i3-12100F 3.30 GHz
Installed RAM 16.0 GB (15.9 GB usable)
System type 64-bit operating system, x64-based processor
Pen and touch No pen or touch input is available for this display
GPU: GTX 1050 Ti 4GB
KoboldCpp Version: koboldcpp-1.75.2 on CUDA 12.1 using cuBLAS

Please provide as much relevant information about your setup as possible, such as the Operating System, CPU, GPU, KoboldCpp Version, and relevant logs (helpful to include the launch params from the terminal output, flags and crash logs)

@LostRuins
Copy link
Owner

Have you tried Autogenerate Memory
image

@SPn00b
Copy link
Author

SPn00b commented Sep 22, 2024

Okay anyway to auto trigger it when context limit reaches to just fit one output length or single response before context shifting removes previous tokens? Currently I'm using context shifting.

@LostRuins
Copy link
Owner

Needs to be done manually

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants