linux kernel crash after a lengthy chat

[maxvaneck]

LocalAI version:
latest-aio-cpu docker container
2.22.1 at this time

Environment, CPU architecture, OS, and Version:
Linux Zana 6.1.106-Unraid #1 SMP PREEMPT_DYNAMIC Wed Aug 21 23:36:07 PDT 2024 x86_64 11th Gen Intel(R) Core(TM) i5-11400 @ 2.60GHz GenuineIntel GNU/Linux
64 GB of RAM

Describe the bug
after a while of doing some roleplay chatting with the system prompt set to a character description the linux kernel will simply crash included are the stacktrace pictures i took

To Reproduce
simply load up the webui choose a roleplay model enter a character description as a prompt and keep chatting until crash

Expected behavior
<really? -_-

Logs
i would but my problem prevents this kernel stacktraces are included

Additional context
this problem is so far reproducible on stheno and lewdplay(with the occasional anti horni bonk it's a good roleplay model )
i have also reproduced this problem with big-agi as frontend which seems to increase the likelihood of crashes but the default webui also exhibits this behaviour .

[levidehaan]

have you watched your temps?
sounds like overheating to me.

[maxvaneck]

That was my first thought as well but that would cause a system reset not a full out kernel panic. Besides it's fine with 8 hours of transcoding video so I can reasonably rule out temperature

[maxvaneck]

i also suspected memory errors since i'm using the cpu and llama-cpp is very memory intensive but that passed an 12 hour memcheck so thats fine as well

[jtwolfe]

im thinking mismatch between input and available context length, i used to have a similar fault when i built my 'big-rag' poc

[maxvaneck]

hmm maybe still weird that could cause a kernel crash

[michieal]

just a thought, but, have you tried a different browser? maybe the output caused a buffer overrun in the browser, and it accidentally executed it as code.

[maxvaneck]

could be but the problem occurs on both the default webui en when i use big-agi as a frontend . i use firefox btw