You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am using Surya on a CPU and really like the quality and speed.
However, the memory usage seems really high. I do not batch requests, it's just single images coming in. Is it normal that memory usage can be around 8-10GB? Is there anyway to reduce it?
I've seen things resolving around batch sizes, but t hink that is only relevant for GPU and when running for multiple images at once or am I mistaken? Thanks!
The text was updated successfully, but these errors were encountered:
stefanknegt
changed the title
Memory usage when running on CPU
Lowering memory usage when running on CPU
Oct 17, 2024
I am using Surya on a CPU and really like the quality and speed.
However, the memory usage seems really high. I do not batch requests, it's just single images coming in. Is it normal that memory usage can be around 8-10GB? Is there anyway to reduce it?
I've seen things resolving around batch sizes, but t hink that is only relevant for GPU and when running for multiple images at once or am I mistaken? Thanks!
The text was updated successfully, but these errors were encountered: