You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
supports automatic mirroring of super-hot items to multiple processes. This prevents memcached hot spotting where a machine's CPU and/or NIC are overloaded by very popular keys/values.
The readme for groupcache has this as one of the primary benefits. Our usage patterns are such that there will likely be rotating super hot keys as we process various groups of data. We would want to run this in embedded library mode, and there's no guarantee that subsequent requests will hit the same server. Is this something olric can/could support?
The text was updated successfully, but these errors were encountered:
If I understand your case correctly, this feature can be implemented as client-side caching. It is doable but it requires a significant amount of engineering time and should wait for a new release.
Client-side caching is a cool feature, but I don't think it's specifically what I'm talking about here, it's more tied to the ReplicaCount. In our use case, we have a handful of very popular keys, basically a long-tail distribution. What groupcache does is detect which keys those are, and keeps those keys on every member to avoid needing to use the network and hot-spotting the member with those keys.
We currently have handled this by just hardcoding a local Go map that deploys with each service and checking that before hitting olric. It would be nice to have olric handle it by default. The two ways I can see it happening, which could either happen separately or both at the same time:
automatically increase replica count for specific keys based on access patterns
allow for pre-seeding the cache with specific values known to be hot
The readme for groupcache has this as one of the primary benefits. Our usage patterns are such that there will likely be rotating super hot keys as we process various groups of data. We would want to run this in embedded library mode, and there's no guarantee that subsequent requests will hit the same server. Is this something olric can/could support?
The text was updated successfully, but these errors were encountered: