You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@sazzad16
I have a requirement where I have to use Redis cache for storing event data received from various streams, and fetch these data by scanning the keys and returning the data in JSON format. Data will be stored for a day only, but will be in millions. Request per second will be 3000 for fetching the data, I am using redis server with redis json module only.
I have created a multi-threaded environment to first scan all the keys and then multiple threads will fire JSON.MGET command to fetch the data. But even doing this I am not able to get the latency below <100ms, the scan command is taking more than 1000 ms to fetch all the keys. I am currently doing this simulation on 7000 JSON objects only, but in real-time it will be in millions.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
@sazzad16
I have a requirement where I have to use Redis cache for storing event data received from various streams, and fetch these data by scanning the keys and returning the data in JSON format. Data will be stored for a day only, but will be in millions. Request per second will be 3000 for fetching the data, I am using redis server with redis json module only.
I have created a multi-threaded environment to first scan all the keys and then multiple threads will fire JSON.MGET command to fetch the data. But even doing this I am not able to get the latency below <100ms, the scan command is taking more than 1000 ms to fetch all the keys. I am currently doing this simulation on 7000 JSON objects only, but in real-time it will be in millions.
Below is how my configuration looks like
Beta Was this translation helpful? Give feedback.
All reactions