Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Redis keys cleaning #116

Open
abhi4578 opened this issue May 16, 2022 · 1 comment
Open

Redis keys cleaning #116

abhi4578 opened this issue May 16, 2022 · 1 comment
Labels
maintainence fixes related to maintainence of iudx systems

Comments

@abhi4578
Copy link
Collaborator

Problem
In resource server, there are some resource items whose unique attribute changes almost at every publication. It can be avoided in some but not in all. This result in amount of data holding in a single redis key to higher value as number of days goes on.
Possible Solution
Delete redis key and recreate it again (why recreate? because latest ingestion pipeline and resource server thinks the key always exists once the key is created on arrival of first packet). This can be done as cron job and with some threshold on no. of entries.
Drawback: Might lose data.

@abhi4578
Copy link
Collaborator Author

As of now it is manually resolved by deleting that key. Could possibly automate, as the no. of similar type of keys may increase.

@abhi4578 abhi4578 added the maintainence fixes related to maintainence of iudx systems label May 18, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
maintainence fixes related to maintainence of iudx systems
Projects
None yet
Development

No branches or pull requests

1 participant