You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Oct 17, 2018. It is now read-only.
Currently M3Aggregator uses snapshot based placement to manage its placements, so when users make topology changes, it will schedule a new placement in the future and append to current placement and placement consumer(like collectors) will cut over to the new placement at the right time.
This was designed to address the clock skew issue when there is a large number of collectors, but this data structure added complexity to both placement management and operations, we should look into changing the placement from the current model to the goal state based model, which only contains one placement snapshot and all users(Both M3collectors and M3aggregators) should gracefully/eventually migrate to the goal state. By leveraging shard level cutover and cutoff times, we could still accommodate the clock skew issue among collectors and simplify the logic around placement managements.
This could also enable us to merge the topology tooling between M3aggregator and M3DB, which would greatly simplify the daily operation around M3aggregator placement management.
The text was updated successfully, but these errors were encountered:
Sign up for freeto subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Currently M3Aggregator uses snapshot based placement to manage its placements, so when users make topology changes, it will schedule a new placement in the future and append to current placement and placement consumer(like collectors) will cut over to the new placement at the right time.
This was designed to address the clock skew issue when there is a large number of collectors, but this data structure added complexity to both placement management and operations, we should look into changing the placement from the current model to the goal state based model, which only contains one placement snapshot and all users(Both M3collectors and M3aggregators) should gracefully/eventually migrate to the goal state. By leveraging shard level cutover and cutoff times, we could still accommodate the clock skew issue among collectors and simplify the logic around placement managements.
This could also enable us to merge the topology tooling between M3aggregator and M3DB, which would greatly simplify the daily operation around M3aggregator placement management.
The text was updated successfully, but these errors were encountered: