You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Revisit the batch processor settings. With a ingest rate of 10k records/s, writing each second means 10x parts as compared to 100k records write/s. 10k maybe fine but given the space we operate we need to tune it to find the balanced parameter that doesn't OOM the collector but also ensures the number of parts created is not too much. https://clickhouse.com/docs/en/cloud/bestpractices/bulk-inserts
The text was updated successfully, but these errors were encountered:
Revisit the batch processor settings. With a ingest rate of 10k records/s, writing each second means 10x parts as compared to 100k records write/s. 10k maybe fine but given the space we operate we need to tune it to find the balanced parameter that doesn't OOM the collector but also ensures the number of parts created is not too much. https://clickhouse.com/docs/en/cloud/bestpractices/bulk-inserts
The text was updated successfully, but these errors were encountered: