Replies: 3 comments 1 reply
-
This question may be related to this question. #19293 |
Beta Was this translation helpful? Give feedback.
-
This would indicate that the source is falling behind (or, at least, is reading old logs). This can happen for a couple of reasons:
To validate the first one you could look at https://vector.dev/docs/reference/configuration/sources/internal_metrics/#utilization for the components to identify if any are the bottleneck. If none are, then it seems like that the source isn't keeping up in which case you could try tweaking https://vector.dev/docs/reference/configuration/sources/kubernetes_logs/#max_read_bytes to see if you get better performance. |
Beta Was this translation helpful? Give feedback.
-
One other thing that jumps out as a potential issue here is differences between timezones. Do you know if the k8s pod logs will be in the same or different timezone as the Vector process? |
Beta Was this translation helpful? Give feedback.
-
A note for the community
Problem
source: kubernetes_logs
![截屏2023-12-13 18 14 12](https://private-user-images.githubusercontent.com/15256940/290154052-afd3492c-0243-40f6-b74f-17d86db1ec28.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTkxOTI1MDAsIm5iZiI6MTcxOTE5MjIwMCwicGF0aCI6Ii8xNTI1Njk0MC8yOTAxNTQwNTItYWZkMzQ5MmMtMDI0My00MGY2LWI3NGYtMTdkODZkYjFlYzI4LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjQlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI0VDAxMjMyMFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWFjNDM0M2M2ZDcxOWZhM2MzYTI3OWVlYjQyMzQxNzllNzFiZWYyNDgyNzI3Y2FhZDcyM2JjODYwZDg0OTcyNzgmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.jGEoa5ghvA-6wAxlmH2idaSj15DWLt7CfIOMnHeo_yI)
out :kafka
we find lag is very big,I would like to ask, what is the possible reason? thanks
Configuration
Version
0.33.1
Debug Output
No response
Example Data
No response
Additional Context
No response
References
No response
Beta Was this translation helpful? Give feedback.
All reactions