Events dropping when webhook is off #19310
Unanswered
RafaelLobox
asked this question in
Q&A
Replies: 1 comment 1 reply
-
This is unfortunately expected but #10870 is tracking improvements in this area (to have Vector retry more sink request failures). |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi guys!
Lately, my vector instance is having a specific problem that consists of events crashing when I turn off my webhook.
So, when my webhook is disabled, I lose all events.
I'm using the http type in my sink and it's configured to get the path from my webhook. When the webhook is activated, it works fine, but when the webhook is deactivated, all the events coming from my source are discarded.
here is a snippet of my configuration file:
api:
enabled: true
address: xxxxxxxxxxxxxxxxxxxxxx
sources:
siem_webhook:
type: http_server
address: xxxxxxxxxxxxxx
decoding:
codec: json
headers:
- 'content-type: application/json'
method: POST
path: '/webhook'
path_key: path
query_parameters:
- application
response_code: 200
strict_path: true
sinks:
xxxxxx_n8n:
type: http
inputs:
- siem_webhook
compression: none
method: post
uri: XXXXXXXXXXXXXXXXXXXXXXXXXXXXX
encoding:
codec: json
tls:
verify_certificate: false
buffer:
type: memory
max_events: 1000
when_full: block
acknowledgements:
enabled: true
console:
type: console
encoding:
codec: json
inputs:
- siem_webhook
Here are the logs:
2023-11-29T18:08:11.021363Z ERROR sink{component_kind="sink" component_id=xxxxx_n8n component_type=http}:request{request_id=19}: vector::sinks::util::retries: Not retriable; dropping the request. reason="Http status: 404 Not Found" internal_log_rat
e_limit=true
2023-11-29T18:08:11.021406Z ERROR sink{component_kind="sink" component_id=xxxxxxx_n8n component_type=http}:request{request_id=19}: vector_common::internal_event::service: Service call failed. No retries or retries exhausted. error=None request_id=19
error_type="request_failed" stage="sending" internal_log_rate_limit=true
2023-11-29T18:08:11.021446Z ERROR sink{component_kind="sink" component_id=xxxxx_n8n component_type=http}:request{request_id=19}: vector_common::internal_event::component_events_dropped: Events dropped intentional=false count=1 reason="Service call
failed. No retries or retries exhausted." internal_log_rate_limit=true
I'd be very grateful if you could help me find out what's going on!
Beta Was this translation helpful? Give feedback.
All reactions