You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently I am testing Airflow on k8s.
gitSync function working fine with local gitlab repo, with external github repo, with or without authentication.
But one parameter works incorrectly - "wait".
As I understand, this is the time in seconds for scheduler, and it will sync DAG with specified repo every N seconds.
I have changed values from 5 to 120, but scheduler still sync DAG with near 4 minutes delay.
Could you help me to find issue of this behavior.
# interval between git sync attempts in seconds
# high values are more likely to cause DAGs to become out of sync between different components
# low values cause more traffic to the remote git repository
wait: 30
containerName: git-sync
uid: 65533
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hello!
Airflow ver: 2.6.2
Chart version: 1.10.0
k8s: 1.23.5
Currently I am testing Airflow on k8s.
gitSync function working fine with local gitlab repo, with external github repo, with or without authentication.
But one parameter works incorrectly - "wait".
As I understand, this is the time in seconds for scheduler, and it will sync DAG with specified repo every N seconds.
I have changed values from 5 to 120, but scheduler still sync DAG with near 4 minutes delay.
Could you help me to find issue of this behavior.
I got it from this instruction:
https://airflow.apache.org/docs/helm-chart/stable/index.html
"wait" refer to _helpers.yaml template.
value: {{ .Values.dags.gitSync.wait | quote }}
https://airflow.apache.org/docs/helm-chart/stable/manage-dags-files.html
"Mounting DAGs using Git-Sync sidecar without Persistence"
--set dags.persistence.enabled=false
--set dags.gitSync.enabled=true
it works in general, but "wait" not change interval of sync in seconds. Always about 4 minutes.
Beta Was this translation helpful? Give feedback.
All reactions