Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for timeZone in Scheduled Spark Jobs #2328

Open
indreshverma opened this issue Nov 20, 2024 · 1 comment
Open

Support for timeZone in Scheduled Spark Jobs #2328

indreshverma opened this issue Nov 20, 2024 · 1 comment

Comments

@indreshverma
Copy link

What question do you want to ask?

I’d like to request the addition of a timeZone option for scheduled Spark jobs in the Spark Operator. Starting with Kubernetes 1.25, the timeZone field is supported in CronJobs, allowing users to specify the timezone for scheduling. However, this feature does not currently appear to be supported in the Spark Operator’s scheduled job configuration.

This omission makes it challenging to manage Spark job schedules in multi-timezone environments. Users have to resort to workarounds, such as adjusting schedules manually or modifying their application logic, which can be error-prone and less intuitive compared to native timezone support.

It would be great if the Spark Operator could include support for timeZone, aligning with Kubernetes’ native CronJob capabilities. This addition would enhance usability and make scheduling Spark jobs more straightforward and consistent with Kubernetes standards.

Looking forward to hearing your thoughts on this! Please let me know.

Additional context

No response

Have the same question?

Give it a 👍 We prioritize the question with most 👍

@jacobsalway
Copy link
Member

Left a comment on the earlier issue #1712 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants