Release v1beta1-0.8.1

This release contains an import bug fix for an issue related to application spec update and restart handling. Specifically it contains:

• Fixed a bug related to application spec update and restart handling: #446.
• Added a submission ID used to group resources that belong to the same application run: #446.

Release v1beta1-0.8.0

This release includes the following changes:

• The mutation webhook now gets SparkApplication objects and use their specs to figure out what to mutate to Spark driver and executor Pods. This replaced the original approach of using special annotations to carry needed mutations. This makes it much easier to support future mutations.
• Added support for specifying PodSecurityContext for the driver and/or executor Pods.
• Pinned the Kubernetes dependencies to a specific version instead of a release branch.
• Other bug fixes.

Release v1beta1-0.7.1

This beta release includes the following changes:

• Various bug and documentation fixes.
• Better jsonschema validation.

Release v1beta1-0.7

This is the first beta release of the operator after switching to use the v1beta1 version of the APIs.

Release v1alpha1-0.6

This is an alpha release with the v1alpha1 version of the CRDs. This release includes the following changes:

• Fixes to allow running multiple instances of the operator with each one for a different namespace.
• Support for OpenShift clusters.
• Fixes to make the scheduling logic for ScheduledSparkApplications more robust.
• Other fixes and enhancements.

Release v1alpha1-0.5

This is an alpha release with the v1alpha1 version of the CRDs. This release includes the following changes:

• Upgraded to Spark 2.4.0.
• Major refactoring to the SparkApplication controller logic around application/driver/executor state tracking and management.
• Optional ingress creation for Spark driver UI.
• Basic end-to-end tests.
• Other bug fixes and enhancements.

Release v1alpha1-0.4

This release includes the following list of features and changes:

• Helm Chart for the Spark Operator.
• Support for creating a one-shot SparkApplication from a ScheduledSparkApplication.
• Support for tolerations.
• Upgraded to golang 1.11.
• Bug fixes.

Release v1alpha1-0.3

This is an alpha release with API version v1alpha1 for Spark 2.3.x and up (including the Spark master branch or 2.4.0-SNAPSHOT). It includes the following list of features and changes:

• Support for exposing application-level (exposed and served by the operator) as well as driver and executor metrics to Prometheus.
• Support for automatically uploading local application dependencies to S3 in sparkctl.
• New mutating admission webhook that replaced the old initializer for pod customization.
• Support for using pod affinity/anti-affinity, mounting arbitrary volumes to the driver/executors, using image pull secret (requires a Spark image built from the Spark master).
• PySpark support (requires a Spark image built from the Spark master).
• Documentation enhancements.

Release v1alpha1-0.2 for Spark 2.3.x

This release version works with Spark 2.3.x. Major changes since the last release include the following:

• Native cron support via the ScheduledSparkApplication CRD.
• Bug fixes.
• Documentation enhancements.

Release v1alpha1-0.1 for Spark 2.3.x

This is the first release of the Spark Operator with API version v1alpha1. This release version works with Spark 2.3.x.