-
Notifications
You must be signed in to change notification settings - Fork 38
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Compile DataPull using OpenJDK 11+ once Scala becomes compatible #2
Comments
FYI - I attempted this for another Spark application and I eventually gave up on using JDK 11 until we upgrade to Spark 3.0. I got everything to work except for the Hive metastore integration. I finally dug into the Spark code and found a workaround that was added in the 3.0 release: apache/spark@c65f9b2#diff-842e3447fc453de26c706db1cac8f2c4R329. Here’s the related ticket: https://issues.apache.org/jira/browse/SPARK-26839 and PR: apache/spark#24057. |
Is your feature request related to a problem? Please describe.
Although Scala apps can run on JDK 11, per official docs it is recommended that Java 8 be used for compiling Scala code. Per the same documentation, this is expected to happen in June 2019.
Describe the solution you'd like
Upgrade Scala and dependencies to a version that uses OpenJDK 11+.
Describe alternatives you've considered
An alternative is to use Amazon Corretto JDK instead.
Additional context
N/A
The text was updated successfully, but these errors were encountered: