Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Compile DataPull using OpenJDK 11+ once Scala becomes compatible #2

Open
markovarghese opened this issue Apr 29, 2019 · 1 comment
Open

Comments

@markovarghese
Copy link
Collaborator

Is your feature request related to a problem? Please describe.
Although Scala apps can run on JDK 11, per official docs it is recommended that Java 8 be used for compiling Scala code. Per the same documentation, this is expected to happen in June 2019.

Describe the solution you'd like
Upgrade Scala and dependencies to a version that uses OpenJDK 11+.

Describe alternatives you've considered
An alternative is to use Amazon Corretto JDK instead.

Additional context
N/A

@JoshRamynke
Copy link

FYI - I attempted this for another Spark application and I eventually gave up on using JDK 11 until we upgrade to Spark 3.0.

I got everything to work except for the Hive metastore integration. I finally dug into the Spark code and found a workaround that was added in the 3.0 release: apache/spark@c65f9b2#diff-842e3447fc453de26c706db1cac8f2c4R329. Here’s the related ticket: https://issues.apache.org/jira/browse/SPARK-26839 and PR: apache/spark#24057.

markovarghese added a commit that referenced this issue May 25, 2021
Sync from master to fork
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants