-
Notifications
You must be signed in to change notification settings - Fork 28
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Write to bigquery using DataframeWriter #63
Labels
Comments
Sorry for the late reply @fbbergamo, It is a good idea, there isnt a specific reason we cant do this, as far as I know its only the redshift connector that uses this, so there isnt really a spark standard to writing a connector I think we did start writing a class but it really didn't go anywhere You can look here and send a pr |
@samelamin thanks, I will work on and let you know. :) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Is there any problem to implement the writing to Bigquery using DataFrameWriter,
What Do you guys think to implement like the redshift lib?
https://github.com/databricks/spark-redshift/blob/master/src/main/scala/com/databricks/spark/redshift/DefaultSource.scala#L68
I want to use the spark like other formats:
This will help to use this library using the same interface that is already build in my project.
Is there any other way to achieve this?
The text was updated successfully, but these errors were encountered: