Support to set ClickHouse insert settings when writing to a table #369
Labels
enhancement
New feature or request
Comments
mahdimalverdi
pushed a commit
to mahdimalverdi/spark-clickhouse-connector
that referenced
this issue
Dec 21, 2024
- Enable custom ClickHouse insert settings when writing to tables. - Add support for `spark.clickhouse.write.settings.*` configuration. - Ensure settings are applied to the `INSERT INTO ... SETTINGS ...` SQL command. - Update documentation to describe usage of write settings. - Add unit tests to validate behavior. Closes ClickHouse#369
mahdimalverdi
pushed a commit
to mahdimalverdi/spark-clickhouse-connector
that referenced
this issue
Dec 21, 2024
- Enable custom ClickHouse insert settings when writing to tables. - Add support for `spark.clickhouse.write.settings` configuration. - Update documentation to describe usage of write settings. Closes ClickHouse#369
mahdimalverdi
pushed a commit
to mahdimalverdi/spark-clickhouse-connector
that referenced
this issue
Dec 21, 2024
This was referenced Dec 21, 2024
mahdimalverdi
added a commit
to mahdimalverdi/spark-clickhouse-connector
that referenced
this issue
Dec 21, 2024
* Update configurtion file (ClickHouse#372) * Support ClickHouse insert settings for table writes (ClickHouse#369) - Enable custom ClickHouse insert settings when writing to tables. - Add support for `spark.clickhouse.write.settings.*` configuration. - Ensure settings are applied to the `INSERT INTO ... SETTINGS ...` SQL command. - Update documentation to describe usage of write settings. - Add unit tests to validate behavior. Closes ClickHouse#369 * Support ClickHouse insert settings for table writes (ClickHouse#369) - Enable custom ClickHouse insert settings when writing to tables. - Add support for `spark.clickhouse.write.settings` configuration. - Update documentation to describe usage of write settings. Closes ClickHouse#369 * reformat the codes Closes ClickHouse#369 --------- Co-authored-by: Mark Zitnik <[email protected]> Co-authored-by: Mahdi Malverdi <[email protected]>
mahdimalverdi
pushed a commit
to mahdimalverdi/spark-clickhouse-connector
that referenced
this issue
Dec 21, 2024
- Enable custom ClickHouse insert settings when writing to tables. - Add support for `spark.clickhouse.write.settings` configuration. - Update documentation to describe usage of write settings. Closes ClickHouse#369
mahdimalverdi
pushed a commit
to mahdimalverdi/spark-clickhouse-connector
that referenced
this issue
Dec 21, 2024
mahdimalverdi
added a commit
to mahdimalverdi/spark-clickhouse-connector
that referenced
this issue
Dec 21, 2024
* Support ClickHouse insert settings for table writes (ClickHouse#369) - Enable custom ClickHouse insert settings when writing to tables. - Add support for `spark.clickhouse.write.settings` configuration. - Update documentation to describe usage of write settings. Closes ClickHouse#369 * reformat the codes Closes ClickHouse#369 --------- Co-authored-by: Mahdi Malverdi <[email protected]>
mahdimalverdi
pushed a commit
to mahdimalverdi/spark-clickhouse-connector
that referenced
this issue
Dec 21, 2024
- Enable custom ClickHouse insert settings when writing to tables. - Add support for `spark.clickhouse.write.settings` configuration. - Update documentation to describe usage of write settings. Closes ClickHouse#369
mahdimalverdi
pushed a commit
to mahdimalverdi/spark-clickhouse-connector
that referenced
this issue
Dec 21, 2024
mahdimalverdi
added a commit
to mahdimalverdi/spark-clickhouse-connector
that referenced
this issue
Dec 21, 2024
* Support ClickHouse insert settings for table writes (ClickHouse#369) - Enable custom ClickHouse insert settings when writing to tables. - Add support for `spark.clickhouse.write.settings` configuration. - Update documentation to describe usage of write settings. Closes ClickHouse#369 * reformat the codes Closes ClickHouse#369 --------- Co-authored-by: Mahdi Malverdi <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
We can add custom settings to ClickHouse SQL when running an insert.
Example:
INSERT INTO [table] SETTINGS [...]Currently, there is no way to achieve this with the spark connector.
Maybe spark-clickhouse-connector can read settings starting with
spark.clickhouse.write.settings. and apply them when write into clickhouse tables.The text was updated successfully, but these errors were encountered: