Skip to content

Latest commit

 

History

History
92 lines (85 loc) · 4.04 KB

release-note.md

File metadata and controls

92 lines (85 loc) · 4.04 KB

Next-release

New Feature

Zeta Engine

  • [Script]Add support close engine instance shell
  • [Client]Add Zeta Client ShutdownHook To Cancel Job
  • [Script]Add a jvm.properties file to define the SeaTunnel Zeta JVM Options
  • [Script] Run the server through daemon #4161

Core

  • [Starter][Flink]Support transform-v2 for flink #3396
  • [Flink] Support flink 1.14.x #3963

Transformer

  • [Spark] Support transform-v2 for spark (#3409)
  • [ALL]Add FieldMapper Transform #3781
  • [ALL]Add SQL Transform #4148

Connectors

  • [Elasticsearch] Support https protocol & compatible with opensearch
  • [Elasticsearch] Support DSL
  • [Hbase] Add hbase sink connector #4049
  • [Github] Add Github source connector #4155
  • [CDC] Support export debezium-json format to kafka #4339
  • [GoogleFirestore] Support Google Firestore sink #4304
  • [RocketMQ] Add RocketMQ source and sink connector #4007
  • [Jdbc] Add vertica connector #4303

Formats

  • [Canal]Support read canal format message #3950

Improves

Core

  • [Starter][Spark] Push transform operation from Spark Driver to Executors #4502

Connectors

  • [CDC]Add mysql-cdc source factory #3791
  • [JDBC]Fix the problem that the exception cannot be thrown normally #3796
  • [JDBC]Remove unused options for jdbc source factory #3794
  • [JDBC]Add exactly-once for JDBC source connector #3750
  • [JDBC]Fix JDBC source xa transaction commit failure on pipeline restore #3809
  • [JDBC]Improve option check rule
  • [JDBC]Support SAP HANA. (#3017)
  • [MongoDB]Add source query capability #3697
  • [IoTDB]Unified schema parameter, update IoTDB source fields to schema #3823
  • [InfluxDB]Unifie InfluxDB source fields to schema #3897
  • [File]Fix file source connector option rule bug #3804
  • [File]Add lzo compression way
  • [Kafka]Fix Source failed to parse offset format #3810
  • [Kafka]Fix source the default value of commit_on_checkpoint #3831
  • [Kafka & RabbitMQ & StarRocks & ClickHouse]Change Connector Custom Config Prefix To Map #3719
  • [Common]The log outputs detailed exception stack information #3805
  • [API]Add parallelism and column projection interface #3829
  • [API]Add get source method to all source connector #3846
  • [Hive] Support read user-defined partitions #3842
  • [SelectDB Cloud] Support SelectDB Cloud Sink Connector #3958
  • [File] add file excel sink and source #4164
  • [Hive] Support read text table & Column projection #4105
  • [File] Support column projection #4105
  • [Github] Add github source connector #4155
  • [Jdbc] Add database field to sink config #4199
  • [Doris] Refactor some Doris Sink code as well as support 2pc and cdc #4235
  • [SelectDB Cloud] Refactor some SelectDB Cloud Sink code as well as support copy into batch and async flush and cdc #4312

Zeta Engine

  • [Chore] Remove unnecessary dependencies #3795
  • [Core] Improve job restart of all node down #3784
  • [Checkpoint] Cancel CheckpointCoordinator First Before Cancel Task #3838
  • [Storage] Remove seatunnel-api from engine storage. #3834
  • [Core] change queue to disruptor. #3847
  • [Improve] Statistics server job and system resource usage. #3982

Bug Fixes

Connectors

  • [ClickHouse File] Fix ClickhouseFile Committer Serializable Problems #3803
  • [ClickHouse] Fix clickhouse write cdc changelog update event #3951
  • [ClickHouse] Fix connector source snapshot state NPE #4027
  • [Kudu] Fix connector source snapshot state NPE #4027
  • [Maxcompute] Fix some data type parse fail #3894
  • [Doris] Fix content-length header already present #4277
  • [Iceberg] Fix iceberg source stream mode init error #4638

Zeta Engine

  • [Checkpoint] Fix Checkpoint Continue Trigger After Job CANCELED #3808
  • [Checkpoint] Add savepoint and restore with savepoint #3930
  • [Core]Fix Local Mode can't deserialize split (#3817)
  • [Metrics] Fix Metrics will lose when Job be canceled or restart. #3797 #3977
  • [Restapi] add get running job info by jobId. #4140

Documents

  • [Doc] seatunnel run with flink operator error #3998
  • [Doc] Correct transform sql config on fqa.md #4493

Test

E2E

  • [SqlServer CDC] fix SqlServerCDC IT failure #3807
  • [Container Version] Fix risk of unreproducible test cases #4591