Alter table changes not replicated to destination postgres db most of the time. #123

gaganturna · 2020-09-03T11:52:35Z

Describe the bug

Whenever we alter our table at source MySQL, the newly added column is not replicated to PostgreSQL. And we get below error in "sch_chameleon.t_error_log" table : 42703 - column "seg_id" of relation "tbl_abc_xyz" does not exist.

To Reproduce

Assuming that we have replicated MySQL to PostgreSQL. Create table using below:
CREATE TABLE tbl_abc_xyz (
ab1_id int(11) DEFAULT NULL,
ab2_id int(11) NOT NULL AUTO_INCREMENT,
ab3_name varchar(500) DEFAULT NULL,
ab4_ID varchar(64) DEFAULT NULL,
ab5_used varchar(500) DEFAULT NULL,
ab6_Count int(11) DEFAULT NULL,
ab7_Count int(11) DEFAULT NULL,
ab8_count int(11) DEFAULT NULL,
ab9_Time timestamp NULL DEFAULT NULL,
ab10_Time timestamp NULL DEFAULT '0000-00-00 00:00:00',
ab11_time timestamp NULL DEFAULT '0000-00-00 00:00:00',
ab12_Type varchar(64) DEFAULT NULL,
ab13 varchar(64) DEFAULT NULL,
ab14_Type varchar(64) DEFAULT NULL,
ab15_type int(11) DEFAULT NULL,
ab16_time timestamp NOT NULL DEFAULT '0000-00-00 00:00:00',
ab17 timestamp NULL DEFAULT NULL,
ab18_user_id int(11) DEFAULT NULL,
ab19_category varchar(64) DEFAULT NULL,
ab20_path text DEFAULT NULL,
ab21_rate int(11) DEFAULT NULL,
ab22_count int(11) DEFAULT NULL,
ab23_count int(11) DEFAULT NULL,
ab24_name varchar(128) DEFAULT NULL,
ab25_count int(11) DEFAULT NULL,
ab26_path text DEFAULT NULL,
ab27_count int(11) DEFAULT NULL,
ab28_count int(11) DEFAULT NULL,
ab29_path text DEFAULT NULL,
ab30 varchar(64) DEFAULT NULL,
ab31_id varchar(64) DEFAULT NULL,
ab32_name varchar(256) DEFAULT NULL,
ab33_count int(11) DEFAULT NULL,
ab34_file varchar(2000) DEFAULT NULL,
ab35_type int(11) DEFAULT NULL,
ab36_by int(11) DEFAULT NULL,
ab37_file longtext DEFAULT NULL,
ab38_sequence varchar(500) DEFAULT NULL,
ab39 varchar(500) DEFAULT NULL,
ab40_count int(11) DEFAULT NULL,
ab41Flag tinyint(1) DEFAULT NULL,
ab42_path text DEFAULT NULL,
ab43_path text DEFAULT NULL,
ab44_path text DEFAULT NULL,
ab45_path text DEFAULT NULL,
ab46_count bigint(20) DEFAULT NULL,
ab47_number bigint(20) DEFAULT NULL,
ab48_path text DEFAULT NULL,
ab49_count int(11) DEFAULT NULL,
ab50_count int(11) DEFAULT NULL,
ab51_time int(11) DEFAULT NULL,
PRIMARY KEY (ab2_id)
);

And then try to Alter table using below command;
Alter table abc.tbl_abc_xyz add column seg_id int;

Expected behavior

Newly added column does not replicate to PostgreSQL DB always and we found below error in "sch_chameleon.t_error_log" table : 42703 - column "seg_id" of relation "tbl_abc_xyz" does not exist.

Environment:

OS: Cent OS Linux release 7.8.2003
Python: 3.6
MariaDB: 10.3.14(Source)
PostgreSQL: 12.2(Destination)

The text was updated successfully, but these errors were encountered:

the4thdoctor · 2020-09-03T15:41:31Z

Tested in my environment and the column is added correctly.
Can you run chameleon --version please?
Can you also post your pg_chameleon configuration (please remove any sensitive data) and the output of start_replica with the --debug option.
Thanks.

gaganturna · 2020-09-04T05:06:49Z

Hi,

Please find the details:

Chameleon version:
pg-chameleon 2.0.12

chameleon_configuration:

#global settings
pid_dir: '~/.pg_chameleon/pid/'
log_dir: '~/.pg_chameleon/logs/'
log_dest: file
log_level: info
log_days_keep: 10
rollbar_key: ''
rollbar_env: ''

# type_override allows the user to override the default type conversion into a different one.
type_override:
  "tinyint(1)":
    override_to: boolean
    override_tables:
      - "*"

#postgres  destination connection
pg_conn:
  host: "10.0.0.1"
  port: "5432"
  user: "usr_replica"
  password: "password"
  database: "db"
  charset: "utf8"

sources:
  mysql:
    db_conn:
      host: "localhost"
      port: "3306"
      user: "usr_replica"
      password: "password"
      charset: 'utf8'
      connect_timeout: 10
    schema_mappings:
      gui: gui
      MAIL: MAIL
      MO: MO
      BD: BD

    limit_tables:

    skip_tables:

    grant_select_to:
      - usr_readonly
    lock_timeout: "120s"
    my_server_id: 100
    replica_batch_size: 10000
    replay_max_rows: 10000
    batch_retention: '3 day'
    copy_max_memory: "300M"
    copy_mode: 'file'
    out_dir: /tmp
    sleep_loop: 1
    on_error_replay: continue
    on_error_read: continue
    auto_maintenance: "disabled"
    gtid_enable: No
    type: mysql
    skip_events:
      insert:
        - delphis_mediterranea.foo #skips inserts on the table delphis_mediterranea.foo
      delete:
        - delphis_mediterranea #skips deletes on schema delphis_mediterranea
      update:


  pgsql:
  db_conn:
    host: "10.0.0.1"
    port: "5432"
user: "usr_replica"
    password: "password"
    database:  "db"
    charset: 'utf8'
    connect_timeout: 10
    schema_mappings:
      db: gui
      db: MAIL
      db: MO
      db: BD

    limit_tables:

    skip_tables:

    copy_max_memory: "300M"
    grant_select_to:
      - usr_readonly
    lock_timeout: "10s"
    my_server_id: 100
    replica_batch_size: 3000
    replay_max_rows : 10000
    sleep_loop: 5
    batch_retention: '3 day'
    copy_mode: 'file'
    out_dir: /tmp
    type: pgsql

Output of start_replica with debug option (in this option output was printing regularly so have killed it(ctrl +c) ) and started start_replica normally to resume operations.

 (venv) [root@localhost ~]# chameleon start_replica --config default --source mysql --debug
 2020-09-04 10:17:26 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:26 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:26 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:26 MainProcess INFO global_lib.py (605): Checking if the replica for source mysql is stopped
 2020-09-04 10:17:26 MainProcess INFO global_lib.py (615): Cleaning not processed batches for source mysql
 2020-09-04 10:17:26 MainProcess DEBUG pg_lib.py (3198): Cleaning table t_log_replica_mysql_1
 2020-09-04 10:17:26 MainProcess DEBUG pg_lib.py (3198): Cleaning table t_log_replica_mysql_2
 2020-09-04 10:17:27 MainProcess INFO global_lib.py (546): Starting the replica daemons for source mysql
 2020-09-04 10:17:27 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:27 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:27 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:27 replay_replica DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:27 read_replica DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:27 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:27 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552000, 'mysql-bin.000006', 638715252, 't_log_replica_mysql_1', None)]
 2020-09-04 10:17:27 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:27 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638715252. id_batch: 1552000
 2020-09-04 10:17:27 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638715252.
 2020-09-04 10:17:27 read_replica DEBUG mysql_lib.py (1301): writing the last 3 events
 2020-09-04 10:17:27 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:17:27 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_2
 2020-09-04 10:17:27 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:17:27 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:17:27 read_replica DEBUG pg_lib.py (3401): Binlog position:638717188
 2020-09-04 10:17:27 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:17:24
 2020-09-04 10:17:27 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_2
 2020-09-04 10:17:27 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552000 in class variable
 2020-09-04 10:17:27 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552000
 2020-09-04 10:17:27 read_replica DEBUG pg_lib.py (3609): updating batch 1552000 to processed
 2020-09-04 10:17:27 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552000
 2020-09-04 10:17:27 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:27 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:28 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:17:28 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:28 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:28 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:28 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:28 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:28 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552001, 'mysql-bin.000006', 638717188, 't_log_replica_mysql_2', None)]
 2020-09-04 10:17:28 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:28 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638717188. id_batch: 1552001
 2020-09-04 10:17:28 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638717188.
 2020-09-04 10:17:28 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:28 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:29 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:29 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:29 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:29 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:29 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:29 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552001, 'mysql-bin.000006', 638717188, 't_log_replica_mysql_2', None)]
 2020-09-04 10:17:29 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:29 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638717188. id_batch: 1552001
 2020-09-04 10:17:29 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638717188.
 2020-09-04 10:17:29 read_replica DEBUG mysql_lib.py (1301): writing the last 1 events
 2020-09-04 10:17:30 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:17:30 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_1
 2020-09-04 10:17:30 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:17:30 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:17:30 read_replica DEBUG pg_lib.py (3401): Binlog position:638717910
 2020-09-04 10:17:30 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:17:29
 2020-09-04 10:17:30 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_1
 2020-09-04 10:17:30 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552001 in class variable
 2020-09-04 10:17:30 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552001
 2020-09-04 10:17:30 read_replica DEBUG pg_lib.py (3609): updating batch 1552001 to processed
 2020-09-04 10:17:30 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552001
 2020-09-04 10:17:30 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:30 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:30 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:17:30 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:30 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:30 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:31 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:31 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:31 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552002, 'mysql-bin.000006', 638717910, 't_log_replica_mysql_1', None)]
 2020-09-04 10:17:31 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:31 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:31 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:31 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:31 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638717910. id_batch: 1552002
 2020-09-04 10:17:31 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638717910.
 2020-09-04 10:17:31 read_replica DEBUG mysql_lib.py (1301): writing the last 1 events
 2020-09-04 10:17:31 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:17:31 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_2
 2020-09-04 10:17:31 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:17:31 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:17:31 read_replica DEBUG pg_lib.py (3401): Binlog position:638718517
 2020-09-04 10:17:31 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:17:31
 2020-09-04 10:17:31 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_2
 2020-09-04 10:17:31 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552002 in class variable
 2020-09-04 10:17:31 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552002
 2020-09-04 10:17:31 read_replica DEBUG pg_lib.py (3609): updating batch 1552002 to processed
 2020-09-04 10:17:31 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552002
 2020-09-04 10:17:31 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:31 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:32 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:17:32 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:32 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:32 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:32 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:32 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:32 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552003, 'mysql-bin.000006', 638718517, 't_log_replica_mysql_2', None)]
 2020-09-04 10:17:32 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:32 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638718517. id_batch: 1552003
 2020-09-04 10:17:32 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638718517.
 2020-09-04 10:17:32 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:32 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:33 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:33 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:33 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:33 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:33 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:33 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552003, 'mysql-bin.000006', 638718517, 't_log_replica_mysql_2', None)]
 2020-09-04 10:17:33 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:34 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638718517. id_batch: 1552003
 2020-09-04 10:17:34 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638718517.
 2020-09-04 10:17:34 read_replica DEBUG mysql_lib.py (1301): writing the last 1 events
 2020-09-04 10:17:34 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:17:34 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_1
 2020-09-04 10:17:34 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:17:34 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:17:34 read_replica DEBUG pg_lib.py (3401): Binlog position:638719124
 2020-09-04 10:17:34 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:17:32
 2020-09-04 10:17:34 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_1
 2020-09-04 10:17:34 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552003 in class variable
 2020-09-04 10:17:34 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552003
 2020-09-04 10:17:34 read_replica DEBUG pg_lib.py (3609): updating batch 1552003 to processed
 2020-09-04 10:17:34 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552003
 2020-09-04 10:17:34 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:34 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:34 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:17:34 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:34 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:34 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:35 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:35 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:35 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552004, 'mysql-bin.000006', 638719124, 't_log_replica_mysql_1', None)]
 2020-09-04 10:17:35 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:35 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638719124. id_batch: 1552004
 2020-09-04 10:17:35 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638719124.
 2020-09-04 10:17:35 read_replica DEBUG mysql_lib.py (1301): writing the last 1 events
 2020-09-04 10:17:35 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:17:35 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_2
 2020-09-04 10:17:35 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:17:35 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:17:35 read_replica DEBUG pg_lib.py (3401): Binlog position:638719846
 2020-09-04 10:17:35 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:17:34
 2020-09-04 10:17:35 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_2
 2020-09-04 10:17:35 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552004 in class variable
 2020-09-04 10:17:35 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552004
 2020-09-04 10:17:35 read_replica DEBUG pg_lib.py (3609): updating batch 1552004 to processed
 2020-09-04 10:17:35 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552004
 2020-09-04 10:17:35 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:35 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:35 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:35 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:35 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:36 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:17:36 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:36 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:36 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552005, 'mysql-bin.000006', 638719846, 't_log_replica_mysql_2', None)]
 2020-09-04 10:17:36 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:36 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:36 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:36 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:36 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638719846. id_batch: 1552005
 2020-09-04 10:17:36 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638719846.
 2020-09-04 10:17:36 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:36 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:37 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:37 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:37 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:37 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:37 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:37 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552005, 'mysql-bin.000006', 638719846, 't_log_replica_mysql_2', None)]
 2020-09-04 10:17:37 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:38 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638719846. id_batch: 1552005
 2020-09-04 10:17:38 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638719846.
 2020-09-04 10:17:38 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:38 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:38 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:38 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:38 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:39 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:39 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:39 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552005, 'mysql-bin.000006', 638719846, 't_log_replica_mysql_2', None)]
 2020-09-04 10:17:39 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:39 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638719846. id_batch: 1552005
 2020-09-04 10:17:39 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638719846.
 2020-09-04 10:17:39 read_replica DEBUG mysql_lib.py (1301): writing the last 1 events
 2020-09-04 10:17:39 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:17:39 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_1
 2020-09-04 10:17:39 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:17:39 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:17:39 read_replica DEBUG pg_lib.py (3401): Binlog position:638720453
 2020-09-04 10:17:39 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:17:39
 2020-09-04 10:17:39 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_1
 2020-09-04 10:17:39 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552005 in class variable
 2020-09-04 10:17:39 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552005
 2020-09-04 10:17:39 read_replica DEBUG pg_lib.py (3609): updating batch 1552005 to processed
 2020-09-04 10:17:39 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552005
 2020-09-04 10:17:39 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:39 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:39 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:39 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:39 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:40 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:17:40 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:40 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:40 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552006, 'mysql-bin.000006', 638720453, 't_log_replica_mysql_1', None)]
 2020-09-04 10:17:40 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:40 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638720453. id_batch: 1552006
 2020-09-04 10:17:40 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638720453.
 2020-09-04 10:17:40 read_replica DEBUG mysql_lib.py (1301): writing the last 1 events
 2020-09-04 10:17:40 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:17:40 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_2
 2020-09-04 10:17:40 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:17:40 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:17:40 read_replica DEBUG pg_lib.py (3401): Binlog position:638721175
 2020-09-04 10:17:40 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:17:39
 2020-09-04 10:17:40 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_2
 2020-09-04 10:17:40 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552006 in class variable
 2020-09-04 10:17:40 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552006
 2020-09-04 10:17:40 read_replica DEBUG pg_lib.py (3609): updating batch 1552006 to processed
 2020-09-04 10:17:40 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552006
 2020-09-04 10:17:40 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:40 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:40 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:40 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:40 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:41 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:17:41 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:41 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:41 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552007, 'mysql-bin.000006', 638721175, 't_log_replica_mysql_2', None)]
 2020-09-04 10:17:41 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:41 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:41 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:41 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:42 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638721175. id_batch: 1552007
 2020-09-04 10:17:42 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638721175.
 2020-09-04 10:17:42 read_replica DEBUG mysql_lib.py (1301): writing the last 1 events
 2020-09-04 10:17:42 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:17:42 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_1
 2020-09-04 10:17:42 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:17:42 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:17:42 read_replica DEBUG pg_lib.py (3401): Binlog position:638721782
 2020-09-04 10:17:42 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:17:40
 2020-09-04 10:17:42 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_1
 2020-09-04 10:17:42 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552007 in class variable
 2020-09-04 10:17:42 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552007
 2020-09-04 10:17:42 read_replica DEBUG pg_lib.py (3609): updating batch 1552007 to processed
 2020-09-04 10:17:42 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552007
 2020-09-04 10:17:42 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:42 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:42 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:17:43 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:43 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:43 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:43 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:43 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:43 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552008, 'mysql-bin.000006', 638721782, 't_log_replica_mysql_1', None)]
 2020-09-04 10:17:43 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:43 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638721782. id_batch: 1552008
 2020-09-04 10:17:43 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638721782.
 2020-09-04 10:17:43 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:43 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:44 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:44 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:44 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:44 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:44 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:44 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552008, 'mysql-bin.000006', 638721782, 't_log_replica_mysql_1', None)]
 2020-09-04 10:17:44 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:44 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638721782. id_batch: 1552008
 2020-09-04 10:17:44 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638721782.
 2020-09-04 10:17:44 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:44 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:45 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:45 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:45 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:45 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:45 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:45 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552008, 'mysql-bin.000006', 638721782, 't_log_replica_mysql_1', None)]
 2020-09-04 10:17:45 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:45 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638721782. id_batch: 1552008
 2020-09-04 10:17:46 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638721782.
 2020-09-04 10:17:46 read_replica DEBUG mysql_lib.py (1301): writing the last 1 events
 2020-09-04 10:17:46 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:17:46 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_2
 2020-09-04 10:17:46 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:17:46 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:17:46 read_replica DEBUG pg_lib.py (3401): Binlog position:638722504
 2020-09-04 10:17:46 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:17:44
 2020-09-04 10:17:46 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_2
 2020-09-04 10:17:46 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552008 in class variable
 2020-09-04 10:17:46 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552008
 2020-09-04 10:17:46 read_replica DEBUG pg_lib.py (3609): updating batch 1552008 to processed
 2020-09-04 10:17:46 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552008
 2020-09-04 10:17:46 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:46 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:46 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:46 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:46 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:46 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:17:47 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:47 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:47 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552009, 'mysql-bin.000006', 638722504, 't_log_replica_mysql_2', None)]
 2020-09-04 10:17:47 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:47 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:47 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:47 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:47 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638722504. id_batch: 1552009
 2020-09-04 10:17:47 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638722504.
 2020-09-04 10:17:47 read_replica DEBUG mysql_lib.py (1301): writing the last 1 events
 2020-09-04 10:17:47 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:17:47 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_1
 2020-09-04 10:17:47 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:17:47 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:17:47 read_replica DEBUG pg_lib.py (3401): Binlog position:638723111
 2020-09-04 10:17:47 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:17:47
 2020-09-04 10:17:47 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_1
 2020-09-04 10:17:47 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552009 in class variable
 2020-09-04 10:17:47 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552009
 2020-09-04 10:17:47 read_replica DEBUG pg_lib.py (3609): updating batch 1552009 to processed
 2020-09-04 10:17:47 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552009
 2020-09-04 10:17:47 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:47 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:48 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:17:48 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:48 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:48 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:48 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:48 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:48 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552010, 'mysql-bin.000006', 638723111, 't_log_replica_mysql_1', None)]
 2020-09-04 10:17:48 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:48 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638723111. id_batch: 1552010
 2020-09-04 10:17:48 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638723111.
 2020-09-04 10:17:48 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:48 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:49 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:49 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:49 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:49 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:49 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:49 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552010, 'mysql-bin.000006', 638723111, 't_log_replica_mysql_1', None)]
 2020-09-04 10:17:49 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:50 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638723111. id_batch: 1552010
 2020-09-04 10:17:50 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638723111.
 2020-09-04 10:17:50 read_replica DEBUG mysql_lib.py (1301): writing the last 2 events
 2020-09-04 10:17:50 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:17:50 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_2
 2020-09-04 10:17:50 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:17:50 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:17:50 read_replica DEBUG pg_lib.py (3401): Binlog position:638724440
 2020-09-04 10:17:50 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:17:49
 2020-09-04 10:17:50 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_2
 2020-09-04 10:17:50 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552010 in class variable
 2020-09-04 10:17:50 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552010
 2020-09-04 10:17:50 read_replica DEBUG pg_lib.py (3609): updating batch 1552010 to processed
 2020-09-04 10:17:50 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552010
 2020-09-04 10:17:50 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:50 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:50 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:17:50 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:50 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:50 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:51 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:51 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:51 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552011, 'mysql-bin.000006', 638724440, 't_log_replica_mysql_2', None)]
 2020-09-04 10:17:51 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:51 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638724440. id_batch: 1552011
 2020-09-04 10:17:51 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638724440.
 2020-09-04 10:17:51 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:51 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:51 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:51 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:51 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:52 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:52 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:52 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552011, 'mysql-bin.000006', 638724440, 't_log_replica_mysql_2', None)]
 2020-09-04 10:17:52 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:52 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:52 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:52 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:52 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638724440. id_batch: 1552011
 2020-09-04 10:17:52 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638724440.
 2020-09-04 10:17:52 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:52 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:53 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:53 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:53 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:53 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:53 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:53 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552011, 'mysql-bin.000006', 638724440, 't_log_replica_mysql_2', None)]
 2020-09-04 10:17:53 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:54 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638724440. id_batch: 1552011
 2020-09-04 10:17:54 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638724440.
 2020-09-04 10:17:54 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:54 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:54 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:54 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:54 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:55 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:55 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:55 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552011, 'mysql-bin.000006', 638724440, 't_log_replica_mysql_2', None)]
 2020-09-04 10:17:55 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:55 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638724440. id_batch: 1552011
 2020-09-04 10:17:55 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638724440.
 2020-09-04 10:17:55 read_replica DEBUG mysql_lib.py (1301): writing the last 1 events
 2020-09-04 10:17:55 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:17:55 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_1
 2020-09-04 10:17:55 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:17:55 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:17:55 read_replica DEBUG pg_lib.py (3401): Binlog position:638725162
 2020-09-04 10:17:55 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:17:54
 2020-09-04 10:17:55 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_1
 2020-09-04 10:17:55 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552011 in class variable
 2020-09-04 10:17:55 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552011
 2020-09-04 10:17:55 read_replica DEBUG pg_lib.py (3609): updating batch 1552011 to processed
 2020-09-04 10:17:55 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552011
 2020-09-04 10:17:55 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:55 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:55 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:55 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:55 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:56 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:17:56 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:56 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:56 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552012, 'mysql-bin.000006', 638725162, 't_log_replica_mysql_1', None)]
 2020-09-04 10:17:56 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:56 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638725162. id_batch: 1552012
 2020-09-04 10:17:56 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638725162.
 2020-09-04 10:17:56 read_replica DEBUG mysql_lib.py (1301): writing the last 1 events
 2020-09-04 10:17:56 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:17:56 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_2
 2020-09-04 10:17:56 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:17:56 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:17:56 read_replica DEBUG pg_lib.py (3401): Binlog position:638725769
 2020-09-04 10:17:56 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:17:55
 2020-09-04 10:17:56 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_2
 2020-09-04 10:17:56 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552012 in class variable
 2020-09-04 10:17:56 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552012
 2020-09-04 10:17:56 read_replica DEBUG pg_lib.py (3609): updating batch 1552012 to processed
 2020-09-04 10:17:56 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552012
 2020-09-04 10:17:56 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:56 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:56 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:56 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:56 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:57 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:17:57 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:57 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:57 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552013, 'mysql-bin.000006', 638725769, 't_log_replica_mysql_2', None)]
 2020-09-04 10:17:57 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:57 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:57 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:57 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:58 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638725769. id_batch: 1552013
 2020-09-04 10:17:58 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638725769.
 2020-09-04 10:17:58 read_replica DEBUG mysql_lib.py (1301): writing the last 1 events
 2020-09-04 10:17:58 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:17:58 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_1
 2020-09-04 10:17:58 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:17:58 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:17:58 read_replica DEBUG pg_lib.py (3401): Binlog position:638726376
 2020-09-04 10:17:58 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:17:56
 2020-09-04 10:17:58 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_1
 2020-09-04 10:17:58 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552013 in class variable
 2020-09-04 10:17:58 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552013
 2020-09-04 10:17:58 read_replica DEBUG pg_lib.py (3609): updating batch 1552013 to processed
 2020-09-04 10:17:58 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552013
 2020-09-04 10:17:58 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:58 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:17:58 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:17:59 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:17:59 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:17:59 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:17:59 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:17:59 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:17:59 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552014, 'mysql-bin.000006', 638726376, 't_log_replica_mysql_1', None)]
 2020-09-04 10:17:59 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:17:59 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638726376. id_batch: 1552014
 2020-09-04 10:17:59 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638726376.
 2020-09-04 10:17:59 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:17:59 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:18:00 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:00 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:00 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:00 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:18:00 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:18:00 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552014, 'mysql-bin.000006', 638726376, 't_log_replica_mysql_1', None)]
 2020-09-04 10:18:00 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:18:00 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638726376. id_batch: 1552014
 2020-09-04 10:18:00 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638726376.
 2020-09-04 10:18:00 read_replica DEBUG mysql_lib.py (1301): writing the last 9 events
 2020-09-04 10:18:00 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:18:00 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_2
 2020-09-04 10:18:00 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:18:00 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:18:00 read_replica DEBUG pg_lib.py (3401): Binlog position:638752772
 2020-09-04 10:18:00 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:18:00
 2020-09-04 10:18:00 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_2
 2020-09-04 10:18:00 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552014 in class variable
 2020-09-04 10:18:00 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552014
 2020-09-04 10:18:00 read_replica DEBUG pg_lib.py (3609): updating batch 1552014 to processed
 2020-09-04 10:18:00 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552014
 2020-09-04 10:18:00 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:18:00 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:18:01 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:01 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:01 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:01 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:18:01 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:18:01 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:18:01 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552015, 'mysql-bin.000006', 638752772, 't_log_replica_mysql_2', None)]
 2020-09-04 10:18:01 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:18:02 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638752772. id_batch: 1552015
 2020-09-04 10:18:02 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638752772.
 2020-09-04 10:18:02 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:18:02 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:18:02 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:02 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:02 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:03 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:18:03 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:18:03 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552015, 'mysql-bin.000006', 638752772, 't_log_replica_mysql_2', None)]
 2020-09-04 10:18:03 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:18:03 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:03 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:03 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:03 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638752772. id_batch: 1552015
 2020-09-04 10:18:03 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638752772.
 2020-09-04 10:18:03 read_replica DEBUG mysql_lib.py (1301): writing the last 1 events
 2020-09-04 10:18:03 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:18:03 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_1
 2020-09-04 10:18:03 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:18:03 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:18:03 read_replica DEBUG pg_lib.py (3401): Binlog position:638753379
 2020-09-04 10:18:03 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:18:03
 2020-09-04 10:18:03 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_1
 2020-09-04 10:18:03 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552015 in class variable
 2020-09-04 10:18:03 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552015
 2020-09-04 10:18:03 read_replica DEBUG pg_lib.py (3609): updating batch 1552015 to processed
 2020-09-04 10:18:03 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552015
 2020-09-04 10:18:03 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:18:03 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:18:03 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:18:04 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:04 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:04 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:04 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:18:04 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:18:04 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552016, 'mysql-bin.000006', 638753379, 't_log_replica_mysql_1', None)]
 2020-09-04 10:18:04 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:18:04 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638753379. id_batch: 1552016
 2020-09-04 10:18:04 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638753379.
 2020-09-04 10:18:04 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:18:04 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:18:05 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:05 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:05 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:05 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:18:05 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:18:05 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552016, 'mysql-bin.000006', 638753379, 't_log_replica_mysql_1', None)]
 2020-09-04 10:18:05 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:18:06 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638753379. id_batch: 1552016
 2020-09-04 10:18:06 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638753379.
 2020-09-04 10:18:06 read_replica DEBUG mysql_lib.py (1301): writing the last 2 events
 2020-09-04 10:18:06 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:18:06 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_2
 2020-09-04 10:18:06 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:18:06 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:18:06 read_replica DEBUG pg_lib.py (3401): Binlog position:638754708
 2020-09-04 10:18:06 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:18:04
 2020-09-04 10:18:06 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_2
 2020-09-04 10:18:06 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552016 in class variable
 2020-09-04 10:18:06 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552016
 2020-09-04 10:18:06 read_replica DEBUG pg_lib.py (3609): updating batch 1552016 to processed
 2020-09-04 10:18:06 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552016
 2020-09-04 10:18:06 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:18:06 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:18:06 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:06 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:06 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:06 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:18:07 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:18:07 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:18:07 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552017, 'mysql-bin.000006', 638754708, 't_log_replica_mysql_2', None)]
 2020-09-04 10:18:07 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:18:07 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638754708. id_batch: 1552017
 2020-09-04 10:18:07 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638754708.
 2020-09-04 10:18:07 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:18:07 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:18:07 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:07 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:07 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:08 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:18:08 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:18:08 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552017, 'mysql-bin.000006', 638754708, 't_log_replica_mysql_2', None)]
 2020-09-04 10:18:08 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:18:08 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:08 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:08 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:08 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638754708. id_batch: 1552017
 2020-09-04 10:18:08 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638754708.
 2020-09-04 10:18:08 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:18:08 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 
 2020-09-04 10:18:09 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:09 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:09 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:09 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:18:09 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:18:09 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552017, 'mysql-bin.000006', 638754708, 't_log_replica_mysql_2', None)]
 2020-09-04 10:18:09 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:18:10 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638754708. id_batch: 1552017
 2020-09-04 10:18:10 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638754708.
 2020-09-04 10:18:10 read_replica DEBUG mysql_lib.py (1301): writing the last 1 events
 2020-09-04 10:18:10 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:18:10 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_1
 2020-09-04 10:18:10 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:18:10 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:18:10 read_replica DEBUG pg_lib.py (3401): Binlog position:638755430
 2020-09-04 10:18:10 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:18:09
 2020-09-04 10:18:10 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_1
 2020-09-04 10:18:10 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552017 in class variable
 2020-09-04 10:18:10 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552017
 2020-09-04 10:18:10 read_replica DEBUG pg_lib.py (3609): updating batch 1552017 to processed
 2020-09-04 10:18:10 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552017
 2020-09-04 10:18:10 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:18:10 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:18:10 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:10 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:10 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:10 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:18:11 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:18:11 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:18:11 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552018, 'mysql-bin.000006', 638755430, 't_log_replica_mysql_1', None)]
 2020-09-04 10:18:11 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:18:11 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638755430. id_batch: 1552018
 2020-09-04 10:18:11 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638755430.
 2020-09-04 10:18:11 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:18:11 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:18:11 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:11 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:11 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:12 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:18:12 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:18:12 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552018, 'mysql-bin.000006', 638755430, 't_log_replica_mysql_1', None)]
 2020-09-04 10:18:12 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:18:12 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638755430. id_batch: 1552018
 2020-09-04 10:18:12 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638755430.
 2020-09-04 10:18:12 read_replica DEBUG mysql_lib.py (1301): writing the last 1 events
 2020-09-04 10:18:12 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:18:12 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_2
 2020-09-04 10:18:12 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:18:12 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:18:12 read_replica DEBUG pg_lib.py (3401): Binlog position:638756037
 2020-09-04 10:18:12 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:18:11
 2020-09-04 10:18:12 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_2
 2020-09-04 10:18:12 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552018 in class variable
 2020-09-04 10:18:12 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552018
 2020-09-04 10:18:12 read_replica DEBUG pg_lib.py (3609): updating batch 1552018 to processed
 2020-09-04 10:18:12 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552018
 2020-09-04 10:18:12 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:18:12 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:18:12 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:12 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:12 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:13 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:18:13 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:18:13 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:18:13 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552019, 'mysql-bin.000006', 638756037, 't_log_replica_mysql_2', None)]
 2020-09-04 10:18:13 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:18:14 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:14 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:14 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:14 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638756037. id_batch: 1552019
 2020-09-04 10:18:14 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638756037.
 2020-09-04 10:18:14 read_replica DEBUG mysql_lib.py (1301): writing the last 1 events
 2020-09-04 10:18:14 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:18:14 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_1
 2020-09-04 10:18:14 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:18:14 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:18:14 read_replica DEBUG pg_lib.py (3401): Binlog position:638756644
 2020-09-04 10:18:14 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:18:12
 2020-09-04 10:18:14 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_1
 2020-09-04 10:18:14 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552019 in class variable
 2020-09-04 10:18:14 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552019
 2020-09-04 10:18:14 read_replica DEBUG pg_lib.py (3609): updating batch 1552019 to processed
 2020-09-04 10:18:14 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552019
 2020-09-04 10:18:14 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:18:14 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:18:14 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:18:15 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:15 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:15 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:15 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:18:15 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:18:15 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552020, 'mysql-bin.000006', 638756644, 't_log_replica_mysql_1', None)]
 2020-09-04 10:18:15 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:18:15 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638756644. id_batch: 1552020
 2020-09-04 10:18:15 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638756644.
 2020-09-04 10:18:15 read_replica DEBUG mysql_lib.py (1301): writing the last 1 events
 2020-09-04 10:18:15 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:18:15 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_2
 2020-09-04 10:18:15 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:18:15 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:18:15 read_replica DEBUG pg_lib.py (3401): Binlog position:638757366
 2020-09-04 10:18:15 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:18:14
 2020-09-04 10:18:15 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_2
 2020-09-04 10:18:15 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552020 in class variable
 2020-09-04 10:18:15 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552020
 2020-09-04 10:18:15 read_replica DEBUG pg_lib.py (3609): updating batch 1552020 to processed
 2020-09-04 10:18:15 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552020
 2020-09-04 10:18:15 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:18:15 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:18:16 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:16 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:16 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:16 replay_replica INFO pg_lib.py (1169): Replayed at most 10000 rows for source mysql
 2020-09-04 10:18:16 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:18:16 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:18:16 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552021, 'mysql-bin.000006', 638757366, 't_log_replica_mysql_2', None)]
 2020-09-04 10:18:16 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:18:16 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638757366. id_batch: 1552021
 2020-09-04 10:18:16 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638757366.
 2020-09-04 10:18:16 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:18:16 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:18:17 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:17 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:17 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:17 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:18:17 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:18:17 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552021, 'mysql-bin.000006', 638757366, 't_log_replica_mysql_2', None)]
 2020-09-04 10:18:17 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:18:18 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638757366. id_batch: 1552021
 2020-09-04 10:18:18 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638757366.
 2020-09-04 10:18:18 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:18:18 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:18:18 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:18 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:18 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:19 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:18:19 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:18:19 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552021, 'mysql-bin.000006', 638757366, 't_log_replica_mysql_2', None)]
 2020-09-04 10:18:19 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:18:19 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:19 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:19 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:19 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638757366. id_batch: 1552021
 2020-09-04 10:18:19 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638757366.
 2020-09-04 10:18:19 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:18:19 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 2020-09-04 10:18:20 MainProcess DEBUG global_lib.py (555): Replica process for source mysql is running
 2020-09-04 10:18:20 MainProcess DEBUG pg_lib.py (620): Changing the autocommit flag to True
 2020-09-04 10:18:20 MainProcess DEBUG pg_lib.py (1236): Cleaning replayed batches for source mysql older than 3 day
 2020-09-04 10:18:20 read_replica DEBUG pg_lib.py (640): There is already a database connection active.
 2020-09-04 10:18:20 read_replica DEBUG pg_lib.py (3070): Collecting schema mappings for source mysql
 2020-09-04 10:18:20 read_replica DEBUG mysql_lib.py (1335): Batch data [(1552021, 'mysql-bin.000006', 638757366, 't_log_replica_mysql_2', None)]
 2020-09-04 10:18:20 read_replica DEBUG mysql_lib.py (893): collecting table type map
 2020-09-04 10:18:20 read_replica DEBUG mysql_lib.py (1105): GTID DISABLED - log_file mysql-bin.000006, log_position 638757366. id_batch: 1552021
 2020-09-04 10:18:20 read_replica DEBUG mysql_lib.py (1119): ROTATE EVENT - binlogfile mysql-bin.000006, position 638757366.
 2020-09-04 10:18:20 read_replica DEBUG mysql_lib.py (1301): writing the last 2 events
 2020-09-04 10:18:20 read_replica DEBUG mysql_lib.py (1345): trying to save the master data...
 2020-09-04 10:18:20 read_replica DEBUG pg_lib.py (2017): New log table : t_log_replica_mysql_1
 2020-09-04 10:18:20 read_replica INFO pg_lib.py (3399): Saved master data for source: mysql
 2020-09-04 10:18:20 read_replica DEBUG pg_lib.py (3400): Binlog file: mysql-bin.000006
 2020-09-04 10:18:20 read_replica DEBUG pg_lib.py (3401): Binlog position:638758695
 2020-09-04 10:18:20 read_replica DEBUG pg_lib.py (3402): Last event: 2020-09-04 10:18:19
 2020-09-04 10:18:20 read_replica DEBUG pg_lib.py (3403): Next log table name: t_log_replica_mysql_1
 2020-09-04 10:18:20 read_replica DEBUG mysql_lib.py (1348): new batch created, saving id_batch 1552021 in class variable
 2020-09-04 10:18:20 read_replica DEBUG mysql_lib.py (1353): updating processed flag for id_batch 1552021
 2020-09-04 10:18:20 read_replica DEBUG pg_lib.py (3609): updating batch 1552021 to processed
 2020-09-04 10:18:20 read_replica DEBUG pg_lib.py (3620): collecting events id for batch 1552021
 2020-09-04 10:18:20 read_replica DEBUG pg_lib.py (3281): Checking consistent status for source: mysql
 2020-09-04 10:18:20 read_replica DEBUG pg_lib.py (3310): The source: mysql is consistent
 ^C2020-09-04 10:18:21 MainProcess INFO global_lib.py (171): Caught stop replica signal terminating daemons and ending the replica process.
 2020-09-04 10:18:21 replay_replica INFO global_lib.py (171): Caught stop replica signal terminating daemons and ending the replica process.

the4thdoctor · 2020-09-04T05:39:43Z

I suggest you to upgrade pgchameleon to the latest version 2.0.14 as some bugs and improvements have been done.
Check the changelog here.
For the upgrade instructions check the release notes here.
However even with the version 2.0.12 I can still replicate the DDL.
In which schema is the problematic table?
I see you have several schemas replicated from the mysql source.

schema_mappings:
  gui: gui
  MAIL: MAIL
  MO: MO
  BD: BD

gaganturna · 2020-09-04T07:02:12Z

HI,

This one is version on staging but in my production I am using version 2.0.14. And over there I sometimes face same issue.

Moreover I have tried altering table in MAIL, gui and BD schema and faced issue in all three sometimes.

Is there any issue in configuration file.

gaganturna · 2020-09-08T06:27:16Z

Hi,

Any other suggestions.

the4thdoctor · 2020-09-08T10:24:26Z

I understand there is a problem but I will check it out when I have time. By the end of the week as I work on this project on free time.
I'll let you know ASAP.

gaganturna · 2020-09-09T05:24:49Z

Hi,

Sure, thanks for update. Will be waiting.

the4thdoctor self-assigned this Sep 3, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Alter table changes not replicated to destination postgres db most of the time. #123

Alter table changes not replicated to destination postgres db most of the time. #123

gaganturna commented Sep 3, 2020

the4thdoctor commented Sep 3, 2020

gaganturna commented Sep 4, 2020

the4thdoctor commented Sep 4, 2020 •

edited

Loading

gaganturna commented Sep 4, 2020

gaganturna commented Sep 8, 2020

the4thdoctor commented Sep 8, 2020

gaganturna commented Sep 9, 2020

Alter table changes not replicated to destination postgres db most of the time. #123

Alter table changes not replicated to destination postgres db most of the time. #123

Comments

gaganturna commented Sep 3, 2020

the4thdoctor commented Sep 3, 2020

gaganturna commented Sep 4, 2020

the4thdoctor commented Sep 4, 2020 • edited Loading

gaganturna commented Sep 4, 2020

gaganturna commented Sep 8, 2020

the4thdoctor commented Sep 8, 2020

gaganturna commented Sep 9, 2020

the4thdoctor commented Sep 4, 2020 •

edited

Loading