Skip to content

kingbase中在mysql模式下如果有integer字段类型则执行增量cdc会将字段过滤掉 #473

@baisui1981

Description

@baisui1981

用户反馈在kingbase中在mysql模式下如果有integer字段类型则执行增量cdc会将字段过滤掉,导致数据同步不正常。

CREATE TABLE `flow_node_expand` (
	`id` character varying(64)  NOT NULL,
	`join_pattern` integer NULL,
	 PRIMARY KEY (`id`)
)

INSERT INTO `flow_node_expand` (`id`, `join_pattern`) 
VALUES ('test_id_123', 1);
CREATE TABLE `flow_inst_expand` (
	`id` bigint NOT NULL,
	`proc_inst_id` character varying(64) COLLATE `ci_x_icu` NULL,
	`main_doc` character varying(32) COLLATE `ci_x_icu` NULL,
	`document_no` character varying(64) COLLATE `ci_x_icu` NULL,
	`urgent_flag` character varying(2) COLLATE `ci_x_icu` NULL,
	`secrecy` character varying(32) COLLATE `ci_x_icu` NULL,
	`secrecy_term` character varying(32) COLLATE `ci_x_icu` NULL,
	`storage_period` character varying(1000) COLLATE `ci_x_icu` NULL,
	`conclude_time_limit` date NULL,
	`special_bean_id` character varying(64) COLLATE `ci_x_icu` NULL,
	`file_system_call_back` character varying(255) COLLATE `ci_x_icu` NULL,
	`file_system_des` character varying(255) COLLATE `ci_x_icu` NULL,
	`file_system_file_id` character varying(255) COLLATE `ci_x_icu` NULL,
	`push_file_system_flag` integer NULL,
	`receive_dept` character varying(255) COLLATE `ci_x_icu` NULL,
	`form_definition_cache_key` character varying(255) COLLATE `ci_x_icu` NULL,
	`create_by` character varying(255) COLLATE `ci_x_icu` NULL,
	`create_time` datetime NULL,
	`update_by` character varying(255) COLLATE `ci_x_icu` NULL,
	`update_time` datetime NULL,
	`del_flag` character varying(2) COLLATE `ci_x_icu` NULL DEFAULT '0'::varchar,
	`push_date` datetime NULL,
	`show_color` character varying(32) COLLATE `ci_x_icu` NULL,
	CONSTRAINT `PRIMARY_F205051D` PRIMARY KEY (id),
	CONSTRAINT `idx_proc_inst_id_2EB519ED` UNIQUE (proc_inst_id)
)TABLESPACE sys_default;

CREATE TABLE `act_hi_procinst` (
	`ID_` character varying(64) COLLATE `ci_x_icu` NOT NULL,
	`REV_` integer NULL DEFAULT 1,
	`PROC_INST_ID_` character varying(64) COLLATE `ci_x_icu` NOT NULL,
	`BUSINESS_KEY_` character varying(750) COLLATE `ci_x_icu` NULL,
	`PROC_DEF_ID_` character varying(64) COLLATE `ci_x_icu` NOT NULL,
	`START_TIME_` datetime(3) NULL,
	`END_TIME_` datetime(3) NULL,
	`DURATION_` bigint NULL,
	`START_USER_ID_` character varying(255) COLLATE `ci_x_icu` NULL,
	`START_ACT_ID_` character varying(255) COLLATE `ci_x_icu` NULL,
	`END_ACT_ID_` character varying(255) COLLATE `ci_x_icu` NULL,
	`SUPER_PROCESS_INSTANCE_ID_` character varying(64) COLLATE `ci_x_icu` NULL,
	`DELETE_REASON_` character varying(4000) COLLATE `ci_x_icu` NULL,
	`TENANT_ID_` character varying(255) COLLATE `ci_x_icu` NULL DEFAULT ''::varchar,
	`NAME_` character varying(255) COLLATE `ci_x_icu` NULL,
	`CALLBACK_ID_` character varying(255) COLLATE `ci_x_icu` NULL,
	`CALLBACK_TYPE_` character varying(255) COLLATE `ci_x_icu` NULL,
	CONSTRAINT `PRIMARY_58130377` PRIMARY KEY (ID_)
)TABLESPACE sys_default;

报告一下错误信息:
Image

另外有大量字段类型不识别的问题:

2025-11-28 12:58:48,588 WARN  io.debezium.relational.TableSchemaBuilder                    [] - No converter found for column public.flow_node_expand.join_pattern of type int. The column will not be part of change events for that table.
2025-11-28 12:58:48,588 WARN  io.debezium.connector.postgresql.TypeRegistry                [] - Unknown OID -1 requested
2025-11-28 12:58:48,588 WARN  io.debezium.relational.TableSchemaBuilder                    [] - No converter found for column public.flow_node_expand.duration_ of type bigint. The column will not be part of change events for that table.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions