You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
mysql-cdc init mode how to specify snapshot chunk position?
because the table is very big. I want to pull data such as sql below select * from source where id between 500000000 and 550000000
and then I will reform the data structure, then insert to postgreSQL.
but It's take very long time to target snapshot chunk. So, I want to know that is there some way to specify the snapshot chunk offset, to locate target source data.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
各位大神啊,
mysql-cdc init 这种模式,在同步快照阶段,怎么指定快照的位置啊? (当然可以自己写程序,但是想只维护一个模式)
因为数据量在10亿级别,需要对数据进行分批量转化,所以想指定一下快照的位置。
还是说,我这种使用方式,其实不是很恰当? 烦请指点一二,不胜感激。🙏
Dear masters of flink cdc,
mysql-cdc init mode how to specify snapshot chunk position?
because the table is very big. I want to pull data such as sql below
select * from source where id between 500000000 and 550000000
and then I will reform the data structure, then insert to postgreSQL.
but It's take very long time to target snapshot chunk. So, I want to know that is there some way to specify the snapshot chunk offset, to locate target source data.
Beta Was this translation helpful? Give feedback.
All reactions