Recommended approach to process CDC data

[almoehi]

Hi,

I am trying to figure out what the best approach would be for handling postgres CDC data. I currently have it in a append-only raw table (in duckdb) which contains initial snapshot data and subsequent update/insert/delete events - identified by a flag column.

What is the recommended approach to process CDC data with sqlmesh?

Incremental by unique key and when matched ?

I was hoping to use duckdb but it seems like that is not supported with when matched.

Any other suggestions ?

Thanks & Cheers!