April 25, 2019
Suppose we have some data in a production OLTP database, and we need to send it to some OLAP database. This post describes one of the simplest approaches, and how to make it productional enough to rely on.
For every table t, we need to:
introduce a new field, updated_at introduce a new index on that field, so we can get the records that changed after a certain updated_at. For example,