Werner Daehn
Dec 21, 2021

--

Valid points but not necessarily a K.O. criteria. If a file arrives only occasionally then you can call this the change event and stream its rows. It is the same thing as a database transaction changing 100k rows at once. And how to figure out if something arrived can be different things, e.g. scanning a directory every five minutes in worst case.

Modifying a single SQL statement for sure is easier. But if you have a large integration task with 100s of them, some dependent on each other, a choreography of flows might actually be easier. Maybe.

--

--

Werner Daehn
Werner Daehn

Written by Werner Daehn

Data Integration expert for Big Data and SAP

Responses (1)