Fetching {incremental_value} for incremental load from different schema than target. #382
Unanswered
rohitbatta
asked this question in
Q&A
Replies: 1 comment
-
|
You can now do this with hooks. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I am trying to load the data from source (oracle) to target (sqlserver). I am using incremental load approach to fetch delta and using last_modified column to load the data. Once data is loaded to sqlserver schema "staging", i would transform that data to different schema and cleanup staging schema.
For next run, there is no record in staging schema to calculate max_value for last_modified. Is there any option to pick the {incremant_value} dynamically from other schema from same database or picking max value from different table and pass it as {increment_value}
Beta Was this translation helpful? Give feedback.
All reactions