How pentaho's copy block handles dublicate data? -


i trying copy mysql db hana db through pentaho's copy table wizard. automatically created workflow confused if destination db partially filled, handle dublicate rows or copy them anyways?

the copy table wizard doesn't analyze duplicates. attempts run bunch of insert statements destination db. it's job etl developer ensure duplicate data filtered out or alternatively, updated on target db. check insert/update step. performance of course lower, each row first database lookup , depending on lookup results either insert or update issued.


Comments

Popular posts from this blog

Python Kivy ListView: How to delete selected ListItemButton? -

asp.net mvc 4 - A specified Include path is not valid. The EntityType '' does not declare a navigation property with the name '' -